-- Logs begin at Thu 2022-06-30 02:17:41 UTC, end at Thu 2022-06-30 04:05:29 UTC. -- Jun 30 03:34:28.993487 dv-cinder-846842-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 30 03:34:29.003204 dv-cinder-846842-7-smb devstack@keystone.service[87029]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 30 03:34:29.005136 dv-cinder-846842-7-smb devstack@keystone.service[87029]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 03:34:29 2022] *** Jun 30 03:34:29.005136 dv-cinder-846842-7-smb devstack@keystone.service[87029]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 03:34:29.005136 dv-cinder-846842-7-smb devstack@keystone.service[87029]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 03:34:29.005136 dv-cinder-846842-7-smb devstack@keystone.service[87029]: nodename: dv-cinder-846842-7-smb Jun 30 03:34:29.005136 dv-cinder-846842-7-smb devstack@keystone.service[87029]: machine: x86_64 Jun 30 03:34:29.005136 dv-cinder-846842-7-smb devstack@keystone.service[87029]: clock source: unix Jun 30 03:34:29.005136 dv-cinder-846842-7-smb devstack@keystone.service[87029]: pcre jit disabled Jun 30 03:34:29.005136 dv-cinder-846842-7-smb devstack@keystone.service[87029]: detected number of CPU cores: 4 Jun 30 03:34:29.005136 dv-cinder-846842-7-smb devstack@keystone.service[87029]: current working directory: / Jun 30 03:34:29.005136 dv-cinder-846842-7-smb devstack@keystone.service[87029]: detected binary path: /usr/bin/uwsgi-core Jun 30 03:34:29.005136 dv-cinder-846842-7-smb devstack@keystone.service[87029]: your processes number limit is 47680 Jun 30 03:34:29.005821 dv-cinder-846842-7-smb devstack@keystone.service[87029]: your memory page size is 4096 bytes Jun 30 03:34:29.005821 dv-cinder-846842-7-smb devstack@keystone.service[87029]: detected max file descriptor number: 2048 Jun 30 03:34:29.005821 dv-cinder-846842-7-smb devstack@keystone.service[87029]: lock engine: pthread robust mutexes Jun 30 03:34:29.005821 dv-cinder-846842-7-smb devstack@keystone.service[87029]: thunder lock: enabled Jun 30 03:34:29.005821 dv-cinder-846842-7-smb devstack@keystone.service[87029]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 30 03:34:29.005821 dv-cinder-846842-7-smb devstack@keystone.service[87029]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 03:34:29.051433 dv-cinder-846842-7-smb devstack@keystone.service[87029]: Python main interpreter initialized at 0x56220f4009c0 Jun 30 03:34:29.051433 dv-cinder-846842-7-smb devstack@keystone.service[87029]: python threads support enabled Jun 30 03:34:29.051433 dv-cinder-846842-7-smb devstack@keystone.service[87029]: your server socket listen backlog is limited to 100 connections Jun 30 03:34:29.051433 dv-cinder-846842-7-smb devstack@keystone.service[87029]: your mercy for graceful operations on workers is 90 seconds Jun 30 03:34:29.051793 dv-cinder-846842-7-smb devstack@keystone.service[87029]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 03:34:29.051862 dv-cinder-846842-7-smb devstack@keystone.service[87029]: *** Operational MODE: preforking *** Jun 30 03:34:29.052123 dv-cinder-846842-7-smb devstack@keystone.service[87029]: *** uWSGI is running in multiple interpreter mode *** Jun 30 03:34:29.052123 dv-cinder-846842-7-smb devstack@keystone.service[87029]: spawned uWSGI master process (pid: 87029) Jun 30 03:34:29.052335 dv-cinder-846842-7-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 30 03:34:29.053387 dv-cinder-846842-7-smb devstack@keystone.service[87029]: spawned uWSGI worker 1 (pid: 87039, cores: 1) Jun 30 03:34:29.053387 dv-cinder-846842-7-smb devstack@keystone.service[87029]: spawned uWSGI worker 2 (pid: 87040, cores: 1) Jun 30 03:34:29.053387 dv-cinder-846842-7-smb devstack@keystone.service[87029]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 03:34:34.512717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 03:34:34.512717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: from cryptography.utils import int_from_bytes Jun 30 03:34:34.513545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 03:34:34.513545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: from cryptography.utils import int_from_bytes Jun 30 03:34:34.513545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 03:34:34.513545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: from cryptography.utils import int_from_bytes Jun 30 03:34:34.514064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 03:34:34.514064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: from cryptography.utils import int_from_bytes Jun 30 03:34:34.561265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 03:34:34.561469 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 03:34:34.561552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 03:34:34.561625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] command line args: [] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 03:34:34.561689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 03:34:34.561751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] command line args: [] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 03:34:34.561817 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 03:34:34.561983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ================================================================================ {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 03:34:34.562067 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 03:34:34.562177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ================================================================================ {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 03:34:34.562250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] admin_token = **** {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.562455 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] admin_token = **** {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.562590 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] config_dir = [] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.562671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.562737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] config_dir = [] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.562839 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] config_source = [] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.562900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.563023 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] debug = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.563173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] config_source = [] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.563259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.563424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] debug = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.563424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.563578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.563644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.563707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.563769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.563928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.564016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.564200 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.564325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.564392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] list_limit = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.564456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] list_limit = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.564586 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] log_config_append = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.564672 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] log_config_append = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.564738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.564801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.564916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] log_dir = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.564994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] log_dir = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.565059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] log_file = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.565124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] log_file = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.565308 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.565432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.565565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.565644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.565758 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.565843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.566038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.566172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.566249 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.566313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.566384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.566446 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.566597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.566683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.566823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.566897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.567089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.567220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.567302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.567368 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.567490 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.567582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.567743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.567873 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.567956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.568028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.568218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.568339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.568433 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.568508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.568941 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.569024 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.569104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] publish_errors = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.569166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] publish_errors = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.569340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.569427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.569557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.569682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.569801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.569886 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.569964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.570098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.570190 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.570263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.570380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] standard_threads = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.570464 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] standard_threads = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.570616 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.570745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.570856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.570934 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.571010 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.571087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.571195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] use_journal = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.571278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] use_journal = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.571355 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] use_json = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.571426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] use_json = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.571523 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] use_stderr = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.571604 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] use_stderr = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.571684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] use_syslog = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.571799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] use_syslog = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.571904 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.571992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 03:34:34.572163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.572244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.572397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.572478 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.572652 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.572737 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.572889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.572969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.573143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.573227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.573368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.573453 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.573611 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.573697 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.573843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.573923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.574090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.574170 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.574333 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.574414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.574582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.574663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.574827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.574919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.575096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.575184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.575329 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.575410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.575573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.575653 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.575818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.575903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.576056 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.576130 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.576271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.576347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.576522 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.576597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.576759 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.576834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.576990 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.577076 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.577239 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.577315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.577591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.577673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.577843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.577918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.578089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.578165 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.578319 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.578395 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.578544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.578619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.578780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.578858 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.579026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.579110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.579271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.579347 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.579521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.579605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.579748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.579829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.579974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.580056 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.580216 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.580304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.580461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.580539 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.580694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.580768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.580941 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.581024 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.581170 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.581249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.581401 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.581482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.581629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.581777 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.581850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.581924 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.582070 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.582145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.582296 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.582383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.582519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.582594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.582751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.582884 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.583020 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.583107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.583245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.583321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.583480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.583556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.583704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.583788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.583937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.584012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.584165 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.584240 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.584411 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.584495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.584639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.584750 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.584872 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.584978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.585107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.585216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.585312 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.585405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.585550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.585684 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.585816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.585900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.586013 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.586087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.586221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.586354 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.586448 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.586526 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.586672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.586841 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.586931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.587014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.587170 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.587255 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.587400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.587536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.587681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.587814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.587935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.588066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.588187 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.588328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.588450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.588570 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.588692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.588823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.588953 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.589072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.589194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.589325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.589456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.589583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.589711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.589833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.589953 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.590073 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.590193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.590317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.590446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.590573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.590696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.590935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.591059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.591233 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.591233 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.591509 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.591628 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.591753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.591885 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.592009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.592141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.592266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.592395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.592523 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.592647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.592772 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.592905 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.593043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.593253 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.593378 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.593504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.593633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.593841 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.593969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.594093 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.594217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.594340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.594463 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.594595 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.594727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.594884 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.595022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.595147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.595270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.595394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.595517 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.595653 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.595778 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.595901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.596026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.596150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.596280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.596412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.596535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.596659 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.596792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.596922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.597047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.597182 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.597306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.597431 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.597554 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.597554 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.597795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.597918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] auth.external = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.598042 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] auth.external = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.598176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.598298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.598432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.598594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.598730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.598908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.599027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] auth.password = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.599152 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] auth.password = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.599278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] auth.token = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.599401 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] auth.token = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.599532 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.599681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.599812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.599941 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.600066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.600196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.600333 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.600465 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.600589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.600713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.600834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.600954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.601078 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.601220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.601344 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] credential.caching = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.601468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] credential.caching = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.601592 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.601715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.601838 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.601979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.602105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.602229 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.602353 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.602477 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.602600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.602732 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.602907 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.603024 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.603148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.603272 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.603396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.603870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.603994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.604130 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.604256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.604391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.604517 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.604649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.604776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.604899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.605023 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.605146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.605277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.605408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.605534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.605658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.605792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] federation.caching = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.605915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] federation.caching = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.606039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.606170 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.606295 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.606485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.606661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.606813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.606935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.607066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.607187 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.607313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.607438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.607563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.607699 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.607833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.607959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.608084 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.608209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.608333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.608457 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.608589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.608721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.608846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.608970 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity.caching = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.609094 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity.caching = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.609218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.609426 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.609559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.609690 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.609816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.609941 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.610074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.610202 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.610326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.610450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.610574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.610699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.610877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.611005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.611130 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.611264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.611390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.611514 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.611647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.611772 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.611896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.612021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.612145 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.612269 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.612404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.612532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.612656 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.612781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.612922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.613047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.613182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.613308 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.613435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.613560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.613685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.613759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.613930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.614057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.614181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.614304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.614427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.614550 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.614688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.614828 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.614948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.615072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.615196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.615276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.615449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.615575 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.615699 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.615823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.615948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.616072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.616205 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.616339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.616469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.616594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.616718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.616842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.616974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.617100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.617224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.617347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.617478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.617602 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.617733 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.617857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.617981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.618115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.618240 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.618361 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.618489 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.618601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.618731 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.618869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.618990 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.619111 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.619246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.619371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.619495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.619618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.619742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.619875 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.620008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.620189 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.620312 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.620434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.620555 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.620676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.620805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.620927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.621047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.621169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.621290 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.621411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.621549 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.621671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.621792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.621913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.622081 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.622237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.622375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.622504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.622625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.622747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.622901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.623037 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.623163 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.623288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.623427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.623552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.623676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.623809 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.623934 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.624059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.624182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.624306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.624432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.624565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.624690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.624814 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.624938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.625072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.625197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.625329 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.625456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.625580 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.625704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.625828 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.625951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.626083 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.626209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.626335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.626460 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.626583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.626707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.626837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.626905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.627091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.627214 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.627337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.627337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.627581 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.627705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.627705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.627937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.628060 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.628182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.628313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.628437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.628575 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.628699 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.628821 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.628944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.629074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.629198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.629321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.629444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.629568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.629692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.629824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.629948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.630071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.630194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.630326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.630450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.630582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.630707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.630876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.631002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.631127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.631250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.631381 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] resource.caching = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.631506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.631506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] resource.caching = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.631741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.631864 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.631997 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.632129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.632254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.632377 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.632504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.632623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.632747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.632877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.633001 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.633124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.633247 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.633370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.633493 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.633691 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.633831 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.633955 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.634077 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] role.caching = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.634201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] role.caching = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.634323 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] role.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.634454 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] role.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.634578 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.634702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.634841 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.634962 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.635087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.635222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.635347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.635471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.635603 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.635728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.635859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.635985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.636109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.636232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.636356 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.636479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.636610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.636735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.636859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.636983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.637107 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.637240 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.637372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.637497 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.637656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.637850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.637989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.638116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.638249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.638372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.638497 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.638620 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.638744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.638931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.639079 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.639204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.639328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.639452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.639576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.639700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.639833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.639958 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.640083 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.640214 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.640341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.640465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.640596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.640736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.640860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.640985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.641109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.641233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.641364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.641488 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.641612 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.641735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.641859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.641991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.642115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.642239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.642362 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.642505 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.642629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.642774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.642904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.643031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.643155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] token.caching = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.643279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] token.caching = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.643402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.643534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.643658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.643781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.643905 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.644028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.644161 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.644294 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.644420 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.644420 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.644653 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.644776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.644776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.645025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.645150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.645273 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.645398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.645521 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.645644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.645644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.645895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.646019 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.646143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.646143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.646376 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.646376 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.646617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.646740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.646892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.646892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.647127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.647261 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.647385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.connection = **** {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.647519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.647659 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.647783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.647907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.647907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.648140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.connection = **** {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.648276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.648416 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.648542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.648665 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.648788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.648910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.649034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.649166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.649301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.649425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.649549 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.649672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.649796 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.649927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.650053 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.650176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.650300 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.650422 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.650546 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.650677 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.650816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.650937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.651072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.651360 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.651486 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.651623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.651749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.651873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.651997 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.652122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.652248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 03:34:34.652382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.652382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.652382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 03:34:34.652382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 03:34:34.675563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.675795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.675951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.676041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.676167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.676370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.684375 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.684740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.712315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.712521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.712651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.712845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.858436 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.858922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.907260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.907498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.909335 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.909573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.970644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.970847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.971032 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.971128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.971296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.971427 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.971503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.971577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.971693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.971795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.971901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.972135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.996730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.996957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.997133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.997249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.997347 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.997450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.997548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.997639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.997710 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.997778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.997892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.997980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.998120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:34.998302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.008991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.009298 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.021695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.021935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.022135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.022232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.022331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.022405 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.022578 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.022716 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.022846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.022925 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.022988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87040) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.023058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.023181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.023412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87039) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 03:34:35.040346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.040559 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 03:34:35.040895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.041018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.041181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 03:34:35.041265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 03:34:35.041327 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.041439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.041638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.041761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 03:34:35.041907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.042038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.042158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.042277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.042432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.042576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.053095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.053370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.053638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.053926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.054013 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.054168 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.054401 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.054671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.062185 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.062958 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.065479 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.065757 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.066037 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.066161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.066287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.066498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.066622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.066782 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.066909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.067030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.067166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.067302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.067425 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.067503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.067620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.067736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.067869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.067989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.068109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.068232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.068518 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.068762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.094972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.095177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.096578 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.096703 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.096863 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.096998 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.102270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.102544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.102955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.103080 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.103397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.104393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.110748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.110954 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.115261 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.115457 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.115552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.115685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.115958 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.116234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.116506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.116774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.117040 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.117304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.120025 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.120312 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.120591 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.120874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.121151 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.121407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.121676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.122846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.135809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.136084 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.140715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.140841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.141003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.144372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.144664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.145674 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.149304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.149598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.149720 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.153391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.154920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.157224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.157518 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.157791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.158067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.158350 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.158473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.158618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.162173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.162474 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.162750 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.163045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.163327 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.163602 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.177723 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.178000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.178262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.178517 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.182657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.182960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.183228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.183489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.186428 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.188153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.188427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.191403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.191688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.191962 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.192238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.192517 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.192784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.193105 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.193387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.196658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.196931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.197214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.197490 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.197770 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.206022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.206312 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.206590 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.206888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.207175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.208768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.209066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.211097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.211387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.211667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.211945 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.212234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.213859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.214159 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.226811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.230404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.232513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.233875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.235623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.235828 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.237233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.237502 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.237776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.239149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.240873 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.242490 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.242783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.243077 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.245101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.246692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.250013 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.250311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.250506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.250715 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.251016 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.252006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.255257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.255550 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.255944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.256225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.260112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.260404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.260679 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.265385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.265669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.265947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.268596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87039) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.268867 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.269141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.269407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.269673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.270047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.270326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.270591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.270895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.271161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.271440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.271678 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.271935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.272192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87039) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.273872 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87040) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 03:34:35.274150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.274432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.274706 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.275005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.275383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.275668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.275941 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.276233 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.276506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.276790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.277053 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.277302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.277568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87040) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 03:34:35.310344 dv-cinder-846842-7-smb devstack@keystone.service[87039]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56220f4009c0 pid: 87039 (default app) Jun 30 03:34:35.313772 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6a86b-5fb6-42a6-9279-ada84040ab27 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:35.314067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6a86b-5fb6-42a6-9279-ada84040ab27 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:35.314343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6a86b-5fb6-42a6-9279-ada84040ab27 None None] PATH_INFO: `/v3` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:35.315629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56220f4009c0 pid: 87040 (default app) Jun 30 03:34:35.318579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Thu Jun 30 03:34:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:42.973189 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30cf23-47ed-4417-8e1d-e1b058635cda None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:42.973769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30cf23-47ed-4417-8e1d-e1b058635cda None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:42.973769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30cf23-47ed-4417-8e1d-e1b058635cda None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:42.978526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:34:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:34:42.985496 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57201282-aed5-476b-b512-6914fb657f91 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:42.986219 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57201282-aed5-476b-b512-6914fb657f91 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:42.986372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57201282-aed5-476b-b512-6914fb657f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:43.059029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: INFO dbcounter [None req-57201282-aed5-476b-b512-6914fb657f91 None None] Registered counter for database keystone Jun 30 03:34:43.084423 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG oslo_db.sqlalchemy.engines [None req-57201282-aed5-476b-b512-6914fb657f91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87039) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 03:34:43.094536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writer thread running {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 03:34:43.276273 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG passlib.handlers.bcrypt [None req-57201282-aed5-476b-b512-6914fb657f91 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87039) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 30 03:34:43.276586 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG passlib.handlers.bcrypt [None req-57201282-aed5-476b-b512-6914fb657f91 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87039) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 30 03:34:43.332131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-57201282-aed5-476b-b512-6914fb657f91 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:34:43.333760 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-57201282-aed5-476b-b512-6914fb657f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:34:43.476068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:34:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 30 03:34:43.711379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30cf23-47ed-4417-8e1d-e1b058635cda None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:43.784625 dv-cinder-846842-7-smb devstack@keystone.service[87040]: INFO dbcounter [None req-6f30cf23-47ed-4417-8e1d-e1b058635cda None None] Registered counter for database keystone Jun 30 03:34:43.807164 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG oslo_db.sqlalchemy.engines [None req-6f30cf23-47ed-4417-8e1d-e1b058635cda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 03:34:43.816629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writer thread running {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 03:34:43.936308 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30cf23-47ed-4417-8e1d-e1b058635cda None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:43.941862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32643194-5231-4388-8547-496f53eaae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:43.942529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32643194-5231-4388-8547-496f53eaae36 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:43.942853 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32643194-5231-4388-8547-496f53eaae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:43.943109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32643194-5231-4388-8547-496f53eaae36 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:43.952185 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32643194-5231-4388-8547-496f53eaae36 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:44.004647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: WARNING keystone.common.rbac_enforcer.enforcer [None req-32643194-5231-4388-8547-496f53eaae36 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 30 03:34:44.005177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32643194-5231-4388-8547-496f53eaae36 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:44.015669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Jun 30 03:34:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:34:44.025506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57201282-aed5-476b-b512-6914fb657f91 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:44.047302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57201282-aed5-476b-b512-6914fb657f91 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:44.053058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2b3aa-38e7-48e5-9a78-5effeb1414f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:44.054196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2b3aa-38e7-48e5-9a78-5effeb1414f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:44.054478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2b3aa-38e7-48e5-9a78-5effeb1414f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:44.054757 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2b3aa-38e7-48e5-9a78-5effeb1414f9 admin admin] PATH_INFO: `/v3/projects/26fd4a4f105a4803a50f2696df78fba5` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:44.058985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2b3aa-38e7-48e5-9a78-5effeb1414f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=26fd4a4f105a4803a50f2696df78fba5)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:44.109961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: WARNING keystone.common.rbac_enforcer.enforcer [None req-76b2b3aa-38e7-48e5-9a78-5effeb1414f9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 30 03:34:44.110295 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2b3aa-38e7-48e5-9a78-5effeb1414f9 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:44.114904 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Thu Jun 30 03:34:44 2022] GET /identity/v3/projects/26fd4a4f105a4803a50f2696df78fba5 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:46.107151 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2b3e-119e-4ada-8975-beed19fac800 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:46.107708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2b3e-119e-4ada-8975-beed19fac800 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:46.107708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2b3e-119e-4ada-8975-beed19fac800 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:46.111869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:34:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:34:46.118626 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41484b29-3683-458d-b048-6a6e5e1e4328 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:46.119092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41484b29-3683-458d-b048-6a6e5e1e4328 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:46.119250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41484b29-3683-458d-b048-6a6e5e1e4328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:46.146841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-41484b29-3683-458d-b048-6a6e5e1e4328 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:34:46.148330 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-41484b29-3683-458d-b048-6a6e5e1e4328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:34:46.158435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:34:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 30 03:34:46.186597 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2b3e-119e-4ada-8975-beed19fac800 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:46.206425 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2b3e-119e-4ada-8975-beed19fac800 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:46.212110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549c083-0258-4407-98f8-b5be70a9e85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:46.212747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549c083-0258-4407-98f8-b5be70a9e85f admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:46.213045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549c083-0258-4407-98f8-b5be70a9e85f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:46.213316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549c083-0258-4407-98f8-b5be70a9e85f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:46.222049 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549c083-0258-4407-98f8-b5be70a9e85f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:46.223874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549c083-0258-4407-98f8-b5be70a9e85f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:46.233961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Jun 30 03:34:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:34:46.242641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41484b29-3683-458d-b048-6a6e5e1e4328 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:46.257816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41484b29-3683-458d-b048-6a6e5e1e4328 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:46.265629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1911983-a42a-4fb0-baab-a23783e4bdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:46.267063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911983-a42a-4fb0-baab-a23783e4bdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:46.267480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911983-a42a-4fb0-baab-a23783e4bdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:46.267916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911983-a42a-4fb0-baab-a23783e4bdf3 admin admin] PATH_INFO: `/v3/users/7c1cf291bfd64ba287443cde4df814a7` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:46.270373 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1911983-a42a-4fb0-baab-a23783e4bdf3 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c1cf291bfd64ba287443cde4df814a7)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:46.273441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1911983-a42a-4fb0-baab-a23783e4bdf3 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:46.276035 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Thu Jun 30 03:34:46 2022] GET /identity/v3/users/7c1cf291bfd64ba287443cde4df814a7 => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:48.348669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca91e4-facc-4126-ad71-c661abab06c2 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:48.349213 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca91e4-facc-4126-ad71-c661abab06c2 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:48.349213 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca91e4-facc-4126-ad71-c661abab06c2 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:48.350568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:34:48.357985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970b6af-7a88-4c34-b0db-2fc40c6fe03f None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:48.357985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970b6af-7a88-4c34-b0db-2fc40c6fe03f None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:48.357985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970b6af-7a88-4c34-b0db-2fc40c6fe03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:48.373906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-b970b6af-7a88-4c34-b0db-2fc40c6fe03f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:34:48.375092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-b970b6af-7a88-4c34-b0db-2fc40c6fe03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:34:48.394743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5cfb4-22ce-44b4-99ee-5287c83d6ff8 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:48.395069 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5cfb4-22ce-44b4-99ee-5287c83d6ff8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:48.395494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5cfb4-22ce-44b4-99ee-5287c83d6ff8 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:48.396840 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:34:48.401803 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee068d4-e83c-4cd3-babe-c14c0e007d79 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:48.402095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee068d4-e83c-4cd3-babe-c14c0e007d79 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:48.402372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee068d4-e83c-4cd3-babe-c14c0e007d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:48.443568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG passlib.handlers.bcrypt [None req-cee068d4-e83c-4cd3-babe-c14c0e007d79 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87040) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 30 03:34:48.443971 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG passlib.handlers.bcrypt [None req-cee068d4-e83c-4cd3-babe-c14c0e007d79 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87040) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 30 03:34:48.459889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:34:48.485066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970b6af-7a88-4c34-b0db-2fc40c6fe03f None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:48.489709 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-cee068d4-e83c-4cd3-babe-c14c0e007d79 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:34:48.491345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-cee068d4-e83c-4cd3-babe-c14c0e007d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:34:48.510286 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:48.593078 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:34:48.596765 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970b6af-7a88-4c34-b0db-2fc40c6fe03f None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:48.619881 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee068d4-e83c-4cd3-babe-c14c0e007d79 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:48.634023 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747d8bb-b50a-4529-8b35-2a4401c76349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:48.634857 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d8bb-b50a-4529-8b35-2a4401c76349 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:48.635137 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d8bb-b50a-4529-8b35-2a4401c76349 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:48.635411 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d8bb-b50a-4529-8b35-2a4401c76349 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:48.647008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747d8bb-b50a-4529-8b35-2a4401c76349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-d747d8bb-b50a-4529-8b35-2a4401c76349 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:34:48.662972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:34:48.663948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:34:48.664762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:34:48.664762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:34:48.664762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:34:48.664762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:34:48.664762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:34:48.664762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:34:48.664762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:34:48.664762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:34:48.664762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:34:48.664762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:34:48.664762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:34:48.664762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:34:48.664762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:34:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:34:48.670229 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747d8bb-b50a-4529-8b35-2a4401c76349 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:48.726810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee068d4-e83c-4cd3-babe-c14c0e007d79 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:48.729595 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:48.755767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:48.764476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a2736-b93d-42df-b62f-79c2859b871b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:48.765396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a2736-b93d-42df-b62f-79c2859b871b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:48.765687 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a2736-b93d-42df-b62f-79c2859b871b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:48.765963 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a2736-b93d-42df-b62f-79c2859b871b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:48.774201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747d8bb-b50a-4529-8b35-2a4401c76349 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:48.808100 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2df32-1875-4d4a-91f1-f23f11e9be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:48.808771 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2df32-1875-4d4a-91f1-f23f11e9be0e None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:48.809175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2df32-1875-4d4a-91f1-f23f11e9be0e None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:48.809371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2df32-1875-4d4a-91f1-f23f11e9be0e None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:48.810100 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2df32-1875-4d4a-91f1-f23f11e9be0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:34:48.810414 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2df32-1875-4d4a-91f1-f23f11e9be0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:48.811862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2df32-1875-4d4a-91f1-f23f11e9be0e None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:48.823421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:34:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:34:48.829471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2df32-1875-4d4a-91f1-f23f11e9be0e None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:48.834955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a2736-b93d-42df-b62f-79c2859b871b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:48.836497 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a2736-b93d-42df-b62f-79c2859b871b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:48.930521 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2df32-1875-4d4a-91f1-f23f11e9be0e None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:48.937933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 03:34:48.943799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a2736-b93d-42df-b62f-79c2859b871b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:48.946963 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:48.964978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14631418-e240-412e-a601-3131f71df406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:48.966001 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14631418-e240-412e-a601-3131f71df406 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:48.966286 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14631418-e240-412e-a601-3131f71df406 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:48.966570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14631418-e240-412e-a601-3131f71df406 None admin] PATH_INFO: `/v3/users/7c1cf291bfd64ba287443cde4df814a7` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:48.967833 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14631418-e240-412e-a601-3131f71df406 None admin] RBAC: Authorizing `identity:get_user(user_id=7c1cf291bfd64ba287443cde4df814a7)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:48.969319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14631418-e240-412e-a601-3131f71df406 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:48.971006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:34:48 2022] GET /identity/v3/users/7c1cf291bfd64ba287443cde4df814a7 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:34:48.976354 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14631418-e240-412e-a601-3131f71df406 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:49.001376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:49.043553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a2736-b93d-42df-b62f-79c2859b871b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:49.076594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df292612-4c69-4b84-a993-ebe4a4c98587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:49.077399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df292612-4c69-4b84-a993-ebe4a4c98587 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:49.077681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df292612-4c69-4b84-a993-ebe4a4c98587 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:49.077954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df292612-4c69-4b84-a993-ebe4a4c98587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:49.097721 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df292612-4c69-4b84-a993-ebe4a4c98587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:49.099236 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df292612-4c69-4b84-a993-ebe4a4c98587 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:49.109843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14631418-e240-412e-a601-3131f71df406 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-df292612-4c69-4b84-a993-ebe4a4c98587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:34:49.120142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:34:49.120947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:34:49.121751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:34:49.121751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:34:49.121751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:34:49.121751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:34:49.121751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:34:49.128121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df292612-4c69-4b84-a993-ebe4a4c98587 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:49.145404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897f7da-31f2-45b4-bf50-f7c752df76dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:49.146153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897f7da-31f2-45b4-bf50-f7c752df76dd None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:49.146435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897f7da-31f2-45b4-bf50-f7c752df76dd None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:49.146714 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897f7da-31f2-45b4-bf50-f7c752df76dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:49.147931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897f7da-31f2-45b4-bf50-f7c752df76dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:49.149402 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897f7da-31f2-45b4-bf50-f7c752df76dd None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:49.151055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:34:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:49.156873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897f7da-31f2-45b4-bf50-f7c752df76dd None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:49.185142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:49.229227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df292612-4c69-4b84-a993-ebe4a4c98587 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:49.235924 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:49.255696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897f7da-31f2-45b4-bf50-f7c752df76dd None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:49.264185 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19b9ba-8047-4e3e-b599-94e89883c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:49.264852 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b9ba-8047-4e3e-b599-94e89883c6bb None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:49.265134 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b9ba-8047-4e3e-b599-94e89883c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:49.265415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b9ba-8047-4e3e-b599-94e89883c6bb None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:49.266142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19b9ba-8047-4e3e-b599-94e89883c6bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:34:49.266453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19b9ba-8047-4e3e-b599-94e89883c6bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:49.267887 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19b9ba-8047-4e3e-b599-94e89883c6bb None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:49.284974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 10/20] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:34:49.289335 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad50f2c-9ba7-4e66-b902-f68a2a044cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:49.290016 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad50f2c-9ba7-4e66-b902-f68a2a044cca None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:49.290303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad50f2c-9ba7-4e66-b902-f68a2a044cca None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:49.290582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad50f2c-9ba7-4e66-b902-f68a2a044cca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:49.291483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad50f2c-9ba7-4e66-b902-f68a2a044cca None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.domain.id=default, user.id=7c1cf291bfd64ba287443cde4df814a7) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:34:49.291800 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad50f2c-9ba7-4e66-b902-f68a2a044cca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:49.293421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad50f2c-9ba7-4e66-b902-f68a2a044cca None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:49.302014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 11/21] 10.222.0.26 () {56 vars in 1322 bytes} [Thu Jun 30 03:34:49 2022] GET /identity/v3/role_assignments?user.id=7c1cf291bfd64ba287443cde4df814a7&scope.domain.id=default&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:51.510978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0fbfc-cd65-40cc-8277-a215ed3186df None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:51.511489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0fbfc-cd65-40cc-8277-a215ed3186df None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:51.511644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0fbfc-cd65-40cc-8277-a215ed3186df None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:51.513091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 11/22] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:34:51.518687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee994f17-a72b-4147-b83f-824aedb0d4c8 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:51.519123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee994f17-a72b-4147-b83f-824aedb0d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:51.519277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee994f17-a72b-4147-b83f-824aedb0d4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:51.542684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ee994f17-a72b-4147-b83f-824aedb0d4c8 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:34:51.544722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ee994f17-a72b-4147-b83f-824aedb0d4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:34:51.641018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:34:51.677339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0fbfc-cd65-40cc-8277-a215ed3186df None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:51.714462 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba94f5-3afc-4242-9b52-1fbf2fd665cb None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:51.714651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba94f5-3afc-4242-9b52-1fbf2fd665cb None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:51.714919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba94f5-3afc-4242-9b52-1fbf2fd665cb None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:51.716430 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:34:51.722565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9d466-8ae5-451c-bce6-6d98eed61d02 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:51.722869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9d466-8ae5-451c-bce6-6d98eed61d02 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:51.723146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9d466-8ae5-451c-bce6-6d98eed61d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:51.773501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-cee9d466-8ae5-451c-bce6-6d98eed61d02 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:34:51.774618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cee9d466-8ae5-451c-bce6-6d98eed61d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:34:51.883074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 14/25] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:34:51.912953 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0fbfc-cd65-40cc-8277-a215ed3186df None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:51.936315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9d466-8ae5-451c-bce6-6d98eed61d02 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:51.939722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:51.977104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:52.065700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9d466-8ae5-451c-bce6-6d98eed61d02 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:52.076508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f891bc-aa41-4962-8694-01480fc809a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:52.077436 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f891bc-aa41-4962-8694-01480fc809a4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:52.077723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f891bc-aa41-4962-8694-01480fc809a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:52.077995 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f891bc-aa41-4962-8694-01480fc809a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:52.102904 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45af95e-e76c-4978-9325-36ccedee44db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:52.104571 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45af95e-e76c-4978-9325-36ccedee44db None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:52.104992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45af95e-e76c-4978-9325-36ccedee44db None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:52.105418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45af95e-e76c-4978-9325-36ccedee44db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:52.117642 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45af95e-e76c-4978-9325-36ccedee44db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:52.119367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f891bc-aa41-4962-8694-01480fc809a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:34:52.119503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45af95e-e76c-4978-9325-36ccedee44db None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-a9f891bc-aa41-4962-8694-01480fc809a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:34:52.137613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:34:52.138576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:34:52.139403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:34:52.139403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:34:52.139403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:34:52.139403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:34:52.139403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:34:52.139403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:34:52.139403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:34:52.139403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:34:52.139403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:34:52.139403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:34:52.139403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:34:52.139403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-e45af95e-e76c-4978-9325-36ccedee44db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:34:52.141175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:34:52.141943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:34:52.142742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:34:52.142742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:34:52.142742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:34:52.142742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:34:52.144334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 15/26] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:34:52.145954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 12/27] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:34:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 469 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:34:52.146169 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205d92e-7bed-42c5-83b7-55d0d7bf1c92 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:52.146745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205d92e-7bed-42c5-83b7-55d0d7bf1c92 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:52.147232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205d92e-7bed-42c5-83b7-55d0d7bf1c92 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:52.148712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 16/28] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:34:52.155805 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f891bc-aa41-4962-8694-01480fc809a4 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:52.160767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c34d4-c244-4aec-b2a4-a7c6dcb922a1 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:52.162708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c34d4-c244-4aec-b2a4-a7c6dcb922a1 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:52.162708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c34d4-c244-4aec-b2a4-a7c6dcb922a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:52.223848 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-409c34d4-c244-4aec-b2a4-a7c6dcb922a1 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:34:52.225081 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-409c34d4-c244-4aec-b2a4-a7c6dcb922a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:34:52.303758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f891bc-aa41-4962-8694-01480fc809a4 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:52.352074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:52.374214 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 17/29] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:34:52.375428 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c34d4-c244-4aec-b2a4-a7c6dcb922a1 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:52.407141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a14eff-07d4-4e64-a19c-425f809bcb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:52.409803 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a14eff-07d4-4e64-a19c-425f809bcb03 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:52.410611 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a14eff-07d4-4e64-a19c-425f809bcb03 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:52.412008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a14eff-07d4-4e64-a19c-425f809bcb03 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:52.413115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a14eff-07d4-4e64-a19c-425f809bcb03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:34:52.414658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a14eff-07d4-4e64-a19c-425f809bcb03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:52.416382 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a14eff-07d4-4e64-a19c-425f809bcb03 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:52.431680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 13/30] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:52.432898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e2d5-4bb5-4390-97f0-502b35eac778 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:52.433200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e2d5-4bb5-4390-97f0-502b35eac778 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:52.433498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e2d5-4bb5-4390-97f0-502b35eac778 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:52.443763 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 14/31] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:34:52 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:34:52.444613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075e2d5-4bb5-4390-97f0-502b35eac778 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:52.515834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c34d4-c244-4aec-b2a4-a7c6dcb922a1 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:52.548834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:52.556318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e872faa-e9c6-4d65-9eb6-3174241e22c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:52.557601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e872faa-e9c6-4d65-9eb6-3174241e22c3 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:52.558074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e872faa-e9c6-4d65-9eb6-3174241e22c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:52.558532 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e872faa-e9c6-4d65-9eb6-3174241e22c3 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:52.560305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e872faa-e9c6-4d65-9eb6-3174241e22c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:34:52.562380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e872faa-e9c6-4d65-9eb6-3174241e22c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:52.564028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e872faa-e9c6-4d65-9eb6-3174241e22c3 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:52.574486 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 18/32] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:34:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:52.575616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e872faa-e9c6-4d65-9eb6-3174241e22c3 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:52.632473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:52.684444 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075e2d5-4bb5-4390-97f0-502b35eac778 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:52.700110 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e872faa-e9c6-4d65-9eb6-3174241e22c3 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:52.721617 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0426d7-097d-419f-97a7-7fba0eeec00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:52.722300 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0426d7-097d-419f-97a7-7fba0eeec00f None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:52.722584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0426d7-097d-419f-97a7-7fba0eeec00f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:52.722902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0426d7-097d-419f-97a7-7fba0eeec00f None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:52.723672 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0426d7-097d-419f-97a7-7fba0eeec00f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:52.725083 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0426d7-097d-419f-97a7-7fba0eeec00f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:52.744305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de546f-5eba-42b3-95de-8841c7e5bbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:52.745447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de546f-5eba-42b3-95de-8841c7e5bbd3 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:52.745938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de546f-5eba-42b3-95de-8841c7e5bbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:52.746508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de546f-5eba-42b3-95de-8841c7e5bbd3 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:52.747536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de546f-5eba-42b3-95de-8841c7e5bbd3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:52.749453 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de546f-5eba-42b3-95de-8841c7e5bbd3 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:52.867178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 15/33] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 30 03:34:52 2022] POST /identity/v3/roles => generated 225 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:34:52.868942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d283c0a-482c-4448-82d0-14c0fc4ae40e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:52.869238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d283c0a-482c-4448-82d0-14c0fc4ae40e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:52.869525 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d283c0a-482c-4448-82d0-14c0fc4ae40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:52.897521 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 19/34] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 03:34:52 2022] POST /identity/v3/projects => generated 301 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:34:52.898915 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de546f-5eba-42b3-95de-8841c7e5bbd3 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:52.908123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-3d283c0a-482c-4448-82d0-14c0fc4ae40e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:34:52.909791 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3d283c0a-482c-4448-82d0-14c0fc4ae40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:34:53.104804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 16/35] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:34:53.112714 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de546f-5eba-42b3-95de-8841c7e5bbd3 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:53.120707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:53.136083 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d283c0a-482c-4448-82d0-14c0fc4ae40e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:53.162270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b8928-016c-4d0b-ac38-8b8463e155b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:53.163228 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b8928-016c-4d0b-ac38-8b8463e155b8 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:53.163511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b8928-016c-4d0b-ac38-8b8463e155b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:53.163788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b8928-016c-4d0b-ac38-8b8463e155b8 None admin] PATH_INFO: `/v3/users/7c1cf291bfd64ba287443cde4df814a7` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:53.167663 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b8928-016c-4d0b-ac38-8b8463e155b8 None admin] RBAC: Authorizing `identity:get_user(user_id=7c1cf291bfd64ba287443cde4df814a7)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:53.170365 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b8928-016c-4d0b-ac38-8b8463e155b8 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:53.172379 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 20/36] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:34:52 2022] GET /identity/v3/users/7c1cf291bfd64ba287443cde4df814a7 => generated 247 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:53.176764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:53.179011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b8928-016c-4d0b-ac38-8b8463e155b8 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:53.282067 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d283c0a-482c-4448-82d0-14c0fc4ae40e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:53.307599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b8928-016c-4d0b-ac38-8b8463e155b8 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:53.318897 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2052bc-c6e5-4c4c-881b-08c4f5a09184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:53.319628 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2052bc-c6e5-4c4c-881b-08c4f5a09184 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:53.319875 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2052bc-c6e5-4c4c-881b-08c4f5a09184 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:53.320178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2052bc-c6e5-4c4c-881b-08c4f5a09184 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:53.320948 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2052bc-c6e5-4c4c-881b-08c4f5a09184 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:53.322526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2052bc-c6e5-4c4c-881b-08c4f5a09184 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:53.340443 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 17/37] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 30 03:34:53 2022] POST /identity/v3/roles => generated 219 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:34:53.342191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d0cf0-a5d4-48d3-8df7-ea53210170ef None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:53.342719 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d0cf0-a5d4-48d3-8df7-ea53210170ef None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:53.343231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d0cf0-a5d4-48d3-8df7-ea53210170ef None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:53.344900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 18/38] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:34:53.352301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc8e55-879d-4ba7-8839-2d3f7f46977a None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:53.353271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc8e55-879d-4ba7-8839-2d3f7f46977a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:53.353769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc8e55-879d-4ba7-8839-2d3f7f46977a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:53.373985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-62dc8e55-879d-4ba7-8839-2d3f7f46977a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:34:53.375897 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-62dc8e55-879d-4ba7-8839-2d3f7f46977a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:34:53.471022 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 19/39] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:34:53.472211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33023c0-bf3c-415f-be0d-5c2d04d17f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:53.473073 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33023c0-bf3c-415f-be0d-5c2d04d17f7a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:53.473351 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af41a-cc19-40db-9411-fb1e6a946ef7 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:53.473447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33023c0-bf3c-415f-be0d-5c2d04d17f7a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:53.473624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33023c0-bf3c-415f-be0d-5c2d04d17f7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:53.473714 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af41a-cc19-40db-9411-fb1e6a946ef7 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:53.473906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af41a-cc19-40db-9411-fb1e6a946ef7 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:53.475133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33023c0-bf3c-415f-be0d-5c2d04d17f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:53.475359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 20/40] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:34:53.477103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33023c0-bf3c-415f-be0d-5c2d04d17f7a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:53.479276 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 21/41] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:34:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:53.481328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7f5f5-cdc4-4e81-ba6d-112be093f086 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:53.481618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7f5f5-cdc4-4e81-ba6d-112be093f086 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:53.481898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7f5f5-cdc4-4e81-ba6d-112be093f086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:53.485600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33023c0-bf3c-415f-be0d-5c2d04d17f7a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:53.504321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-c5c7f5f5-cdc4-4e81-ba6d-112be093f086 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:34:53.505546 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c5c7f5f5-cdc4-4e81-ba6d-112be093f086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:34:53.518544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:53.525448 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:53.586211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 21/42] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:34:53.587077 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7f5f5-cdc4-4e81-ba6d-112be093f086 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:53.604229 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33023c0-bf3c-415f-be0d-5c2d04d17f7a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:53.638013 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6dbe4-82bf-4d33-8772-d5a16142816d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:53.638946 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6dbe4-82bf-4d33-8772-d5a16142816d None admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:53.639231 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6dbe4-82bf-4d33-8772-d5a16142816d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:53.639511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6dbe4-82bf-4d33-8772-d5a16142816d None admin] PATH_INFO: `/v3/domains/default/users/7c1cf291bfd64ba287443cde4df814a7/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:53.641533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6dbe4-82bf-4d33-8772-d5a16142816d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7c1cf291bfd64ba287443cde4df814a7, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:53.643044 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6dbe4-82bf-4d33-8772-d5a16142816d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:53.658435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 22/43] 10.222.0.26 () {58 vars in 1361 bytes} [Thu Jun 30 03:34:53 2022] PUT /identity/v3/domains/default/users/7c1cf291bfd64ba287443cde4df814a7/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:34:53.659265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6dbe4-82bf-4d33-8772-d5a16142816d None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:53.690803 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7f5f5-cdc4-4e81-ba6d-112be093f086 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:53.732714 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867faf1f-1187-40cf-bd5c-5951529b858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:53.733481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867faf1f-1187-40cf-bd5c-5951529b858d None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:53.733862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867faf1f-1187-40cf-bd5c-5951529b858d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:53.734147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867faf1f-1187-40cf-bd5c-5951529b858d None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:53.734956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867faf1f-1187-40cf-bd5c-5951529b858d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:53.736683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867faf1f-1187-40cf-bd5c-5951529b858d None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:53.753619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 30 03:34:53 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:34:53.794259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:53.803415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6dbe4-82bf-4d33-8772-d5a16142816d None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:53.850088 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6de43-ea5e-45a0-a7db-5dadf920fd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:53.851150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6de43-ea5e-45a0-a7db-5dadf920fd1d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:53.851498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6de43-ea5e-45a0-a7db-5dadf920fd1d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:53.851787 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6de43-ea5e-45a0-a7db-5dadf920fd1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:53.853491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6de43-ea5e-45a0-a7db-5dadf920fd1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:53.855284 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6de43-ea5e-45a0-a7db-5dadf920fd1d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:53.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 23/45] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:34:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:53.863973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867faf1f-1187-40cf-bd5c-5951529b858d None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:53.874321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:53.979482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867faf1f-1187-40cf-bd5c-5951529b858d None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:54.013213 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ba82b-d69f-497f-8384-a5b4241ae5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:54.013815 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ba82b-d69f-497f-8384-a5b4241ae5f9 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:54.014101 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ba82b-d69f-497f-8384-a5b4241ae5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:54.014387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ba82b-d69f-497f-8384-a5b4241ae5f9 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:54.015405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ba82b-d69f-497f-8384-a5b4241ae5f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:54.016896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ba82b-d69f-497f-8384-a5b4241ae5f9 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:54.047915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 03:34:53 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:34:55.703141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c716595-865e-4e71-9bed-d356c713fcc7 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:55.703685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c716595-865e-4e71-9bed-d356c713fcc7 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:55.703685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c716595-865e-4e71-9bed-d356c713fcc7 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:55.705081 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 24/47] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:34:55.710472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcbbb9-2d1d-412c-8650-c3e9c727a364 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:55.710930 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcbbb9-2d1d-412c-8650-c3e9c727a364 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:55.711020 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcbbb9-2d1d-412c-8650-c3e9c727a364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:55.728874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-4bbcbbb9-2d1d-412c-8650-c3e9c727a364 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:34:55.730078 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4bbcbbb9-2d1d-412c-8650-c3e9c727a364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:34:55.785059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:55.799838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:34:55.823091 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c716595-865e-4e71-9bed-d356c713fcc7 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:55.928658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c716595-865e-4e71-9bed-d356c713fcc7 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:55.963672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebad2a2-cfa8-41aa-8f08-9ad31aec4f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:55.964386 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebad2a2-cfa8-41aa-8f08-9ad31aec4f3a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:55.964695 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebad2a2-cfa8-41aa-8f08-9ad31aec4f3a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:55.964958 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebad2a2-cfa8-41aa-8f08-9ad31aec4f3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:55.975314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebad2a2-cfa8-41aa-8f08-9ad31aec4f3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-5ebad2a2-cfa8-41aa-8f08-9ad31aec4f3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:34:55.983408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:34:55.984278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:34:55.985332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:34:55.985332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:34:55.985332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:34:55.985332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:34:55.985332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:34:55.985332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:34:55.985332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:34:55.985332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:34:55.985332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:34:55.985332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:34:55.985332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:34:55.985332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:34:55.985332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 25/49] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:34:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:34:55.990580 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcbbb9-2d1d-412c-8650-c3e9c727a364 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:56.036308 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9806e-2b4b-4770-aa1d-810f04f63fe6 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:56.036594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9806e-2b4b-4770-aa1d-810f04f63fe6 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:56.036820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9806e-2b4b-4770-aa1d-810f04f63fe6 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:56.038380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 26/50] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:34:56.043305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3aa1e-c5eb-40e7-8cd2-c5ae4af5c9a9 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:56.043583 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3aa1e-c5eb-40e7-8cd2-c5ae4af5c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:56.043863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3aa1e-c5eb-40e7-8cd2-c5ae4af5c9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:56.061474 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-1dd3aa1e-c5eb-40e7-8cd2-c5ae4af5c9a9 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:34:56.063025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-1dd3aa1e-c5eb-40e7-8cd2-c5ae4af5c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:34:56.082066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:56.094253 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcbbb9-2d1d-412c-8650-c3e9c727a364 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:56.129104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c5a2e-39c9-45e6-900b-fbf6e96e2f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:56.129771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c5a2e-39c9-45e6-900b-fbf6e96e2f92 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:56.130056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c5a2e-39c9-45e6-900b-fbf6e96e2f92 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:56.130332 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c5a2e-39c9-45e6-900b-fbf6e96e2f92 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:56.131159 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c5a2e-39c9-45e6-900b-fbf6e96e2f92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:34:56.131472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c5a2e-39c9-45e6-900b-fbf6e96e2f92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:56.132467 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 27/51] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:34:56.132949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c5a2e-39c9-45e6-900b-fbf6e96e2f92 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:56.145232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 25/52] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:34:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:56.150981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3aa1e-c5eb-40e7-8cd2-c5ae4af5c9a9 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:56.155489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c5a2e-39c9-45e6-900b-fbf6e96e2f92 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:56.204491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:56.251834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3aa1e-c5eb-40e7-8cd2-c5ae4af5c9a9 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:56.254415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c5a2e-39c9-45e6-900b-fbf6e96e2f92 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:56.288984 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b0ef4-4248-446c-b5de-3afcf56da39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:56.289473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8898832-bde4-4d04-8a48-648ffeeb3bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:56.289778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0ef4-4248-446c-b5de-3afcf56da39e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:56.290044 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0ef4-4248-446c-b5de-3afcf56da39e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:56.290320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0ef4-4248-446c-b5de-3afcf56da39e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:56.290414 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8898832-bde4-4d04-8a48-648ffeeb3bce None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:56.290600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8898832-bde4-4d04-8a48-648ffeeb3bce None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:56.290905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8898832-bde4-4d04-8a48-648ffeeb3bce None admin] PATH_INFO: `/v3/users/7c1cf291bfd64ba287443cde4df814a7` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:56.291529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b0ef4-4248-446c-b5de-3afcf56da39e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:56.292124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8898832-bde4-4d04-8a48-648ffeeb3bce None admin] RBAC: Authorizing `identity:get_user(user_id=7c1cf291bfd64ba287443cde4df814a7)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:56.293413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b0ef4-4248-446c-b5de-3afcf56da39e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:56.293685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8898832-bde4-4d04-8a48-648ffeeb3bce None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:56.294673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:34:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:34:56.295310 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 28/54] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:34:56 2022] GET /identity/v3/users/7c1cf291bfd64ba287443cde4df814a7 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:56.300477 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b0ef4-4248-446c-b5de-3afcf56da39e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:56.300591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8898832-bde4-4d04-8a48-648ffeeb3bce None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:56.325693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:56.410781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8898832-bde4-4d04-8a48-648ffeeb3bce None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:56.450458 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd188f-fab9-4e97-b978-cac2668a3c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:56.451199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd188f-fab9-4e97-b978-cac2668a3c60 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:56.451480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd188f-fab9-4e97-b978-cac2668a3c60 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:56.451757 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd188f-fab9-4e97-b978-cac2668a3c60 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:56.452476 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd188f-fab9-4e97-b978-cac2668a3c60 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:56.453995 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd188f-fab9-4e97-b978-cac2668a3c60 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:56.481981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 29/55] 10.222.0.26 () {60 vars in 1140 bytes} [Thu Jun 30 03:34:56 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:34:56.514701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b0ef4-4248-446c-b5de-3afcf56da39e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:56.533766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:56.556272 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ba427-dc0c-4490-bac1-2fb3a670c0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:56.557182 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ba427-dc0c-4490-bac1-2fb3a670c0c4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:56.557475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ba427-dc0c-4490-bac1-2fb3a670c0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:56.557888 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ba427-dc0c-4490-bac1-2fb3a670c0c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:56.559632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ba427-dc0c-4490-bac1-2fb3a670c0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:56.561132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ba427-dc0c-4490-bac1-2fb3a670c0c4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:56.562863 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 27/56] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:34:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:56.569116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd188f-fab9-4e97-b978-cac2668a3c60 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:56.651818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:56.679458 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd188f-fab9-4e97-b978-cac2668a3c60 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:56.712651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b876a5-65eb-430f-948f-cb638acfac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:56.713297 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b876a5-65eb-430f-948f-cb638acfac8f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:56.713583 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b876a5-65eb-430f-948f-cb638acfac8f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:56.713862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b876a5-65eb-430f-948f-cb638acfac8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:56.714788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b876a5-65eb-430f-948f-cb638acfac8f None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.domain.id=default, user.id=7c1cf291bfd64ba287443cde4df814a7) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:34:56.715104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b876a5-65eb-430f-948f-cb638acfac8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:56.716589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b876a5-65eb-430f-948f-cb638acfac8f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:56.722515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 30/57] 10.222.0.26 () {56 vars in 1322 bytes} [Thu Jun 30 03:34:56 2022] GET /identity/v3/role_assignments?user.id=7c1cf291bfd64ba287443cde4df814a7&scope.domain.id=default&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:58.513274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5ab5-6c85-435d-8b4e-68e0e85b4529 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:58.514099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5ab5-6c85-435d-8b4e-68e0e85b4529 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:58.514099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5ab5-6c85-435d-8b4e-68e0e85b4529 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:58.516370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 28/58] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:34:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:34:58.522531 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b209004-014f-4d7a-8a63-0be5bc378f12 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:58.522976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b209004-014f-4d7a-8a63-0be5bc378f12 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:58.523208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b209004-014f-4d7a-8a63-0be5bc378f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:58.543057 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6b209004-014f-4d7a-8a63-0be5bc378f12 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:34:58.544270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6b209004-014f-4d7a-8a63-0be5bc378f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:34:58.614345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 31/59] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:34:58.639082 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e5ab5-6c85-435d-8b4e-68e0e85b4529 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:58.750419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e5ab5-6c85-435d-8b4e-68e0e85b4529 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:58.788410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78db131-de5a-4476-93fc-8a25eae8bb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:58.789119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78db131-de5a-4476-93fc-8a25eae8bb73 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:58.789399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78db131-de5a-4476-93fc-8a25eae8bb73 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:58.789671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78db131-de5a-4476-93fc-8a25eae8bb73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:58.790999 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78db131-de5a-4476-93fc-8a25eae8bb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:58.792449 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78db131-de5a-4476-93fc-8a25eae8bb73 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:58.794144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 29/60] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:34:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:34:58.802850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b209004-014f-4d7a-8a63-0be5bc378f12 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:34:58.872250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:34:58.906529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b209004-014f-4d7a-8a63-0be5bc378f12 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:34:58.942696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060bd47-9355-412a-80f5-dad2a1c5f729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:34:58.943394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060bd47-9355-412a-80f5-dad2a1c5f729 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:34:58.943679 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060bd47-9355-412a-80f5-dad2a1c5f729 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:34:58.943954 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060bd47-9355-412a-80f5-dad2a1c5f729 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:34:58.944671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060bd47-9355-412a-80f5-dad2a1c5f729 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:34:58.946139 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060bd47-9355-412a-80f5-dad2a1c5f729 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:34:58.973697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 32/61] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:34:58 2022] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:35:02.135040 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd984e-d9a5-41c6-a163-ca798613818b None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:02.135541 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd984e-d9a5-41c6-a163-ca798613818b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:02.135541 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd984e-d9a5-41c6-a163-ca798613818b None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:02.137914 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 30/62] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:02.143313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4928ef-2a11-40bf-95db-7b176c8becd4 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:02.144139 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4928ef-2a11-40bf-95db-7b176c8becd4 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:02.144632 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4928ef-2a11-40bf-95db-7b176c8becd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:02.171861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ed4928ef-2a11-40bf-95db-7b176c8becd4 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:02.173662 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ed4928ef-2a11-40bf-95db-7b176c8becd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:02.265164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 33/63] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:02.301418 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd984e-d9a5-41c6-a163-ca798613818b None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:02.349115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb846c-0a87-45b5-99e3-44c25c2a88ef None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:02.349815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb846c-0a87-45b5-99e3-44c25c2a88ef None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:02.350294 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb846c-0a87-45b5-99e3-44c25c2a88ef None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:02.351914 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 34/64] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:35:02.357753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e287fb5-04ee-4be3-a29f-f79439b8cc46 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:02.358298 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e287fb5-04ee-4be3-a29f-f79439b8cc46 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:02.358819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e287fb5-04ee-4be3-a29f-f79439b8cc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:02.382085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-4e287fb5-04ee-4be3-a29f-f79439b8cc46 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:02.383649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-4e287fb5-04ee-4be3-a29f-f79439b8cc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:02.386045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:02.440851 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:02.451390 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd984e-d9a5-41c6-a163-ca798613818b None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:02.470623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 35/65] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:02.472383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74289433-de64-4af4-8967-a618ba0fe637 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:02.473036 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74289433-de64-4af4-8967-a618ba0fe637 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:02.473393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74289433-de64-4af4-8967-a618ba0fe637 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:02.475035 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 36/66] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:02.488283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05a2a5-7e92-46ec-8f06-f33910cdbaf9 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:02.488567 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05a2a5-7e92-46ec-8f06-f33910cdbaf9 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:02.488849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05a2a5-7e92-46ec-8f06-f33910cdbaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:02.492973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a309fc-dc66-4497-bc33-d4e73e8ea404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:02.494030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a309fc-dc66-4497-bc33-d4e73e8ea404 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:02.494531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a309fc-dc66-4497-bc33-d4e73e8ea404 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:02.495036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a309fc-dc66-4497-bc33-d4e73e8ea404 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:02.507221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a309fc-dc66-4497-bc33-d4e73e8ea404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:02.508315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ed05a2a5-7e92-46ec-8f06-f33910cdbaf9 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:02.509723 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ed05a2a5-7e92-46ec-8f06-f33910cdbaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-21a309fc-dc66-4497-bc33-d4e73e8ea404 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:02.515620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:02.516566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:02.517331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:02.517331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:02.517331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:02.517331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:02.517331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:02.517331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:02.517331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:02.517331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:02.517331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:02.517331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:02.517331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:02.517331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:02.517331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 31/67] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:02.517968 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a309fc-dc66-4497-bc33-d4e73e8ea404 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:02.587429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 37/68] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:02.588583 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05a2a5-7e92-46ec-8f06-f33910cdbaf9 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:02.624560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a309fc-dc66-4497-bc33-d4e73e8ea404 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:02.641455 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:02.664594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0b228-eacd-4b5b-8b6b-4609a165d2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:02.665797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0b228-eacd-4b5b-8b6b-4609a165d2a1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:02.667012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0b228-eacd-4b5b-8b6b-4609a165d2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:02.668040 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0b228-eacd-4b5b-8b6b-4609a165d2a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:02.681128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0b228-eacd-4b5b-8b6b-4609a165d2a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-27a0b228-eacd-4b5b-8b6b-4609a165d2a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:02.692969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:02.694009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:02.694988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:02.694988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:02.694988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:02.694988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:02.694988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:02.694988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:02.694988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:02.694988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:02.694988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:02.694988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:02.694988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:02.694988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:02.696343 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 32/69] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:35:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:02.697540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7c3d1-e638-45b8-95a0-2a76a7d559c0 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:02.697832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7c3d1-e638-45b8-95a0-2a76a7d559c0 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:02.698113 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7c3d1-e638-45b8-95a0-2a76a7d559c0 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:02.699942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 33/70] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:02.700661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7c3d1-e638-45b8-95a0-2a76a7d559c0 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:02.701781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05a2a5-7e92-46ec-8f06-f33910cdbaf9 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:02.718026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:02.740561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39770d-9247-42df-9b82-5bec51262c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:02.741252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39770d-9247-42df-9b82-5bec51262c40 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:02.741541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39770d-9247-42df-9b82-5bec51262c40 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:02.741819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39770d-9247-42df-9b82-5bec51262c40 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:02.742586 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39770d-9247-42df-9b82-5bec51262c40 None admin] RBAC: Adding query filter params (name=member) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:02.742926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39770d-9247-42df-9b82-5bec51262c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:02.744346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39770d-9247-42df-9b82-5bec51262c40 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:02.753825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 38/71] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:02.754625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39770d-9247-42df-9b82-5bec51262c40 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:02.813351 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7c3d1-e638-45b8-95a0-2a76a7d559c0 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:02.858177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb8dd2-e02e-4087-ba38-4f8238b68610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:02.858672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39770d-9247-42df-9b82-5bec51262c40 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:02.859021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb8dd2-e02e-4087-ba38-4f8238b68610 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:02.859291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb8dd2-e02e-4087-ba38-4f8238b68610 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:02.859568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb8dd2-e02e-4087-ba38-4f8238b68610 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:02.870142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb8dd2-e02e-4087-ba38-4f8238b68610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-adeb8dd2-e02e-4087-ba38-4f8238b68610 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:02.877810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:02.878701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:02.879494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:02.879494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:02.879494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:02.879494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:02.879494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:02.879494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:02.879494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:02.879494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:02.879494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:02.879494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:02.879494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:02.879494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:02.879494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 34/72] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:35:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:02.880785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3487f-52d6-4cc7-abd1-6512201213dc None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:02.880785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3487f-52d6-4cc7-abd1-6512201213dc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:02.880785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3487f-52d6-4cc7-abd1-6512201213dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:02.898857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6fc3487f-52d6-4cc7-abd1-6512201213dc None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:02.899319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8258b-019a-44da-9428-b98a6e180438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:02.900005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8258b-019a-44da-9428-b98a6e180438 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:02.900091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6fc3487f-52d6-4cc7-abd1-6512201213dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:02.900292 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8258b-019a-44da-9428-b98a6e180438 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:02.900576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8258b-019a-44da-9428-b98a6e180438 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:02.901332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8258b-019a-44da-9428-b98a6e180438 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:02.901702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8258b-019a-44da-9428-b98a6e180438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:02.903649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8258b-019a-44da-9428-b98a6e180438 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:02.911747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 39/73] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:35:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:02.911747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4d325-d70c-43ef-b74a-37476a2023fc None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:02.911747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4d325-d70c-43ef-b74a-37476a2023fc None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:02.911747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4d325-d70c-43ef-b74a-37476a2023fc None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:02.911747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 40/74] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:02.911747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4d325-d70c-43ef-b74a-37476a2023fc None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:02.930783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:02.956830 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:02.971592 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 35/75] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:02.975752 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3487f-52d6-4cc7-abd1-6512201213dc None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:03.020843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4d325-d70c-43ef-b74a-37476a2023fc None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:03.052955 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e8f2e-1c9f-4c4b-8035-a31aa5fff2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:03.053852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8f2e-1c9f-4c4b-8035-a31aa5fff2aa None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:03.054131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8f2e-1c9f-4c4b-8035-a31aa5fff2aa None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:03.054408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8f2e-1c9f-4c4b-8035-a31aa5fff2aa None admin] PATH_INFO: `/v3/users/010c431b36384d8087a2e654e92b481d` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:03.068102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e8f2e-1c9f-4c4b-8035-a31aa5fff2aa None admin] RBAC: Authorizing `identity:get_user(user_id=010c431b36384d8087a2e654e92b481d)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:03.069588 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e8f2e-1c9f-4c4b-8035-a31aa5fff2aa None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:03.071314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 41/76] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:02 2022] GET /identity/v3/users/010c431b36384d8087a2e654e92b481d => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:03.076107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e8f2e-1c9f-4c4b-8035-a31aa5fff2aa None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:03.076180 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3487f-52d6-4cc7-abd1-6512201213dc None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:03.112250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae46129-2b9a-4c7a-8276-31c178300eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:03.112923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae46129-2b9a-4c7a-8276-31c178300eee None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:03.113206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae46129-2b9a-4c7a-8276-31c178300eee None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:03.113488 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae46129-2b9a-4c7a-8276-31c178300eee None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:03.114245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae46129-2b9a-4c7a-8276-31c178300eee None admin] RBAC: Adding query filter params (name=admin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:03.114559 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae46129-2b9a-4c7a-8276-31c178300eee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:03.116016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae46129-2b9a-4c7a-8276-31c178300eee None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:03.124434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 36/77] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:03.129032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a54bc8-9b39-4fd1-99b9-40fba070353b None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:03.129032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a54bc8-9b39-4fd1-99b9-40fba070353b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:03.129032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a54bc8-9b39-4fd1-99b9-40fba070353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:03.142721 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-57a54bc8-9b39-4fd1-99b9-40fba070353b None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:03.143964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-57a54bc8-9b39-4fd1-99b9-40fba070353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:03.164671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:03.170131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:03.177146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e8f2e-1c9f-4c4b-8035-a31aa5fff2aa None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:03.222931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 37/78] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:03.222931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a54bc8-9b39-4fd1-99b9-40fba070353b None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:03.223192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca73ac0-fc07-49fb-9f71-7eeedb532b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:03.223192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca73ac0-fc07-49fb-9f71-7eeedb532b7f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:03.223192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca73ac0-fc07-49fb-9f71-7eeedb532b7f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:03.223192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca73ac0-fc07-49fb-9f71-7eeedb532b7f None admin] PATH_INFO: `/v3/users/010c431b36384d8087a2e654e92b481d` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:03.223620 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca73ac0-fc07-49fb-9f71-7eeedb532b7f None admin] RBAC: Authorizing `identity:get_user(user_id=010c431b36384d8087a2e654e92b481d)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:03.223620 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca73ac0-fc07-49fb-9f71-7eeedb532b7f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:03.223620 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 42/79] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:03 2022] GET /identity/v3/users/010c431b36384d8087a2e654e92b481d => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:03.223620 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca73ac0-fc07-49fb-9f71-7eeedb532b7f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:03.315617 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a54bc8-9b39-4fd1-99b9-40fba070353b None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:03.327022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca73ac0-fc07-49fb-9f71-7eeedb532b7f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:03.349340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b8ed0-cdc5-4211-b8d4-d3067cf83e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:03.350143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b8ed0-cdc5-4211-b8d4-d3067cf83e9b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:03.350421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b8ed0-cdc5-4211-b8d4-d3067cf83e9b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:03.350682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b8ed0-cdc5-4211-b8d4-d3067cf83e9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:03.360850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f596f41-caca-4068-83f0-6ab288fd08c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:03.361109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b8ed0-cdc5-4211-b8d4-d3067cf83e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:03.361510 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f596f41-caca-4068-83f0-6ab288fd08c1 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:03.361797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f596f41-caca-4068-83f0-6ab288fd08c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:03.362078 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f596f41-caca-4068-83f0-6ab288fd08c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-317b8ed0-cdc5-4211-b8d4-d3067cf83e9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:03.368733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:03.369552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:03.373962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:03.373962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:03.373962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:03.373962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:03.373962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:03.373962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:03.373962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:03.373962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:03.373962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:03.373962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:03.373962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:03.373962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:03.373962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 38/80] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:03.373962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b8ed0-cdc5-4211-b8d4-d3067cf83e9b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:03.391466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:03.396104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:03.436418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f596f41-caca-4068-83f0-6ab288fd08c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:03.437827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f596f41-caca-4068-83f0-6ab288fd08c1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:03.474786 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b8ed0-cdc5-4211-b8d4-d3067cf83e9b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:03.508501 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2facd-4d86-4873-9645-b0ab200b0b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:03.509393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2facd-4d86-4873-9645-b0ab200b0b98 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:03.509681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2facd-4d86-4873-9645-b0ab200b0b98 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:03.509961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2facd-4d86-4873-9645-b0ab200b0b98 None admin] PATH_INFO: `/v3/users/7c1cf291bfd64ba287443cde4df814a7` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:03.511987 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2facd-4d86-4873-9645-b0ab200b0b98 None admin] RBAC: Authorizing `identity:get_user(user_id=7c1cf291bfd64ba287443cde4df814a7)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:03.513469 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2facd-4d86-4873-9645-b0ab200b0b98 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:03.515146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 39/81] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:03 2022] GET /identity/v3/users/7c1cf291bfd64ba287443cde4df814a7 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:03.519701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2facd-4d86-4873-9645-b0ab200b0b98 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:03.537740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 43/82] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:03.537740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f596f41-caca-4068-83f0-6ab288fd08c1 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:03.599036 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:03.608432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:03.624618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2facd-4d86-4873-9645-b0ab200b0b98 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:03.638743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f596f41-caca-4068-83f0-6ab288fd08c1 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:03.660521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f321e63-3eee-409d-8f6a-425e53cf42be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:03.661190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f321e63-3eee-409d-8f6a-425e53cf42be None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:03.661478 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f321e63-3eee-409d-8f6a-425e53cf42be None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:03.661779 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f321e63-3eee-409d-8f6a-425e53cf42be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:03.672805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef9246-6417-4cd2-a52e-5e523dfe679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:03.673639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef9246-6417-4cd2-a52e-5e523dfe679e None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:03.673926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef9246-6417-4cd2-a52e-5e523dfe679e None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:03.674428 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef9246-6417-4cd2-a52e-5e523dfe679e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:03.675421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef9246-6417-4cd2-a52e-5e523dfe679e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:03.676892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef9246-6417-4cd2-a52e-5e523dfe679e None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:03.678515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 44/83] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:03.679307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef9246-6417-4cd2-a52e-5e523dfe679e None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:03.734136 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f321e63-3eee-409d-8f6a-425e53cf42be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:03.735579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f321e63-3eee-409d-8f6a-425e53cf42be None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:03.778544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef9246-6417-4cd2-a52e-5e523dfe679e None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:03.807095 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:03.812920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1a004-4563-4281-978c-891aad887d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:03.813591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1a004-4563-4281-978c-891aad887d70 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:03.813873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1a004-4563-4281-978c-891aad887d70 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:03.814151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1a004-4563-4281-978c-891aad887d70 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:03.814946 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1a004-4563-4281-978c-891aad887d70 None admin] RBAC: Adding query filter params (name=member) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:03.815255 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1a004-4563-4281-978c-891aad887d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:03.816694 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1a004-4563-4281-978c-891aad887d70 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:03.818147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:03.825410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 45/84] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:03.825410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1a004-4563-4281-978c-891aad887d70 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:03.835546 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 40/85] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:03.836378 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f321e63-3eee-409d-8f6a-425e53cf42be None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:03.936746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f321e63-3eee-409d-8f6a-425e53cf42be None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:03.937115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1a004-4563-4281-978c-891aad887d70 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:03.970527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd4be0-2a1b-45b8-a507-44d2d5ab0cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:03.971429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd4be0-2a1b-45b8-a507-44d2d5ab0cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:03.971712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd4be0-2a1b-45b8-a507-44d2d5ab0cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:03.971831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accb3c0-44cb-4a2e-bdb2-9b05186e0114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:03.971991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd4be0-2a1b-45b8-a507-44d2d5ab0cd4 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:03.972375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accb3c0-44cb-4a2e-bdb2-9b05186e0114 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:03.972658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accb3c0-44cb-4a2e-bdb2-9b05186e0114 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:03.972941 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accb3c0-44cb-4a2e-bdb2-9b05186e0114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:03.973204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd4be0-2a1b-45b8-a507-44d2d5ab0cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:03.974667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd4be0-2a1b-45b8-a507-44d2d5ab0cd4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:03.976410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 41/86] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:03 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:03.982317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd4be0-2a1b-45b8-a507-44d2d5ab0cd4 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:04.034222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:04.042073 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:04.050726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accb3c0-44cb-4a2e-bdb2-9b05186e0114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:04.052261 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accb3c0-44cb-4a2e-bdb2-9b05186e0114 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:04.082823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd4be0-2a1b-45b8-a507-44d2d5ab0cd4 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:04.116590 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246c16-0771-422c-8307-b94a683fee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:04.117257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246c16-0771-422c-8307-b94a683fee55 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:04.117536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246c16-0771-422c-8307-b94a683fee55 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:04.117808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246c16-0771-422c-8307-b94a683fee55 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:04.118530 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67246c16-0771-422c-8307-b94a683fee55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:04.120007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67246c16-0771-422c-8307-b94a683fee55 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:04.145577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 42/87] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:35:03 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:35:04.148090 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246c16-0771-422c-8307-b94a683fee55 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:04.150970 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 46/88] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:04.152092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accb3c0-44cb-4a2e-bdb2-9b05186e0114 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:04.285922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246c16-0771-422c-8307-b94a683fee55 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:04.294189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:04.300214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:04.303025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accb3c0-44cb-4a2e-bdb2-9b05186e0114 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:04.334619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b814a0d-4b9c-413f-8683-934284efabec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:04.335538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b814a0d-4b9c-413f-8683-934284efabec None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:04.335824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b814a0d-4b9c-413f-8683-934284efabec None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:04.336098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b814a0d-4b9c-413f-8683-934284efabec None admin] PATH_INFO: `/v3/users/010c431b36384d8087a2e654e92b481d` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:04.337328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b814a0d-4b9c-413f-8683-934284efabec None admin] RBAC: Authorizing `identity:get_user(user_id=010c431b36384d8087a2e654e92b481d)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:04.338886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b814a0d-4b9c-413f-8683-934284efabec None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:04.341069 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 43/89] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:04 2022] GET /identity/v3/users/010c431b36384d8087a2e654e92b481d => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:04.341840 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b814a0d-4b9c-413f-8683-934284efabec None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:04.346449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00eab4f-9f9d-4252-a0be-22ba7a972860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:04.347390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00eab4f-9f9d-4252-a0be-22ba7a972860 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:04.347675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00eab4f-9f9d-4252-a0be-22ba7a972860 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:04.347942 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00eab4f-9f9d-4252-a0be-22ba7a972860 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:04.349209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00eab4f-9f9d-4252-a0be-22ba7a972860 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:04.351182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00eab4f-9f9d-4252-a0be-22ba7a972860 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:04.354238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 47/90] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:04 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:04.355608 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00eab4f-9f9d-4252-a0be-22ba7a972860 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:04.468525 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b814a0d-4b9c-413f-8683-934284efabec None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:04.477926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00eab4f-9f9d-4252-a0be-22ba7a972860 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:04.511528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d5878-5b32-4d14-8158-30b41aa03c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:04.512322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d5878-5b32-4d14-8158-30b41aa03c59 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:04.513861 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d5878-5b32-4d14-8158-30b41aa03c59 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:04.513861 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d5878-5b32-4d14-8158-30b41aa03c59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:04.513861 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d5878-5b32-4d14-8158-30b41aa03c59 None admin] RBAC: Adding query filter params (role.id=59a0f03d08fd401ebbd29ebd5f174abb, scope.project.id=113460ea611c4df1b58899d547c12317, user.id=010c431b36384d8087a2e654e92b481d) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:04.514073 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d5878-5b32-4d14-8158-30b41aa03c59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:04.515630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d5878-5b32-4d14-8158-30b41aa03c59 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:04.518179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60136110-2557-4ff6-ad1b-f589c9bce2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:04.522809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60136110-2557-4ff6-ad1b-f589c9bce2b6 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:04.522809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60136110-2557-4ff6-ad1b-f589c9bce2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:04.522809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60136110-2557-4ff6-ad1b-f589c9bce2b6 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:04.523848 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60136110-2557-4ff6-ad1b-f589c9bce2b6 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:04.524405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 44/91] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:04 2022] GET /identity/v3/role_assignments?user.id=010c431b36384d8087a2e654e92b481d&scope.project.id=113460ea611c4df1b58899d547c12317&role.id=59a0f03d08fd401ebbd29ebd5f174abb => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:04.525241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d5878-5b32-4d14-8158-30b41aa03c59 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:04.525936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60136110-2557-4ff6-ad1b-f589c9bce2b6 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:04.533184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 48/92] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:04 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:04.539348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60136110-2557-4ff6-ad1b-f589c9bce2b6 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:04.605649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:04.635399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:04.706252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60136110-2557-4ff6-ad1b-f589c9bce2b6 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:04.744808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbce1c-03db-4a4f-a10b-2e33e5de3c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:04.745862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbce1c-03db-4a4f-a10b-2e33e5de3c3f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:04.746124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbce1c-03db-4a4f-a10b-2e33e5de3c3f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:04.746416 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbce1c-03db-4a4f-a10b-2e33e5de3c3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:04.747315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbce1c-03db-4a4f-a10b-2e33e5de3c3f None admin] RBAC: Adding query filter params (role.id=4af08bea19b94c2c863a51b103f50b8b, scope.project.id=113460ea611c4df1b58899d547c12317, user.id=010c431b36384d8087a2e654e92b481d) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:04.747633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbce1c-03db-4a4f-a10b-2e33e5de3c3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:04.749130 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbce1c-03db-4a4f-a10b-2e33e5de3c3f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:04.755693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 49/93] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:04 2022] GET /identity/v3/role_assignments?user.id=010c431b36384d8087a2e654e92b481d&scope.project.id=113460ea611c4df1b58899d547c12317&role.id=4af08bea19b94c2c863a51b103f50b8b => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:04.756690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbce1c-03db-4a4f-a10b-2e33e5de3c3f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:04.764890 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d5878-5b32-4d14-8158-30b41aa03c59 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:04.870025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:04.877887 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03226b0-5cf8-4446-abc1-7ddde84033c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:04.877887 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03226b0-5cf8-4446-abc1-7ddde84033c2 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:04.877887 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03226b0-5cf8-4446-abc1-7ddde84033c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:04.877887 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03226b0-5cf8-4446-abc1-7ddde84033c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:04.880374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbce1c-03db-4a4f-a10b-2e33e5de3c3f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:04.922238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada28b-d7c7-4f5b-8baf-091d9ad9109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:04.923269 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada28b-d7c7-4f5b-8baf-091d9ad9109e None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:04.923691 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada28b-d7c7-4f5b-8baf-091d9ad9109e None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:04.924125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada28b-d7c7-4f5b-8baf-091d9ad9109e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:04.925129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ada28b-d7c7-4f5b-8baf-091d9ad9109e None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=113460ea611c4df1b58899d547c12317, user.id=7c1cf291bfd64ba287443cde4df814a7) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:04.925585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ada28b-d7c7-4f5b-8baf-091d9ad9109e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:04.927255 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ada28b-d7c7-4f5b-8baf-091d9ad9109e None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:04.934059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 50/94] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:04 2022] GET /identity/v3/role_assignments?user.id=7c1cf291bfd64ba287443cde4df814a7&scope.project.id=113460ea611c4df1b58899d547c12317&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:05.023756 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03226b0-5cf8-4446-abc1-7ddde84033c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:05.025270 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03226b0-5cf8-4446-abc1-7ddde84033c2 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:05.079565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:05.160141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 45/95] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:05.165472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada28b-d7c7-4f5b-8baf-091d9ad9109e None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:05.330743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada28b-d7c7-4f5b-8baf-091d9ad9109e None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:05.377717 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176d966-eb5c-4622-a481-0d3c04a2e84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:05.378603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176d966-eb5c-4622-a481-0d3c04a2e84a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:05.378918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176d966-eb5c-4622-a481-0d3c04a2e84a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:05.379199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176d966-eb5c-4622-a481-0d3c04a2e84a None admin] PATH_INFO: `/v3/projects/41318efb050a4640b7056fc0531144b0` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:05.383496 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176d966-eb5c-4622-a481-0d3c04a2e84a None admin] RBAC: Authorizing `identity:get_project(project_id=41318efb050a4640b7056fc0531144b0)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:05.384994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176d966-eb5c-4622-a481-0d3c04a2e84a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:05.387126 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 51/96] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:05 2022] GET /identity/v3/projects/41318efb050a4640b7056fc0531144b0 => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:05.392801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03226b0-5cf8-4446-abc1-7ddde84033c2 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:05.548500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03226b0-5cf8-4446-abc1-7ddde84033c2 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:05.596073 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9fb1c-529f-42d4-aa54-31ec5f7e7d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:05.597134 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9fb1c-529f-42d4-aa54-31ec5f7e7d7b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:05.597609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9fb1c-529f-42d4-aa54-31ec5f7e7d7b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:05.598074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9fb1c-529f-42d4-aa54-31ec5f7e7d7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:05.599133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9fb1c-529f-42d4-aa54-31ec5f7e7d7b None admin] RBAC: Adding query filter params (role.id=59a0f03d08fd401ebbd29ebd5f174abb, scope.project.id=41318efb050a4640b7056fc0531144b0, user.id=010c431b36384d8087a2e654e92b481d) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:05.599687 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9fb1c-529f-42d4-aa54-31ec5f7e7d7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:05.601333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9fb1c-529f-42d4-aa54-31ec5f7e7d7b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:05.611350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 46/97] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:05 2022] GET /identity/v3/role_assignments?user.id=010c431b36384d8087a2e654e92b481d&scope.project.id=41318efb050a4640b7056fc0531144b0&role.id=59a0f03d08fd401ebbd29ebd5f174abb => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:06.571031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d3e9-7ca8-4d01-a8a0-7dac985519c5 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:06.571577 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d3e9-7ca8-4d01-a8a0-7dac985519c5 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:06.571577 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d3e9-7ca8-4d01-a8a0-7dac985519c5 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:06.573368 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 52/98] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:06.579263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a7d3-c3b6-4582-80f6-55a7b32686fd None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:06.581026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a7d3-c3b6-4582-80f6-55a7b32686fd None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:06.581026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a7d3-c3b6-4582-80f6-55a7b32686fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:06.586663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:06.598582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-1d95a7d3-c3b6-4582-80f6-55a7b32686fd None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:06.599926 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1d95a7d3-c3b6-4582-80f6-55a7b32686fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:06.674157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 47/99] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:06.709285 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1d3e9-7ca8-4d01-a8a0-7dac985519c5 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:06.739154 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:06.829352 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1d3e9-7ca8-4d01-a8a0-7dac985519c5 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:06.872787 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0668f6d-0479-460c-b5dc-03e526697984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:06.873604 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0668f6d-0479-460c-b5dc-03e526697984 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:06.874054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0668f6d-0479-460c-b5dc-03e526697984 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:06.874337 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0668f6d-0479-460c-b5dc-03e526697984 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:06.878447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0668f6d-0479-460c-b5dc-03e526697984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:06.880196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0668f6d-0479-460c-b5dc-03e526697984 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:06.883049 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 53/100] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:06.888689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95a7d3-c3b6-4582-80f6-55a7b32686fd None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:06.912648 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8089e80-95a9-41ec-b0d5-fa0684e31956 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:06.912938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8089e80-95a9-41ec-b0d5-fa0684e31956 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:06.913209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8089e80-95a9-41ec-b0d5-fa0684e31956 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:06.914587 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 54/101] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:06.926074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1a54d-6df8-4549-b704-0b5163860a39 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:06.926636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1a54d-6df8-4549-b704-0b5163860a39 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:06.927131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1a54d-6df8-4549-b704-0b5163860a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:06.951738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-01c1a54d-6df8-4549-b704-0b5163860a39 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:06.954867 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-01c1a54d-6df8-4549-b704-0b5163860a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:07.056210 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 55/102] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:07.097225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1a54d-6df8-4549-b704-0b5163860a39 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:07.122591 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95a7d3-c3b6-4582-80f6-55a7b32686fd None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:07.136268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:07.200040 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362094f9-48fd-47f6-bc9a-653ded54d415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:07.200728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362094f9-48fd-47f6-bc9a-653ded54d415 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:07.201013 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362094f9-48fd-47f6-bc9a-653ded54d415 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:07.201291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362094f9-48fd-47f6-bc9a-653ded54d415 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:07.202025 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362094f9-48fd-47f6-bc9a-653ded54d415 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:07.203523 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362094f9-48fd-47f6-bc9a-653ded54d415 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:07.213672 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:07.256082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1a54d-6df8-4549-b704-0b5163860a39 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:07.304413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 48/103] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 03:35:06 2022] POST /identity/v3/projects => generated 302 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:35:07.311294 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b85b7-1a35-47e1-83a6-5ab56274e5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:07.312540 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b85b7-1a35-47e1-83a6-5ab56274e5f5 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:07.313014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b85b7-1a35-47e1-83a6-5ab56274e5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:07.313635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b85b7-1a35-47e1-83a6-5ab56274e5f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:07.335794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b85b7-1a35-47e1-83a6-5ab56274e5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-4a8b85b7-1a35-47e1-83a6-5ab56274e5f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:07.344225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:07.345047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:07.345784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:07.345784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:07.345784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:07.345784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:07.345784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:07.345784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:07.345784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:07.345784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:07.345784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:07.345784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:07.345784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:07.345784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:07.348521 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 56/104] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:35:07.354809 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362094f9-48fd-47f6-bc9a-653ded54d415 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:07.516290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362094f9-48fd-47f6-bc9a-653ded54d415 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:07.564672 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bb7c7-3e87-446d-a8fd-53bb0a70e985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:07.565367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bb7c7-3e87-446d-a8fd-53bb0a70e985 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:07.565656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bb7c7-3e87-446d-a8fd-53bb0a70e985 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:07.565982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bb7c7-3e87-446d-a8fd-53bb0a70e985 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:07.566876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bb7c7-3e87-446d-a8fd-53bb0a70e985 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:07.567173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bb7c7-3e87-446d-a8fd-53bb0a70e985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:07.568660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bb7c7-3e87-446d-a8fd-53bb0a70e985 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:07.583381 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 49/105] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:07.589621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b85b7-1a35-47e1-83a6-5ab56274e5f5 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:07.675148 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b433e4d-50a2-4a35-a63f-39c84914f464 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:07.675651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b433e4d-50a2-4a35-a63f-39c84914f464 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:07.676074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b433e4d-50a2-4a35-a63f-39c84914f464 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:07.677617 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 50/106] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:35:07.683183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996de9a-03de-4fe1-bee6-dc6e41cdfa5e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:07.683680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996de9a-03de-4fe1-bee6-dc6e41cdfa5e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:07.684132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996de9a-03de-4fe1-bee6-dc6e41cdfa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:07.710187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-8996de9a-03de-4fe1-bee6-dc6e41cdfa5e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:07.712397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8996de9a-03de-4fe1-bee6-dc6e41cdfa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:07.759887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:07.786740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b85b7-1a35-47e1-83a6-5ab56274e5f5 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:07.792976 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:07.832706 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 51/107] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:07.846585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cc9e0-e192-4be7-9eb3-28f7a61bee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:07.847745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cc9e0-e192-4be7-9eb3-28f7a61bee5c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:07.848199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cc9e0-e192-4be7-9eb3-28f7a61bee5c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:07.848617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cc9e0-e192-4be7-9eb3-28f7a61bee5c None admin] PATH_INFO: `/v3/users/8b2d48d8e422457db7aebb21afd2bf43` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:07.872949 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cc9e0-e192-4be7-9eb3-28f7a61bee5c None admin] RBAC: Authorizing `identity:get_user(user_id=8b2d48d8e422457db7aebb21afd2bf43)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:07.874674 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cc9e0-e192-4be7-9eb3-28f7a61bee5c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:07.876618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 57/108] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:07 2022] GET /identity/v3/users/8b2d48d8e422457db7aebb21afd2bf43 => generated 289 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:07.882985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996de9a-03de-4fe1-bee6-dc6e41cdfa5e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:07.887153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cc9e0-e192-4be7-9eb3-28f7a61bee5c None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:08.064992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996de9a-03de-4fe1-bee6-dc6e41cdfa5e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:08.079873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cc9e0-e192-4be7-9eb3-28f7a61bee5c None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:08.138437 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b25c2-c683-4f30-8c98-3c6aee49c3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:08.139284 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b25c2-c683-4f30-8c98-3c6aee49c3a1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:08.139571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b25c2-c683-4f30-8c98-3c6aee49c3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:08.139847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b25c2-c683-4f30-8c98-3c6aee49c3a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:08.154189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb01cdd-183b-413f-9e34-784a45c111cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:08.154897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb01cdd-183b-413f-9e34-784a45c111cb None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:08.155163 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb01cdd-183b-413f-9e34-784a45c111cb None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:08.155439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb01cdd-183b-413f-9e34-784a45c111cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:08.169242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b25c2-c683-4f30-8c98-3c6aee49c3a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-f72b25c2-c683-4f30-8c98-3c6aee49c3a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:08.189788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:08.190686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:08.191928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:08.191928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:08.191928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:08.191928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:08.191928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:08.191928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:08.191928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:08.191928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:08.191928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:08.191928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:08.191928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:08.191928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:08.191928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 52/109] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:08.192548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:08.200513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b25c2-c683-4f30-8c98-3c6aee49c3a1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:08.249801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:08.316321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb01cdd-183b-413f-9e34-784a45c111cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:08.317806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb01cdd-183b-413f-9e34-784a45c111cb None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:08.362472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b25c2-c683-4f30-8c98-3c6aee49c3a1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:08.422150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a887ce1-a3f3-4910-9d97-a253a2c7e3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:08.423120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a887ce1-a3f3-4910-9d97-a253a2c7e3cc None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:08.423575 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a887ce1-a3f3-4910-9d97-a253a2c7e3cc None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:08.423991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a887ce1-a3f3-4910-9d97-a253a2c7e3cc None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:08.424989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a887ce1-a3f3-4910-9d97-a253a2c7e3cc None admin] RBAC: Adding query filter params (name=member) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:08.425529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a887ce1-a3f3-4910-9d97-a253a2c7e3cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:08.427096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a887ce1-a3f3-4910-9d97-a253a2c7e3cc None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:08.437179 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 53/110] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:08.438938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd540efc-8c7c-43f8-af26-bc0776970ec8 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:08.439366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd540efc-8c7c-43f8-af26-bc0776970ec8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:08.439879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd540efc-8c7c-43f8-af26-bc0776970ec8 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:08.441265 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 54/111] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:08.447070 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc21e8-76da-4003-b77e-d1bfde699483 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:08.447598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc21e8-76da-4003-b77e-d1bfde699483 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:08.448076 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc21e8-76da-4003-b77e-d1bfde699483 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:08.449578 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 55/112] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:08.450575 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc21e8-76da-4003-b77e-d1bfde699483 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:08.465327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 58/113] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:08.466663 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997c5cb-4b0a-4cd1-8b6d-57dab6ecded2 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:08.466983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997c5cb-4b0a-4cd1-8b6d-57dab6ecded2 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:08.467332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997c5cb-4b0a-4cd1-8b6d-57dab6ecded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:08.489668 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6997c5cb-4b0a-4cd1-8b6d-57dab6ecded2 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:08.491232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6997c5cb-4b0a-4cd1-8b6d-57dab6ecded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:08.554277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:08.564624 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:08.569132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc21e8-76da-4003-b77e-d1bfde699483 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:08.590804 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 59/114] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:08.590804 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772b8a0-ff6a-45d2-8639-b3424c91ee7e None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:08.590804 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772b8a0-ff6a-45d2-8639-b3424c91ee7e None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:08.590804 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772b8a0-ff6a-45d2-8639-b3424c91ee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:08.607428 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-a772b8a0-ff6a-45d2-8639-b3424c91ee7e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:08.608736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a772b8a0-ff6a-45d2-8639-b3424c91ee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:08.633281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23388b-e5ef-4650-a28c-df420ccd5af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:08.634188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23388b-e5ef-4650-a28c-df420ccd5af3 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:08.634481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23388b-e5ef-4650-a28c-df420ccd5af3 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:08.634778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23388b-e5ef-4650-a28c-df420ccd5af3 None admin] PATH_INFO: `/v3/users/010c431b36384d8087a2e654e92b481d` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:08.636583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23388b-e5ef-4650-a28c-df420ccd5af3 None admin] RBAC: Authorizing `identity:get_user(user_id=010c431b36384d8087a2e654e92b481d)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:08.638352 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23388b-e5ef-4650-a28c-df420ccd5af3 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:08.641256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 56/115] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:08 2022] GET /identity/v3/users/010c431b36384d8087a2e654e92b481d => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:08.642448 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23388b-e5ef-4650-a28c-df420ccd5af3 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:08.696237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 60/116] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:08.697712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772b8a0-ff6a-45d2-8639-b3424c91ee7e None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:08.758379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23388b-e5ef-4650-a28c-df420ccd5af3 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:08.794381 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356bf43-1450-4328-9c67-cc313d253c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:08.795292 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356bf43-1450-4328-9c67-cc313d253c27 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:08.795582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356bf43-1450-4328-9c67-cc313d253c27 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:08.795845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356bf43-1450-4328-9c67-cc313d253c27 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:08.797172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356bf43-1450-4328-9c67-cc313d253c27 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:08.798651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356bf43-1450-4328-9c67-cc313d253c27 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:08.800584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 57/117] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:08 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:08.801245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356bf43-1450-4328-9c67-cc313d253c27 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:08.814148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772b8a0-ff6a-45d2-8639-b3424c91ee7e None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:08.816127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:08.837612 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:08.853393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6886588-c8a4-4647-902c-c31800b2c43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:08.854365 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6886588-c8a4-4647-902c-c31800b2c43b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:08.854707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6886588-c8a4-4647-902c-c31800b2c43b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:08.855061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6886588-c8a4-4647-902c-c31800b2c43b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:08.865611 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6886588-c8a4-4647-902c-c31800b2c43b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-a6886588-c8a4-4647-902c-c31800b2c43b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:08.873709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:08.874627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:08.875516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:08.875516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:08.875516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:08.875516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:08.875516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:08.875516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:08.875516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:08.875516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:08.875516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:08.875516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:08.875516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:08.875516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:08.875516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 61/118] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:35:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:08.876566 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f236987-2a84-48d6-9066-c0552b727391 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:08.876566 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f236987-2a84-48d6-9066-c0552b727391 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:08.876785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f236987-2a84-48d6-9066-c0552b727391 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:08.880014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 62/119] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:08.880014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f236987-2a84-48d6-9066-c0552b727391 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:08.920125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356bf43-1450-4328-9c67-cc313d253c27 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:08.956165 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c097b-5b80-4d2e-8e94-604906303225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:08.957027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c097b-5b80-4d2e-8e94-604906303225 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:08.957308 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c097b-5b80-4d2e-8e94-604906303225 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:08.957587 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c097b-5b80-4d2e-8e94-604906303225 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:08.958754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c097b-5b80-4d2e-8e94-604906303225 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:08.960238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c097b-5b80-4d2e-8e94-604906303225 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:08.962099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 58/120] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:08 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:08.962696 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c097b-5b80-4d2e-8e94-604906303225 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:08.997874 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f236987-2a84-48d6-9066-c0552b727391 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:09.033970 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05e241-809f-4138-8a05-b6b434eb26ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:09.034814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e241-809f-4138-8a05-b6b434eb26ba None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:09.035105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e241-809f-4138-8a05-b6b434eb26ba None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:09.035384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e241-809f-4138-8a05-b6b434eb26ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:09.047402 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05e241-809f-4138-8a05-b6b434eb26ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-db05e241-809f-4138-8a05-b6b434eb26ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:09.055562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:09.056451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:09.057252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:09.057252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:09.057252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:09.057252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:09.057252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:09.057252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:09.057252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:09.057252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:09.057252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:09.057252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:09.057252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:09.057252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:09.057252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 63/121] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:35:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:09.058652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd4efe-606a-46e0-917a-0f65b6c56087 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:09.058652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd4efe-606a-46e0-917a-0f65b6c56087 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:09.058652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd4efe-606a-46e0-917a-0f65b6c56087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:09.077784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-dfdd4efe-606a-46e0-917a-0f65b6c56087 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:09.078941 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-dfdd4efe-606a-46e0-917a-0f65b6c56087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:09.096717 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:09.102895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c097b-5b80-4d2e-8e94-604906303225 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:09.106328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:09.142687 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5d7ca-4d4d-4047-b616-22c77888d067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:09.143519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5d7ca-4d4d-4047-b616-22c77888d067 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:09.143901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5d7ca-4d4d-4047-b616-22c77888d067 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:09.144274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5d7ca-4d4d-4047-b616-22c77888d067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:09.145435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5d7ca-4d4d-4047-b616-22c77888d067 None admin] RBAC: Adding query filter params (role.id=fd5b8ebb128748d5b34cc4fa37a3d1e8, scope.project.id=113460ea611c4df1b58899d547c12317, user.id=8b2d48d8e422457db7aebb21afd2bf43) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:09.145620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5d7ca-4d4d-4047-b616-22c77888d067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:09.147162 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5d7ca-4d4d-4047-b616-22c77888d067 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:09.158795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 59/123] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:08 2022] GET /identity/v3/role_assignments?user.id=8b2d48d8e422457db7aebb21afd2bf43&scope.project.id=113460ea611c4df1b58899d547c12317&role.id=fd5b8ebb128748d5b34cc4fa37a3d1e8 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:09.158992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 64/123] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:09.158992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd4efe-606a-46e0-917a-0f65b6c56087 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:09.159150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5d7ca-4d4d-4047-b616-22c77888d067 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:09.291947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd4efe-606a-46e0-917a-0f65b6c56087 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:09.338110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5d7ca-4d4d-4047-b616-22c77888d067 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:09.346935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11bea-7ab2-4cc9-9733-373f78ff88b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:09.348648 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11bea-7ab2-4cc9-9733-373f78ff88b0 None admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:09.349143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11bea-7ab2-4cc9-9733-373f78ff88b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:09.349567 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11bea-7ab2-4cc9-9733-373f78ff88b0 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317/users/010c431b36384d8087a2e654e92b481d/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:09.353549 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a11bea-7ab2-4cc9-9733-373f78ff88b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=113460ea611c4df1b58899d547c12317, user_id=010c431b36384d8087a2e654e92b481d, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:09.356392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a11bea-7ab2-4cc9-9733-373f78ff88b0 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:09.377454 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 65/124] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:35:09 2022] PUT /identity/v3/projects/113460ea611c4df1b58899d547c12317/users/010c431b36384d8087a2e654e92b481d/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:35:09.380688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11bea-7ab2-4cc9-9733-373f78ff88b0 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:09.383741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c4aba-4021-4c36-ac1a-5363db77ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:09.384717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c4aba-4021-4c36-ac1a-5363db77ec9b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:09.386407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c4aba-4021-4c36-ac1a-5363db77ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:09.386863 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c4aba-4021-4c36-ac1a-5363db77ec9b None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:09.388177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c4aba-4021-4c36-ac1a-5363db77ec9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:09.389534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c4aba-4021-4c36-ac1a-5363db77ec9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:09.394927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c4aba-4021-4c36-ac1a-5363db77ec9b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:09.410129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:09.411787 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 60/125] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:35:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:09.413603 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c4aba-4021-4c36-ac1a-5363db77ec9b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:09.467041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:09.598518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c4aba-4021-4c36-ac1a-5363db77ec9b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:09.627715 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11bea-7ab2-4cc9-9733-373f78ff88b0 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:09.651594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e230d-aa46-4363-86f4-97f2f19bd87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:09.652568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e230d-aa46-4363-86f4-97f2f19bd87e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:09.652857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e230d-aa46-4363-86f4-97f2f19bd87e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:09.653442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e230d-aa46-4363-86f4-97f2f19bd87e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:09.665879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e230d-aa46-4363-86f4-97f2f19bd87e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-0a6e230d-aa46-4363-86f4-97f2f19bd87e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:09.674994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:09.675880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:09.676630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:09.676630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:09.676630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:09.676630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:09.676630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:09.676630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:09.676630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:09.676630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:09.676630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:09.676630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:09.676630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:09.676630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:09.676630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 61/126] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:09.677251 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e230d-aa46-4363-86f4-97f2f19bd87e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:09.692181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88967892-9ed2-4f6a-b63f-f377f4ab5abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:09.692873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88967892-9ed2-4f6a-b63f-f377f4ab5abf None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:09.693210 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88967892-9ed2-4f6a-b63f-f377f4ab5abf None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:09.693483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88967892-9ed2-4f6a-b63f-f377f4ab5abf None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:09.694298 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88967892-9ed2-4f6a-b63f-f377f4ab5abf None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:09.694612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88967892-9ed2-4f6a-b63f-f377f4ab5abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:09.696055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88967892-9ed2-4f6a-b63f-f377f4ab5abf None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:09.715015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 66/127] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:09.716885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88967892-9ed2-4f6a-b63f-f377f4ab5abf None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:09.827150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:09.851216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:09.867103 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e230d-aa46-4363-86f4-97f2f19bd87e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:09.874687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88967892-9ed2-4f6a-b63f-f377f4ab5abf None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:09.930792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9a362-59e0-4763-8521-d57ee4caeaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:09.931706 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a362-59e0-4763-8521-d57ee4caeaa5 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:09.931998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a362-59e0-4763-8521-d57ee4caeaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:09.932301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a362-59e0-4763-8521-d57ee4caeaa5 None admin] PATH_INFO: `/v3/users/010c431b36384d8087a2e654e92b481d` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:09.932682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a3fc5-814f-4c78-b05a-aea237eab77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:09.933377 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a3fc5-814f-4c78-b05a-aea237eab77e None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:09.933619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9a362-59e0-4763-8521-d57ee4caeaa5 None admin] RBAC: Authorizing `identity:get_user(user_id=010c431b36384d8087a2e654e92b481d)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:09.933722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a3fc5-814f-4c78-b05a-aea237eab77e None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:09.933937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a3fc5-814f-4c78-b05a-aea237eab77e None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:09.934675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a3fc5-814f-4c78-b05a-aea237eab77e None admin] RBAC: Adding query filter params (name=member) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:09.935007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a3fc5-814f-4c78-b05a-aea237eab77e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:09.935115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9a362-59e0-4763-8521-d57ee4caeaa5 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:09.936391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a3fc5-814f-4c78-b05a-aea237eab77e None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:09.937139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 62/128] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:09 2022] GET /identity/v3/users/010c431b36384d8087a2e654e92b481d => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:09.937937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9a362-59e0-4763-8521-d57ee4caeaa5 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:09.954105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 67/129] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:09.954883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a3fc5-814f-4c78-b05a-aea237eab77e None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:10.048766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9a362-59e0-4763-8521-d57ee4caeaa5 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:10.084477 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886aa6d-5ee0-4191-876d-7cdc4f3dd4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:10.085368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886aa6d-5ee0-4191-876d-7cdc4f3dd4fb None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:10.085653 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886aa6d-5ee0-4191-876d-7cdc4f3dd4fb None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:10.085931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886aa6d-5ee0-4191-876d-7cdc4f3dd4fb None admin] PATH_INFO: `/v3/users/7c1cf291bfd64ba287443cde4df814a7` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:10.087188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886aa6d-5ee0-4191-876d-7cdc4f3dd4fb None admin] RBAC: Authorizing `identity:get_user(user_id=7c1cf291bfd64ba287443cde4df814a7)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:10.088944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886aa6d-5ee0-4191-876d-7cdc4f3dd4fb None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:10.090615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 63/130] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:09 2022] GET /identity/v3/users/7c1cf291bfd64ba287443cde4df814a7 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:10.095660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886aa6d-5ee0-4191-876d-7cdc4f3dd4fb None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:10.116794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a3fc5-814f-4c78-b05a-aea237eab77e None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:10.125737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:10.155834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac2522-1d38-4cc7-93cb-53b4ee38eb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:10.157160 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac2522-1d38-4cc7-93cb-53b4ee38eb68 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:10.157592 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac2522-1d38-4cc7-93cb-53b4ee38eb68 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:10.158015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac2522-1d38-4cc7-93cb-53b4ee38eb68 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:10.159575 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac2522-1d38-4cc7-93cb-53b4ee38eb68 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:10.161320 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac2522-1d38-4cc7-93cb-53b4ee38eb68 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:10.163471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 68/131] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:09 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:10.170395 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c2208-efaf-429b-b3f3-3d6c68af7a61 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:10.171034 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c2208-efaf-429b-b3f3-3d6c68af7a61 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:10.171475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c2208-efaf-429b-b3f3-3d6c68af7a61 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:10.173014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 69/132] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:10.178031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c2208-efaf-429b-b3f3-3d6c68af7a61 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:10.182637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:10.205346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886aa6d-5ee0-4191-876d-7cdc4f3dd4fb None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:10.241846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651a90e-6a91-4f7f-abc3-21cc51f5d288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:10.242897 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651a90e-6a91-4f7f-abc3-21cc51f5d288 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:10.243177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651a90e-6a91-4f7f-abc3-21cc51f5d288 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:10.243564 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651a90e-6a91-4f7f-abc3-21cc51f5d288 None admin] PATH_INFO: `/v3/users/010c431b36384d8087a2e654e92b481d` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:10.244820 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651a90e-6a91-4f7f-abc3-21cc51f5d288 None admin] RBAC: Authorizing `identity:get_user(user_id=010c431b36384d8087a2e654e92b481d)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:10.246298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651a90e-6a91-4f7f-abc3-21cc51f5d288 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:10.252611 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 64/133] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:10 2022] GET /identity/v3/users/010c431b36384d8087a2e654e92b481d => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:10.252611 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651a90e-6a91-4f7f-abc3-21cc51f5d288 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:10.309851 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c2208-efaf-429b-b3f3-3d6c68af7a61 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:10.353935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec567e1-fa31-47f6-a715-71f1b81ca226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:10.355600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec567e1-fa31-47f6-a715-71f1b81ca226 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:10.356113 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec567e1-fa31-47f6-a715-71f1b81ca226 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:10.356653 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec567e1-fa31-47f6-a715-71f1b81ca226 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:10.358283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec567e1-fa31-47f6-a715-71f1b81ca226 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:10.360154 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec567e1-fa31-47f6-a715-71f1b81ca226 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:10.361304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:10.362475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 70/134] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:10 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:10.364016 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adc5d7-e649-4071-b83e-e80d355173db None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:10.365534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adc5d7-e649-4071-b83e-e80d355173db None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:10.365534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adc5d7-e649-4071-b83e-e80d355173db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:10.371006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651a90e-6a91-4f7f-abc3-21cc51f5d288 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:10.388784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-33adc5d7-e649-4071-b83e-e80d355173db None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:10.390267 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-33adc5d7-e649-4071-b83e-e80d355173db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:10.409578 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7040d-2fc9-41c2-9180-bab7deb0e774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:10.410627 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7040d-2fc9-41c2-9180-bab7deb0e774 None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:10.410943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7040d-2fc9-41c2-9180-bab7deb0e774 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:10.411224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7040d-2fc9-41c2-9180-bab7deb0e774 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317/users/010c431b36384d8087a2e654e92b481d/roles/4af08bea19b94c2c863a51b103f50b8b` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:10.413657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7040d-2fc9-41c2-9180-bab7deb0e774 None admin] RBAC: Authorizing `identity:create_grant(project_id=113460ea611c4df1b58899d547c12317, user_id=010c431b36384d8087a2e654e92b481d, role_id=4af08bea19b94c2c863a51b103f50b8b)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:10.415287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7040d-2fc9-41c2-9180-bab7deb0e774 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:10.435499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 65/135] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:35:10 2022] PUT /identity/v3/projects/113460ea611c4df1b58899d547c12317/users/010c431b36384d8087a2e654e92b481d/roles/4af08bea19b94c2c863a51b103f50b8b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:35:10.436405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7040d-2fc9-41c2-9180-bab7deb0e774 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:10.518491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 71/136] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:10.520341 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adc5d7-e649-4071-b83e-e80d355173db None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:10.527471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:10.659774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7040d-2fc9-41c2-9180-bab7deb0e774 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:10.696348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adc5d7-e649-4071-b83e-e80d355173db None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:10.701792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3026cdf-8c50-4ba9-b30e-d54e951e1351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:10.702679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026cdf-8c50-4ba9-b30e-d54e951e1351 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:10.703022 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026cdf-8c50-4ba9-b30e-d54e951e1351 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:10.703307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026cdf-8c50-4ba9-b30e-d54e951e1351 None admin] PATH_INFO: `/v3/projects/41318efb050a4640b7056fc0531144b0` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:10.704602 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3026cdf-8c50-4ba9-b30e-d54e951e1351 None admin] RBAC: Authorizing `identity:get_project(project_id=41318efb050a4640b7056fc0531144b0)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:10.706208 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3026cdf-8c50-4ba9-b30e-d54e951e1351 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:10.708085 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 66/137] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:10 2022] GET /identity/v3/projects/41318efb050a4640b7056fc0531144b0 => generated 312 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:10.714911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3026cdf-8c50-4ba9-b30e-d54e951e1351 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:10.733510 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a38a8-7c7c-4c45-bc4b-98f90817b2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:10.734427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a38a8-7c7c-4c45-bc4b-98f90817b2ab None admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:10.734722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a38a8-7c7c-4c45-bc4b-98f90817b2ab None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:10.735027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a38a8-7c7c-4c45-bc4b-98f90817b2ab None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317/users/7c1cf291bfd64ba287443cde4df814a7/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:10.737165 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a38a8-7c7c-4c45-bc4b-98f90817b2ab None admin] RBAC: Authorizing `identity:create_grant(project_id=113460ea611c4df1b58899d547c12317, user_id=7c1cf291bfd64ba287443cde4df814a7, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:10.738716 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a38a8-7c7c-4c45-bc4b-98f90817b2ab None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:10.744668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:10.754148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 72/138] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:35:10 2022] PUT /identity/v3/projects/113460ea611c4df1b58899d547c12317/users/7c1cf291bfd64ba287443cde4df814a7/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:35:10.755099 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a38a8-7c7c-4c45-bc4b-98f90817b2ab None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:10.826725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:10.844556 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3026cdf-8c50-4ba9-b30e-d54e951e1351 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:10.869519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a38a8-7c7c-4c45-bc4b-98f90817b2ab None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:10.887388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d6f02-2d0d-4aaa-92a6-c48e54657603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:10.888589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d6f02-2d0d-4aaa-92a6-c48e54657603 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:10.889073 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d6f02-2d0d-4aaa-92a6-c48e54657603 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:10.889552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d6f02-2d0d-4aaa-92a6-c48e54657603 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:10.890982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d6f02-2d0d-4aaa-92a6-c48e54657603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:10.892857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d6f02-2d0d-4aaa-92a6-c48e54657603 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:10.894804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 67/139] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:10.900971 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d6f02-2d0d-4aaa-92a6-c48e54657603 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:10.947434 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7897a-17d5-42ea-a69b-2ceb43149410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:10.949474 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7897a-17d5-42ea-a69b-2ceb43149410 None admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:10.952369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7897a-17d5-42ea-a69b-2ceb43149410 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:10.954561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7897a-17d5-42ea-a69b-2ceb43149410 None admin] PATH_INFO: `/v3/projects/41318efb050a4640b7056fc0531144b0/users/010c431b36384d8087a2e654e92b481d/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:10.958790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7897a-17d5-42ea-a69b-2ceb43149410 None admin] RBAC: Authorizing `identity:create_grant(project_id=41318efb050a4640b7056fc0531144b0, user_id=010c431b36384d8087a2e654e92b481d, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:10.962847 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7897a-17d5-42ea-a69b-2ceb43149410 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:11.000939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 73/140] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:35:10 2022] PUT /identity/v3/projects/41318efb050a4640b7056fc0531144b0/users/010c431b36384d8087a2e654e92b481d/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:35:11.076656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:11.083503 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d6f02-2d0d-4aaa-92a6-c48e54657603 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:11.139097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71922f-d040-4dbb-a63f-1f7909035ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:11.139803 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71922f-d040-4dbb-a63f-1f7909035ce1 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:11.140091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71922f-d040-4dbb-a63f-1f7909035ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:11.140454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71922f-d040-4dbb-a63f-1f7909035ce1 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:11.141186 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71922f-d040-4dbb-a63f-1f7909035ce1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:11.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71922f-d040-4dbb-a63f-1f7909035ce1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:11.180552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 68/141] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:35:10 2022] POST /identity/v3/users => generated 283 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:35:11.536310 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764c678-65aa-4381-876d-175dc8d1b596 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:11.536686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764c678-65aa-4381-876d-175dc8d1b596 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:11.536879 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764c678-65aa-4381-876d-175dc8d1b596 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:11.538412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 74/142] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:11.544171 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5c13c-ecfc-44c9-b85d-fbf0b8b40a3d None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:11.544467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5c13c-ecfc-44c9-b85d-fbf0b8b40a3d None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:11.544749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5c13c-ecfc-44c9-b85d-fbf0b8b40a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:11.565027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-bac5c13c-ecfc-44c9-b85d-fbf0b8b40a3d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:11.566579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-bac5c13c-ecfc-44c9-b85d-fbf0b8b40a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:11.642832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 69/143] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:11.683817 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764c678-65aa-4381-876d-175dc8d1b596 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:11.815459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764c678-65aa-4381-876d-175dc8d1b596 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:11.841811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:11.854247 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0108-ff07-4f25-908d-2f07b6c515bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:11.855228 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0108-ff07-4f25-908d-2f07b6c515bd None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:11.855739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0108-ff07-4f25-908d-2f07b6c515bd None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:11.856188 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0108-ff07-4f25-908d-2f07b6c515bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:11.869268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0108-ff07-4f25-908d-2f07b6c515bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-031a0108-ff07-4f25-908d-2f07b6c515bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:11.877646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:11.878570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:11.879396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:11.879396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:11.879396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:11.879396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:11.879396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:11.879396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:11.879396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:11.879396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:11.879396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:11.879396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:11.879396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:11.879396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:11.881304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 75/144] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:11.887188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5c13c-ecfc-44c9-b85d-fbf0b8b40a3d None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:11.972737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:12.009158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5c13c-ecfc-44c9-b85d-fbf0b8b40a3d None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:12.015234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abb468-7507-4c73-b16f-bb5282806316 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:12.015522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abb468-7507-4c73-b16f-bb5282806316 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:12.015798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abb468-7507-4c73-b16f-bb5282806316 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:12.017193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 76/145] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:12.022375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07542-2065-43d0-bf99-a87951786b7e None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:12.022663 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07542-2065-43d0-bf99-a87951786b7e None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:12.022966 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07542-2065-43d0-bf99-a87951786b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:12.050333 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-72b07542-2065-43d0-bf99-a87951786b7e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:12.051595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-72b07542-2065-43d0-bf99-a87951786b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:12.089614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c008f-6eec-4969-bdff-38f5ffa8270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:12.090235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c008f-6eec-4969-bdff-38f5ffa8270d None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:12.090522 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c008f-6eec-4969-bdff-38f5ffa8270d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:12.090837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c008f-6eec-4969-bdff-38f5ffa8270d None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:12.091616 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c008f-6eec-4969-bdff-38f5ffa8270d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:12.091935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c008f-6eec-4969-bdff-38f5ffa8270d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:12.093454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c008f-6eec-4969-bdff-38f5ffa8270d None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:12.102914 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 70/146] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:12.108758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c008f-6eec-4969-bdff-38f5ffa8270d None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:12.168337 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 77/147] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:12.193086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b07542-2065-43d0-bf99-a87951786b7e None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:12.296227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c008f-6eec-4969-bdff-38f5ffa8270d None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:12.346190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcdce5-1b41-4faf-b2bd-85241ec7f29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:12.347117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcdce5-1b41-4faf-b2bd-85241ec7f29e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:12.347403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcdce5-1b41-4faf-b2bd-85241ec7f29e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:12.347682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcdce5-1b41-4faf-b2bd-85241ec7f29e None admin] PATH_INFO: `/v3/users/8b2d48d8e422457db7aebb21afd2bf43` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:12.348901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcdce5-1b41-4faf-b2bd-85241ec7f29e None admin] RBAC: Authorizing `identity:get_user(user_id=8b2d48d8e422457db7aebb21afd2bf43)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:12.350401 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcdce5-1b41-4faf-b2bd-85241ec7f29e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:12.352528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 71/148] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:12 2022] GET /identity/v3/users/8b2d48d8e422457db7aebb21afd2bf43 => generated 289 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:12.358145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcdce5-1b41-4faf-b2bd-85241ec7f29e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:12.364763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b07542-2065-43d0-bf99-a87951786b7e None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:12.375372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:12.384805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:12.423104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d5693-c6af-4166-bc93-1bf7aae11e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:12.424267 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5693-c6af-4166-bc93-1bf7aae11e3b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:12.424762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5693-c6af-4166-bc93-1bf7aae11e3b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:12.425221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5693-c6af-4166-bc93-1bf7aae11e3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:12.451779 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d5693-c6af-4166-bc93-1bf7aae11e3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-127d5693-c6af-4166-bc93-1bf7aae11e3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:12.461323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:12.462196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:12.462988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:12.462988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:12.462988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:12.462988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:12.462988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:12.462988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:12.462988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:12.462988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:12.462988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:12.462988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:12.462988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:12.462988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:12.465491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 78/149] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:35:12.472962 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d5693-c6af-4166-bc93-1bf7aae11e3b None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:12.559445 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcdce5-1b41-4faf-b2bd-85241ec7f29e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:12.639650 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca8c55-61e1-4c9c-a39d-2de598a83ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:12.640468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca8c55-61e1-4c9c-a39d-2de598a83ad1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:12.640751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca8c55-61e1-4c9c-a39d-2de598a83ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:12.641026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca8c55-61e1-4c9c-a39d-2de598a83ad1 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:12.642086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d5693-c6af-4166-bc93-1bf7aae11e3b None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:12.642321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca8c55-61e1-4c9c-a39d-2de598a83ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:12.643809 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca8c55-61e1-4c9c-a39d-2de598a83ad1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:12.645816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 72/150] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:12 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:12.651388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca8c55-61e1-4c9c-a39d-2de598a83ad1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:12.705161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cd6d9-7c9a-4819-aee6-ed1471d9d69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:12.705847 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cd6d9-7c9a-4819-aee6-ed1471d9d69f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:12.706138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cd6d9-7c9a-4819-aee6-ed1471d9d69f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:12.706405 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cd6d9-7c9a-4819-aee6-ed1471d9d69f None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:12.711440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cd6d9-7c9a-4819-aee6-ed1471d9d69f None admin] RBAC: Adding query filter params (name=member) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:12.711911 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cd6d9-7c9a-4819-aee6-ed1471d9d69f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:12.713420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cd6d9-7c9a-4819-aee6-ed1471d9d69f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:12.727576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 79/151] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:12.734730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cd6d9-7c9a-4819-aee6-ed1471d9d69f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:12.787459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:12.813226 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:12.878454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca8c55-61e1-4c9c-a39d-2de598a83ad1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:12.903903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cd6d9-7c9a-4819-aee6-ed1471d9d69f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:12.957562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207019b-b7e6-4a26-8d7e-32c7c09ab5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:12.959066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207019b-b7e6-4a26-8d7e-32c7c09ab5a3 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:12.959349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207019b-b7e6-4a26-8d7e-32c7c09ab5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:12.959624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207019b-b7e6-4a26-8d7e-32c7c09ab5a3 None admin] PATH_INFO: `/v3/users/010c431b36384d8087a2e654e92b481d` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:12.960871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207019b-b7e6-4a26-8d7e-32c7c09ab5a3 None admin] RBAC: Authorizing `identity:get_user(user_id=010c431b36384d8087a2e654e92b481d)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:12.962370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207019b-b7e6-4a26-8d7e-32c7c09ab5a3 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:12.964646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 80/152] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:12 2022] GET /identity/v3/users/010c431b36384d8087a2e654e92b481d => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:12.974736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207019b-b7e6-4a26-8d7e-32c7c09ab5a3 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:12.995853 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfbaec-39a8-4b2c-ad36-3be5f7aba0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:12.996792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfbaec-39a8-4b2c-ad36-3be5f7aba0c9 None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:12.997083 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfbaec-39a8-4b2c-ad36-3be5f7aba0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:12.997363 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfbaec-39a8-4b2c-ad36-3be5f7aba0c9 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317/users/8b2d48d8e422457db7aebb21afd2bf43/roles/fd5b8ebb128748d5b34cc4fa37a3d1e8` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:13.001265 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfbaec-39a8-4b2c-ad36-3be5f7aba0c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=113460ea611c4df1b58899d547c12317, user_id=8b2d48d8e422457db7aebb21afd2bf43, role_id=fd5b8ebb128748d5b34cc4fa37a3d1e8)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:13.002740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfbaec-39a8-4b2c-ad36-3be5f7aba0c9 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:13.033451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 73/153] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:35:12 2022] PUT /identity/v3/projects/113460ea611c4df1b58899d547c12317/users/8b2d48d8e422457db7aebb21afd2bf43/roles/fd5b8ebb128748d5b34cc4fa37a3d1e8 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:35:13.104074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207019b-b7e6-4a26-8d7e-32c7c09ab5a3 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:13.105942 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:13.142067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa614a3-3315-4e7d-9829-bfdae9ced85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:13.142782 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa614a3-3315-4e7d-9829-bfdae9ced85b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:13.143069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa614a3-3315-4e7d-9829-bfdae9ced85b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:13.143343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa614a3-3315-4e7d-9829-bfdae9ced85b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:13.216198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa614a3-3315-4e7d-9829-bfdae9ced85b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:13.217634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa614a3-3315-4e7d-9829-bfdae9ced85b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:13.323785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 81/154] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 03:35:13.329555 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfbaec-39a8-4b2c-ad36-3be5f7aba0c9 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:13.482629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfbaec-39a8-4b2c-ad36-3be5f7aba0c9 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:13.517792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9e032-acaa-46cb-aefd-1ff4303eaba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:13.518680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9e032-acaa-46cb-aefd-1ff4303eaba3 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:13.518993 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9e032-acaa-46cb-aefd-1ff4303eaba3 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:13.519274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9e032-acaa-46cb-aefd-1ff4303eaba3 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:13.520497 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9e032-acaa-46cb-aefd-1ff4303eaba3 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:13.521981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9e032-acaa-46cb-aefd-1ff4303eaba3 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:13.523741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 74/155] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:13 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:13.529996 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa614a3-3315-4e7d-9829-bfdae9ced85b None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:13.532247 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:13.670397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa614a3-3315-4e7d-9829-bfdae9ced85b None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:13.705350 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313922f8-3332-4c85-87ca-afe07b42085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:13.706024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313922f8-3332-4c85-87ca-afe07b42085d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:13.706307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313922f8-3332-4c85-87ca-afe07b42085d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:13.706585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313922f8-3332-4c85-87ca-afe07b42085d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:13.707455 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313922f8-3332-4c85-87ca-afe07b42085d None admin] RBAC: Adding query filter params (role.id=59a0f03d08fd401ebbd29ebd5f174abb, scope.project.id=113460ea611c4df1b58899d547c12317, user.id=010c431b36384d8087a2e654e92b481d) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:13.707768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313922f8-3332-4c85-87ca-afe07b42085d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:13.709234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313922f8-3332-4c85-87ca-afe07b42085d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:13.715443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 82/156] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:13 2022] GET /identity/v3/role_assignments?user.id=010c431b36384d8087a2e654e92b481d&scope.project.id=113460ea611c4df1b58899d547c12317&role.id=59a0f03d08fd401ebbd29ebd5f174abb => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:13.832533 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a58e24-c973-4518-975a-eafb73a925ee None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:13.833138 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a58e24-c973-4518-975a-eafb73a925ee None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:13.833638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a58e24-c973-4518-975a-eafb73a925ee None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:13.835741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 75/157] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:13.857117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96abff4-4827-48aa-83aa-21b2f095090d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:13.857447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96abff4-4827-48aa-83aa-21b2f095090d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:13.857693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96abff4-4827-48aa-83aa-21b2f095090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:13.878962 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-f96abff4-4827-48aa-83aa-21b2f095090d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:13.880174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-f96abff4-4827-48aa-83aa-21b2f095090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:13.967569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:13.980213 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 83/158] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:14.023819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a58e24-c973-4518-975a-eafb73a925ee None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:14.027565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:14.163328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a58e24-c973-4518-975a-eafb73a925ee None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:14.206333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7863af5-d6e2-4be4-9d75-77b31a668e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:14.207194 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7863af5-d6e2-4be4-9d75-77b31a668e04 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:14.207483 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7863af5-d6e2-4be4-9d75-77b31a668e04 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:14.207760 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7863af5-d6e2-4be4-9d75-77b31a668e04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:14.224160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7863af5-d6e2-4be4-9d75-77b31a668e04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-e7863af5-d6e2-4be4-9d75-77b31a668e04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:14.238348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:14.239370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:14.240154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:14.240154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:14.240154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:14.240154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:14.240154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:14.240154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:14.240154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:14.240154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:14.240154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:14.240154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:14.240154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:14.240154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:14.240154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 76/159] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:35:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:14.247976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96abff4-4827-48aa-83aa-21b2f095090d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:14.371902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96abff4-4827-48aa-83aa-21b2f095090d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:14.407525 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89969b9e-c1b1-4334-b922-00c37592e7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:14.408207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89969b9e-c1b1-4334-b922-00c37592e7ac None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:14.408484 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89969b9e-c1b1-4334-b922-00c37592e7ac None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:14.408759 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89969b9e-c1b1-4334-b922-00c37592e7ac None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:14.409523 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89969b9e-c1b1-4334-b922-00c37592e7ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:14.409829 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89969b9e-c1b1-4334-b922-00c37592e7ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:14.411278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89969b9e-c1b1-4334-b922-00c37592e7ac None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:14.420425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 84/160] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:35:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:14.425897 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7863af5-d6e2-4be4-9d75-77b31a668e04 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:14.495387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:14.545767 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7863af5-d6e2-4be4-9d75-77b31a668e04 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:14.585720 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d90f5-3760-4bdc-a1d3-3d2df6a7623f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:14.586660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d90f5-3760-4bdc-a1d3-3d2df6a7623f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:14.586963 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d90f5-3760-4bdc-a1d3-3d2df6a7623f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:14.587237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d90f5-3760-4bdc-a1d3-3d2df6a7623f None admin] PATH_INFO: `/v3/users/010c431b36384d8087a2e654e92b481d` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:14.588524 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d90f5-3760-4bdc-a1d3-3d2df6a7623f None admin] RBAC: Authorizing `identity:get_user(user_id=010c431b36384d8087a2e654e92b481d)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:14.589964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d90f5-3760-4bdc-a1d3-3d2df6a7623f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:14.591643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 77/161] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:14 2022] GET /identity/v3/users/010c431b36384d8087a2e654e92b481d => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:14.597307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89969b9e-c1b1-4334-b922-00c37592e7ac None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:14.657132 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:14.699762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89969b9e-c1b1-4334-b922-00c37592e7ac None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:14.734681 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920aada-eec2-4e56-8ed8-54b81dd4c172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:14.735375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920aada-eec2-4e56-8ed8-54b81dd4c172 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:14.735657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920aada-eec2-4e56-8ed8-54b81dd4c172 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:14.735933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920aada-eec2-4e56-8ed8-54b81dd4c172 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:14.777644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef625091-1e25-4850-9c79-795d25bc0169 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:14.777931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef625091-1e25-4850-9c79-795d25bc0169 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:14.778209 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef625091-1e25-4850-9c79-795d25bc0169 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:14.779679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 78/162] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:14.785133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ac44e-6281-44bc-a10b-340e4f73f257 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:14.785417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ac44e-6281-44bc-a10b-340e4f73f257 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:14.785696 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ac44e-6281-44bc-a10b-340e4f73f257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:14.814408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-d31ac44e-6281-44bc-a10b-340e4f73f257 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:14.815684 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d31ac44e-6281-44bc-a10b-340e4f73f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:14.847910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920aada-eec2-4e56-8ed8-54b81dd4c172 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:14.847910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920aada-eec2-4e56-8ed8-54b81dd4c172 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:14.955219 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 79/163] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:14.975122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:15.001598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 85/164] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:15.005099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ac44e-6281-44bc-a10b-340e4f73f257 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:15.015846 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920aada-eec2-4e56-8ed8-54b81dd4c172 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:15.100719 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:15.157657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ac44e-6281-44bc-a10b-340e4f73f257 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:15.207027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2fcdb-4942-4f27-9ed5-ff0e0594009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:15.207027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2fcdb-4942-4f27-9ed5-ff0e0594009a None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:15.207027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2fcdb-4942-4f27-9ed5-ff0e0594009a None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:15.207027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2fcdb-4942-4f27-9ed5-ff0e0594009a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:15.209693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920aada-eec2-4e56-8ed8-54b81dd4c172 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:15.212898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2fcdb-4942-4f27-9ed5-ff0e0594009a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-a0e2fcdb-4942-4f27-9ed5-ff0e0594009a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:15.220858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:15.221728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:15.222516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:15.222516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:15.222516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:15.222516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:15.222516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:15.222516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:15.222516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:15.222516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:15.222516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:15.222516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:15.222516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:15.222516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:15.222516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 80/165] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:35:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:15.224316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10579d24-2b26-4ebd-862b-dfdc5dcde896 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:15.224316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10579d24-2b26-4ebd-862b-dfdc5dcde896 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:15.224316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10579d24-2b26-4ebd-862b-dfdc5dcde896 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:15.225733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 81/166] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:15.230262 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10579d24-2b26-4ebd-862b-dfdc5dcde896 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:15.288826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5441324-f0ff-49a9-b16e-8bc781e557d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:15.289706 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441324-f0ff-49a9-b16e-8bc781e557d6 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:15.289982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441324-f0ff-49a9-b16e-8bc781e557d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:15.290251 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441324-f0ff-49a9-b16e-8bc781e557d6 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:15.292780 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5441324-f0ff-49a9-b16e-8bc781e557d6 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:15.295689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5441324-f0ff-49a9-b16e-8bc781e557d6 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:15.298693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 86/167] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:15 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:15.299884 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0136c2-bc56-4222-b92a-db7432351f30 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:15.300168 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0136c2-bc56-4222-b92a-db7432351f30 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:15.300441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0136c2-bc56-4222-b92a-db7432351f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:15.337554 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-9d0136c2-bc56-4222-b92a-db7432351f30 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:15.338818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9d0136c2-bc56-4222-b92a-db7432351f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:15.375075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:15.425223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10579d24-2b26-4ebd-862b-dfdc5dcde896 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:15.462322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:15.474743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 87/168] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:15.477948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0136c2-bc56-4222-b92a-db7432351f30 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:15.498867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af219891-8d8d-4e60-a94d-f2356268def9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:15.499552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af219891-8d8d-4e60-a94d-f2356268def9 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:15.499831 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af219891-8d8d-4e60-a94d-f2356268def9 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:15.500104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af219891-8d8d-4e60-a94d-f2356268def9 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:15.500998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af219891-8d8d-4e60-a94d-f2356268def9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:15.501224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af219891-8d8d-4e60-a94d-f2356268def9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:15.502618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af219891-8d8d-4e60-a94d-f2356268def9 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:15.520755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 82/169] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:15.528923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af219891-8d8d-4e60-a94d-f2356268def9 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:15.647236 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0136c2-bc56-4222-b92a-db7432351f30 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:15.683753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6d458-ed02-4c5f-add5-889ceed0d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:15.684434 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6d458-ed02-4c5f-add5-889ceed0d4fa None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:15.684715 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6d458-ed02-4c5f-add5-889ceed0d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:15.684982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6d458-ed02-4c5f-add5-889ceed0d4fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:15.685941 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6d458-ed02-4c5f-add5-889ceed0d4fa None admin] RBAC: Adding query filter params (role.id=4af08bea19b94c2c863a51b103f50b8b, scope.project.id=113460ea611c4df1b58899d547c12317, user.id=010c431b36384d8087a2e654e92b481d) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:15.686255 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6d458-ed02-4c5f-add5-889ceed0d4fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:15.687780 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6d458-ed02-4c5f-add5-889ceed0d4fa None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:15.693688 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af219891-8d8d-4e60-a94d-f2356268def9 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:15.699436 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 88/170] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:15 2022] GET /identity/v3/role_assignments?user.id=010c431b36384d8087a2e654e92b481d&scope.project.id=113460ea611c4df1b58899d547c12317&role.id=4af08bea19b94c2c863a51b103f50b8b => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:15.700293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6d458-ed02-4c5f-add5-889ceed0d4fa None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:15.735368 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:15.765420 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a3ea3-9c06-4946-ad5b-987df0bb9ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:15.766542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a3ea3-9c06-4946-ad5b-987df0bb9ce1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:15.767001 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a3ea3-9c06-4946-ad5b-987df0bb9ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:15.767414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a3ea3-9c06-4946-ad5b-987df0bb9ce1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:15.791268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a3ea3-9c06-4946-ad5b-987df0bb9ce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-0c7a3ea3-9c06-4946-ad5b-987df0bb9ce1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:15.799487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:15.800599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:15.801526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:15.801526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:15.801526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:15.801526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:15.801526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:15.801526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:15.801526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:15.801526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:15.801526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:15.801526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:15.801526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:15.801526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:15.807616 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 83/171] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:15.823865 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a3ea3-9c06-4946-ad5b-987df0bb9ce1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:15.828514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6d458-ed02-4c5f-add5-889ceed0d4fa None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:15.866413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5f12-ca2c-46dc-baee-656d73b81d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:15.867741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5f12-ca2c-46dc-baee-656d73b81d0e None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:15.868274 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5f12-ca2c-46dc-baee-656d73b81d0e None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:15.868687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5f12-ca2c-46dc-baee-656d73b81d0e None admin] PATH_INFO: `/v3/users/7c1cf291bfd64ba287443cde4df814a7` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:15.870313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed5f12-ca2c-46dc-baee-656d73b81d0e None admin] RBAC: Authorizing `identity:get_user(user_id=7c1cf291bfd64ba287443cde4df814a7)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:15.872002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed5f12-ca2c-46dc-baee-656d73b81d0e None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:15.874388 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 89/172] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:15 2022] GET /identity/v3/users/7c1cf291bfd64ba287443cde4df814a7 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:15.875922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d746c-41da-4714-9f96-743f58f6d96d None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:15.876345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d746c-41da-4714-9f96-743f58f6d96d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:15.876759 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d746c-41da-4714-9f96-743f58f6d96d None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:15.878184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 90/173] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:15.879699 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d746c-41da-4714-9f96-743f58f6d96d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:15.901879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:15.987236 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:16.003288 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d746c-41da-4714-9f96-743f58f6d96d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:16.033398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a3ea3-9c06-4946-ad5b-987df0bb9ce1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:16.056165 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647e48a-6f78-4d5c-9ddd-5e283f80461a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:16.057045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647e48a-6f78-4d5c-9ddd-5e283f80461a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:16.057352 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647e48a-6f78-4d5c-9ddd-5e283f80461a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:16.057951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647e48a-6f78-4d5c-9ddd-5e283f80461a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:16.128036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eba6d7-246b-4683-873d-cf9538c45ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:16.129330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba6d7-246b-4683-873d-cf9538c45ba4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:16.129761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba6d7-246b-4683-873d-cf9538c45ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:16.130182 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba6d7-246b-4683-873d-cf9538c45ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:16.131127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eba6d7-246b-4683-873d-cf9538c45ba4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:16.131596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eba6d7-246b-4683-873d-cf9538c45ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:16.133156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eba6d7-246b-4683-873d-cf9538c45ba4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:16.142196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647e48a-6f78-4d5c-9ddd-5e283f80461a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:16.144525 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647e48a-6f78-4d5c-9ddd-5e283f80461a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:16.150021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 84/174] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:16.151624 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3befbb-6dbc-42aa-8ae3-bf8e334a4c16 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:16.155237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3befbb-6dbc-42aa-8ae3-bf8e334a4c16 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:16.155686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3befbb-6dbc-42aa-8ae3-bf8e334a4c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:16.187912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-be3befbb-6dbc-42aa-8ae3-bf8e334a4c16 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:16.189402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-be3befbb-6dbc-42aa-8ae3-bf8e334a4c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:16.250333 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:16.265982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 91/175] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:16.267358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647e48a-6f78-4d5c-9ddd-5e283f80461a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:16.374169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 85/176] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:16.375416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3befbb-6dbc-42aa-8ae3-bf8e334a4c16 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:16.390580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647e48a-6f78-4d5c-9ddd-5e283f80461a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:16.428447 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:16.437514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88b44a-4bce-42b8-9a41-df436d3bb630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:16.438849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88b44a-4bce-42b8-9a41-df436d3bb630 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:16.439327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88b44a-4bce-42b8-9a41-df436d3bb630 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:16.439803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88b44a-4bce-42b8-9a41-df436d3bb630 None admin] PATH_INFO: `/v3/users/010c431b36384d8087a2e654e92b481d` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:16.441252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88b44a-4bce-42b8-9a41-df436d3bb630 None admin] RBAC: Authorizing `identity:get_user(user_id=010c431b36384d8087a2e654e92b481d)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:16.443140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88b44a-4bce-42b8-9a41-df436d3bb630 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:16.445352 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 92/177] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:16 2022] GET /identity/v3/users/010c431b36384d8087a2e654e92b481d => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:16.446897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5d047-f0be-49f2-bba9-26aacc0af21b None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:16.447370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5d047-f0be-49f2-bba9-26aacc0af21b None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:16.447859 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5d047-f0be-49f2-bba9-26aacc0af21b None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:16.449277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 93/178] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:16.450141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5d047-f0be-49f2-bba9-26aacc0af21b None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:16.521175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:16.523692 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3befbb-6dbc-42aa-8ae3-bf8e334a4c16 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:16.572830 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b79b0-d3a9-4280-9980-c5f5b40bf5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:16.574283 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b79b0-d3a9-4280-9980-c5f5b40bf5c1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:16.575142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b79b0-d3a9-4280-9980-c5f5b40bf5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:16.575710 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b79b0-d3a9-4280-9980-c5f5b40bf5c1 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:16.577443 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b79b0-d3a9-4280-9980-c5f5b40bf5c1 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:16.579747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b79b0-d3a9-4280-9980-c5f5b40bf5c1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:16.581699 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5d047-f0be-49f2-bba9-26aacc0af21b None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:16.582816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 86/179] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:16 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:16.584016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b79b0-d3a9-4280-9980-c5f5b40bf5c1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:16.623114 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef72087-b175-4c4d-af8f-6d34549d26eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:16.623924 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef72087-b175-4c4d-af8f-6d34549d26eb None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:16.624209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef72087-b175-4c4d-af8f-6d34549d26eb None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:16.624483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef72087-b175-4c4d-af8f-6d34549d26eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:16.635151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef72087-b175-4c4d-af8f-6d34549d26eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-3ef72087-b175-4c4d-af8f-6d34549d26eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:16.642883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:16.643746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:16.644522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:16.644522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:16.644522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:16.644522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:16.644522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:16.644522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:16.644522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:16.644522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:16.644522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:16.644522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:16.644522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:16.644522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:16.644522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 94/180] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:35:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:16.645638 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761df38-7811-4fcd-8c71-616f487b2b1d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:16.645638 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761df38-7811-4fcd-8c71-616f487b2b1d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:16.645926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761df38-7811-4fcd-8c71-616f487b2b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:16.663639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-d761df38-7811-4fcd-8c71-616f487b2b1d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:16.664838 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d761df38-7811-4fcd-8c71-616f487b2b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:16.697565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b79b0-d3a9-4280-9980-c5f5b40bf5c1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:16.699115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:16.733146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcc051-5f4a-4b92-aafb-e8a9bcbff2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:16.733845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcc051-5f4a-4b92-aafb-e8a9bcbff2c1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:16.734097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcc051-5f4a-4b92-aafb-e8a9bcbff2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:16.734378 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcc051-5f4a-4b92-aafb-e8a9bcbff2c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:16.742717 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 95/181] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:16.751244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761df38-7811-4fcd-8c71-616f487b2b1d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:16.798560 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:16.812387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcc051-5f4a-4b92-aafb-e8a9bcbff2c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:16.813889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcc051-5f4a-4b92-aafb-e8a9bcbff2c1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:16.852026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761df38-7811-4fcd-8c71-616f487b2b1d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:16.886292 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2b83e-e46b-4775-abdb-5d57abde6ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:16.887739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2b83e-e46b-4775-abdb-5d57abde6ffc None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:16.888055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2b83e-e46b-4775-abdb-5d57abde6ffc None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:16.888322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2b83e-e46b-4775-abdb-5d57abde6ffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:16.889154 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2b83e-e46b-4775-abdb-5d57abde6ffc None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=113460ea611c4df1b58899d547c12317, user.id=7c1cf291bfd64ba287443cde4df814a7) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:16.889465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2b83e-e46b-4775-abdb-5d57abde6ffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:16.890958 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2b83e-e46b-4775-abdb-5d57abde6ffc None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:16.897937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 96/182] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:16 2022] GET /identity/v3/role_assignments?user.id=7c1cf291bfd64ba287443cde4df814a7&scope.project.id=113460ea611c4df1b58899d547c12317&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:16.899142 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225216ae-9879-4ced-af7d-0aee592da84e None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:16.899407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225216ae-9879-4ced-af7d-0aee592da84e None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:16.899707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225216ae-9879-4ced-af7d-0aee592da84e None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:16.901215 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 97/183] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:16.901951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225216ae-9879-4ced-af7d-0aee592da84e None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:16.925204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 87/184] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:16.925204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcc051-5f4a-4b92-aafb-e8a9bcbff2c1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:16.932652 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:17.023498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225216ae-9879-4ced-af7d-0aee592da84e None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:17.035813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:17.060837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcc051-5f4a-4b92-aafb-e8a9bcbff2c1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:17.065363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06ffda-d7f6-473f-8133-e5a64b4b5746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:17.066070 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06ffda-d7f6-473f-8133-e5a64b4b5746 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:17.066349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06ffda-d7f6-473f-8133-e5a64b4b5746 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:17.066624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06ffda-d7f6-473f-8133-e5a64b4b5746 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:17.070963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06ffda-d7f6-473f-8133-e5a64b4b5746 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:17.070963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06ffda-d7f6-473f-8133-e5a64b4b5746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:17.070963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06ffda-d7f6-473f-8133-e5a64b4b5746 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:17.081495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 98/185] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:17.083473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3c247-54e8-48d5-806d-6301f668e86a None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:17.083763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3c247-54e8-48d5-806d-6301f668e86a None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:17.084040 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3c247-54e8-48d5-806d-6301f668e86a None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:17.085315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 99/186] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:17.086936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ce674-2cd4-4d59-a972-0f32c336692e None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:17.086936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ce674-2cd4-4d59-a972-0f32c336692e None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:17.087203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ce674-2cd4-4d59-a972-0f32c336692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:17.107748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ce7ce674-2cd4-4d59-a972-0f32c336692e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:17.108955 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ce7ce674-2cd4-4d59-a972-0f32c336692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:17.110966 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dba867-eee5-453d-b344-b6f7553a1909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:17.111781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dba867-eee5-453d-b344-b6f7553a1909 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:17.112060 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dba867-eee5-453d-b344-b6f7553a1909 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:17.112844 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dba867-eee5-453d-b344-b6f7553a1909 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:17.113591 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dba867-eee5-453d-b344-b6f7553a1909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:17.115109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dba867-eee5-453d-b344-b6f7553a1909 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:17.116787 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 88/187] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:17.117730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dba867-eee5-453d-b344-b6f7553a1909 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:17.180736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 100/188] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:17.181407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ce674-2cd4-4d59-a972-0f32c336692e None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:17.186627 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:17.220319 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dba867-eee5-453d-b344-b6f7553a1909 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:17.254431 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931543f-5fa8-4474-8fa7-4f1846ba128e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:17.255346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931543f-5fa8-4474-8fa7-4f1846ba128e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:17.255630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931543f-5fa8-4474-8fa7-4f1846ba128e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:17.255907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931543f-5fa8-4474-8fa7-4f1846ba128e None admin] PATH_INFO: `/v3/projects/41318efb050a4640b7056fc0531144b0` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:17.257097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931543f-5fa8-4474-8fa7-4f1846ba128e None admin] RBAC: Authorizing `identity:get_project(project_id=41318efb050a4640b7056fc0531144b0)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:17.258552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931543f-5fa8-4474-8fa7-4f1846ba128e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:17.260349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 89/189] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:17 2022] GET /identity/v3/projects/41318efb050a4640b7056fc0531144b0 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:17.261573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0cf50-be03-4a35-ad07-168ac9032bb6 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:17.261864 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0cf50-be03-4a35-ad07-168ac9032bb6 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:17.262137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0cf50-be03-4a35-ad07-168ac9032bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:17.278535 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-4ac0cf50-be03-4a35-ad07-168ac9032bb6 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:17.279866 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4ac0cf50-be03-4a35-ad07-168ac9032bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:17.283869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ce674-2cd4-4d59-a972-0f32c336692e None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:17.285386 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:17.319965 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72011883-db14-4063-b3c6-a183c612f6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:17.321127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72011883-db14-4063-b3c6-a183c612f6a5 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:17.321708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72011883-db14-4063-b3c6-a183c612f6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:17.321992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72011883-db14-4063-b3c6-a183c612f6a5 None admin] PATH_INFO: `/v3/users/5490de7e03e241feaf35fc9b2fb919fe` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:17.335168 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72011883-db14-4063-b3c6-a183c612f6a5 None admin] RBAC: Authorizing `identity:get_user(user_id=5490de7e03e241feaf35fc9b2fb919fe)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:17.336656 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72011883-db14-4063-b3c6-a183c612f6a5 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:17.338396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 101/190] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:17 2022] GET /identity/v3/users/5490de7e03e241feaf35fc9b2fb919fe => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:17.342969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72011883-db14-4063-b3c6-a183c612f6a5 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:17.347427 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 90/191] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:17.351861 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0cf50-be03-4a35-ad07-168ac9032bb6 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:17.419752 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:17.447406 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72011883-db14-4063-b3c6-a183c612f6a5 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:17.453422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0cf50-be03-4a35-ad07-168ac9032bb6 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:17.480603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb2e0d-b940-4345-bc3b-7468dc08b6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:17.481278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb2e0d-b940-4345-bc3b-7468dc08b6e6 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:17.481557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb2e0d-b940-4345-bc3b-7468dc08b6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:17.481827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb2e0d-b940-4345-bc3b-7468dc08b6e6 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:17.482534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb2e0d-b940-4345-bc3b-7468dc08b6e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:17.484042 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb2e0d-b940-4345-bc3b-7468dc08b6e6 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:17.486690 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df355b2e-7398-435d-8077-9201a073a94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:17.487538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df355b2e-7398-435d-8077-9201a073a94b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:17.487818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df355b2e-7398-435d-8077-9201a073a94b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:17.488092 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df355b2e-7398-435d-8077-9201a073a94b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:17.498957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df355b2e-7398-435d-8077-9201a073a94b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:17.503660 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 102/192] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:35:17 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:35:17.504476 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb2e0d-b940-4345-bc3b-7468dc08b6e6 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-df355b2e-7398-435d-8077-9201a073a94b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:17.507207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:17.508167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:17.508972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:17.508972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:17.508972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:17.508972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:17.508972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:17.508972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:17.508972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:17.508972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:17.508972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:17.508972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:17.508972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:17.508972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:17.508972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 91/193] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:35:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:17.509614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df355b2e-7398-435d-8077-9201a073a94b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:17.534177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:17.631019 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df355b2e-7398-435d-8077-9201a073a94b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:17.639179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb2e0d-b940-4345-bc3b-7468dc08b6e6 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:17.660253 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:17.669846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7f13d-152c-40f9-99cf-2d572c07bd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:17.671015 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7f13d-152c-40f9-99cf-2d572c07bd0f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:17.671015 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7f13d-152c-40f9-99cf-2d572c07bd0f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:17.671194 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7f13d-152c-40f9-99cf-2d572c07bd0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:17.678448 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bb16f-9cd7-463f-be33-c57b456b201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:17.679195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bb16f-9cd7-463f-be33-c57b456b201c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:17.679643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bb16f-9cd7-463f-be33-c57b456b201c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:17.679744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bb16f-9cd7-463f-be33-c57b456b201c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:17.680945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bb16f-9cd7-463f-be33-c57b456b201c None admin] RBAC: Adding query filter params (role.id=59a0f03d08fd401ebbd29ebd5f174abb, scope.project.id=41318efb050a4640b7056fc0531144b0, user.id=010c431b36384d8087a2e654e92b481d) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:17.681259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bb16f-9cd7-463f-be33-c57b456b201c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:17.683232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bb16f-9cd7-463f-be33-c57b456b201c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:17.689637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 103/194] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:17 2022] GET /identity/v3/role_assignments?user.id=010c431b36384d8087a2e654e92b481d&scope.project.id=41318efb050a4640b7056fc0531144b0&role.id=59a0f03d08fd401ebbd29ebd5f174abb => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:17.690445 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bb16f-9cd7-463f-be33-c57b456b201c None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:17.766456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7f13d-152c-40f9-99cf-2d572c07bd0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:17.768149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7f13d-152c-40f9-99cf-2d572c07bd0f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:17.797894 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:17.827289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bb16f-9cd7-463f-be33-c57b456b201c None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:17.873629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138d064-ec8c-4d9c-bd01-6f3c43ae4bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:17.874450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138d064-ec8c-4d9c-bd01-6f3c43ae4bc3 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:17.874734 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138d064-ec8c-4d9c-bd01-6f3c43ae4bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:17.875046 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138d064-ec8c-4d9c-bd01-6f3c43ae4bc3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:17.895652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138d064-ec8c-4d9c-bd01-6f3c43ae4bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:17.901582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 92/195] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:17.902693 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7f13d-152c-40f9-99cf-2d572c07bd0f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-8138d064-ec8c-4d9c-bd01-6f3c43ae4bc3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:17.904568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:17.905425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:17.906221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:17.906221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:17.906221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:17.906221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:17.906221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:17.906221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:17.906221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:17.906221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:17.906221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:17.906221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:17.906221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:17.906221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:17.906221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 104/196] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:17.912798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138d064-ec8c-4d9c-bd01-6f3c43ae4bc3 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:17.938702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:18.023281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7f13d-152c-40f9-99cf-2d572c07bd0f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:18.029182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138d064-ec8c-4d9c-bd01-6f3c43ae4bc3 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:18.067947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ee695-332a-4114-8bc1-0b6144ad1d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:18.068607 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ee695-332a-4114-8bc1-0b6144ad1d48 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:18.068895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ee695-332a-4114-8bc1-0b6144ad1d48 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:18.069223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ee695-332a-4114-8bc1-0b6144ad1d48 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:18.069936 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ee695-332a-4114-8bc1-0b6144ad1d48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:18.070247 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ee695-332a-4114-8bc1-0b6144ad1d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:18.071783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ee695-332a-4114-8bc1-0b6144ad1d48 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:18.072045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f0a57-31a9-4a8a-af08-5392361b55d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:18.073052 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f0a57-31a9-4a8a-af08-5392361b55d0 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:18.073591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f0a57-31a9-4a8a-af08-5392361b55d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:18.073866 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f0a57-31a9-4a8a-af08-5392361b55d0 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:18.076189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f0a57-31a9-4a8a-af08-5392361b55d0 None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:18.078262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f0a57-31a9-4a8a-af08-5392361b55d0 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:18.080607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 105/197] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:17 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:18.081393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f0a57-31a9-4a8a-af08-5392361b55d0 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:18.084682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 93/198] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:35:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:18.087769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ee695-332a-4114-8bc1-0b6144ad1d48 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:18.098957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:18.206533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f0a57-31a9-4a8a-af08-5392361b55d0 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:18.208022 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:18.220984 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ee695-332a-4114-8bc1-0b6144ad1d48 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:18.246063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc0f23-fc68-4cd9-8a69-5cf0e27516ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:18.247144 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc0f23-fc68-4cd9-8a69-5cf0e27516ac None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:18.247637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc0f23-fc68-4cd9-8a69-5cf0e27516ac None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:18.248015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc0f23-fc68-4cd9-8a69-5cf0e27516ac None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:18.248921 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc0f23-fc68-4cd9-8a69-5cf0e27516ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:18.249293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc0f23-fc68-4cd9-8a69-5cf0e27516ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:18.250795 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc0f23-fc68-4cd9-8a69-5cf0e27516ac None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:18.259750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 106/199] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:18.260787 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc0f23-fc68-4cd9-8a69-5cf0e27516ac None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:18.265795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d226a-152b-423a-9338-b5c4941f0b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:18.266949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d226a-152b-423a-9338-b5c4941f0b5a None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:18.267405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d226a-152b-423a-9338-b5c4941f0b5a None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:18.267851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d226a-152b-423a-9338-b5c4941f0b5a None admin] PATH_INFO: `/v3/users/5490de7e03e241feaf35fc9b2fb919fe` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:18.269289 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d226a-152b-423a-9338-b5c4941f0b5a None admin] RBAC: Authorizing `identity:get_user(user_id=5490de7e03e241feaf35fc9b2fb919fe)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:18.271488 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d226a-152b-423a-9338-b5c4941f0b5a None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:18.278593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 94/200] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:18 2022] GET /identity/v3/users/5490de7e03e241feaf35fc9b2fb919fe => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:18.278593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d226a-152b-423a-9338-b5c4941f0b5a None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:18.356201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:18.388825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d226a-152b-423a-9338-b5c4941f0b5a None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:18.393001 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc0f23-fc68-4cd9-8a69-5cf0e27516ac None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:18.423709 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d518b-7f06-4d0f-8088-27aa1b180557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:18.424601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d518b-7f06-4d0f-8088-27aa1b180557 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:18.424884 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d518b-7f06-4d0f-8088-27aa1b180557 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:18.425161 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d518b-7f06-4d0f-8088-27aa1b180557 None admin] PATH_INFO: `/v3/users/8b2d48d8e422457db7aebb21afd2bf43` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:18.426378 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d518b-7f06-4d0f-8088-27aa1b180557 None admin] RBAC: Authorizing `identity:get_user(user_id=8b2d48d8e422457db7aebb21afd2bf43)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:18.427867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d518b-7f06-4d0f-8088-27aa1b180557 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:18.434211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 95/201] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:18 2022] GET /identity/v3/users/8b2d48d8e422457db7aebb21afd2bf43 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:18.434211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d518b-7f06-4d0f-8088-27aa1b180557 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:18.436672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea405931-2b11-4651-b868-bc25d6740d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:18.437723 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea405931-2b11-4651-b868-bc25d6740d53 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:18.438206 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea405931-2b11-4651-b868-bc25d6740d53 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:18.438682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea405931-2b11-4651-b868-bc25d6740d53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:18.439876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea405931-2b11-4651-b868-bc25d6740d53 None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=398973d672844da38a2cfaf6f5093a9e, user.id=5490de7e03e241feaf35fc9b2fb919fe) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:18.440405 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea405931-2b11-4651-b868-bc25d6740d53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:18.442240 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea405931-2b11-4651-b868-bc25d6740d53 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:18.449594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 107/202] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:18 2022] GET /identity/v3/role_assignments?user.id=5490de7e03e241feaf35fc9b2fb919fe&scope.project.id=398973d672844da38a2cfaf6f5093a9e&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:18.451192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea405931-2b11-4651-b868-bc25d6740d53 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:18.463583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:18.603710 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d518b-7f06-4d0f-8088-27aa1b180557 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:18.640018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7ac3e-f9ff-4419-be10-41455fa76989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:18.640717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ac3e-f9ff-4419-be10-41455fa76989 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:18.640998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ac3e-f9ff-4419-be10-41455fa76989 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:18.641275 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ac3e-f9ff-4419-be10-41455fa76989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:18.653909 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea405931-2b11-4651-b868-bc25d6740d53 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:18.725317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595539ad-53ce-43c0-b342-94ed01416a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:18.725901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595539ad-53ce-43c0-b342-94ed01416a30 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:18.726530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595539ad-53ce-43c0-b342-94ed01416a30 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:18.726821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595539ad-53ce-43c0-b342-94ed01416a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:18.734287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7ac3e-f9ff-4419-be10-41455fa76989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:18.735998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7ac3e-f9ff-4419-be10-41455fa76989 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:18.737222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:18.763768 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:18.837324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 96/203] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:18.848467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7ac3e-f9ff-4419-be10-41455fa76989 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:18.880374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595539ad-53ce-43c0-b342-94ed01416a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:18.881974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595539ad-53ce-43c0-b342-94ed01416a30 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:18.971735 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7ac3e-f9ff-4419-be10-41455fa76989 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:18.999261 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:19.007970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5437adc-232e-4358-9a76-09250a57732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:19.009147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5437adc-232e-4358-9a76-09250a57732b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:19.009922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5437adc-232e-4358-9a76-09250a57732b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:19.010374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5437adc-232e-4358-9a76-09250a57732b None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:19.014806 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5437adc-232e-4358-9a76-09250a57732b None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:19.014806 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5437adc-232e-4358-9a76-09250a57732b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:19.015728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 97/204] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:18 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:19.022844 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5437adc-232e-4358-9a76-09250a57732b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:19.105846 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 108/205] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:19.111442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595539ad-53ce-43c0-b342-94ed01416a30 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:19.166514 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5437adc-232e-4358-9a76-09250a57732b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:19.173442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:19.237176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63b369-567b-4fa2-8c3d-3a8fd1acd4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:19.237868 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63b369-567b-4fa2-8c3d-3a8fd1acd4b2 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:19.238118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63b369-567b-4fa2-8c3d-3a8fd1acd4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:19.238391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63b369-567b-4fa2-8c3d-3a8fd1acd4b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:19.239266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63b369-567b-4fa2-8c3d-3a8fd1acd4b2 None admin] RBAC: Adding query filter params (role.id=4af08bea19b94c2c863a51b103f50b8b, scope.project.id=398973d672844da38a2cfaf6f5093a9e, user.id=5490de7e03e241feaf35fc9b2fb919fe) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:19.239577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63b369-567b-4fa2-8c3d-3a8fd1acd4b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:19.241051 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63b369-567b-4fa2-8c3d-3a8fd1acd4b2 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:19.247800 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 98/206] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:19 2022] GET /identity/v3/role_assignments?user.id=5490de7e03e241feaf35fc9b2fb919fe&scope.project.id=398973d672844da38a2cfaf6f5093a9e&role.id=4af08bea19b94c2c863a51b103f50b8b => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:19.315385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595539ad-53ce-43c0-b342-94ed01416a30 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:19.371722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816d2af-9e30-4d07-977e-c90b13429206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:19.372637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816d2af-9e30-4d07-977e-c90b13429206 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:19.372924 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816d2af-9e30-4d07-977e-c90b13429206 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:19.373205 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816d2af-9e30-4d07-977e-c90b13429206 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:19.374574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816d2af-9e30-4d07-977e-c90b13429206 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:19.376098 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816d2af-9e30-4d07-977e-c90b13429206 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:19.378139 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 109/207] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:19 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:19.384156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63b369-567b-4fa2-8c3d-3a8fd1acd4b2 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:19.487172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:19.528778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63b369-567b-4fa2-8c3d-3a8fd1acd4b2 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:19.570020 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eff6f-1212-4132-88d0-8d0bec837d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:19.570607 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eff6f-1212-4132-88d0-8d0bec837d17 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:19.570919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eff6f-1212-4132-88d0-8d0bec837d17 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:19.571193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eff6f-1212-4132-88d0-8d0bec837d17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:19.572047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1eff6f-1212-4132-88d0-8d0bec837d17 None admin] RBAC: Adding query filter params (role.id=fd5b8ebb128748d5b34cc4fa37a3d1e8, scope.project.id=113460ea611c4df1b58899d547c12317, user.id=8b2d48d8e422457db7aebb21afd2bf43) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:19.572541 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1eff6f-1212-4132-88d0-8d0bec837d17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:19.574058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1eff6f-1212-4132-88d0-8d0bec837d17 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:19.580762 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 99/208] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:19 2022] GET /identity/v3/role_assignments?user.id=8b2d48d8e422457db7aebb21afd2bf43&scope.project.id=113460ea611c4df1b58899d547c12317&role.id=fd5b8ebb128748d5b34cc4fa37a3d1e8 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:19.956683 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbfc63-dab3-4425-83d3-d40798632cc1 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:19.957026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbfc63-dab3-4425-83d3-d40798632cc1 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:19.957268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbfc63-dab3-4425-83d3-d40798632cc1 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:19.958891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 110/209] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:19.964005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996c084-4ab6-4161-a5db-6ccc0734127e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:19.964292 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996c084-4ab6-4161-a5db-6ccc0734127e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:19.964567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996c084-4ab6-4161-a5db-6ccc0734127e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:19.985224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-2996c084-4ab6-4161-a5db-6ccc0734127e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:19.986434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2996c084-4ab6-4161-a5db-6ccc0734127e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:20.062173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 100/210] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:20.086285 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbfc63-dab3-4425-83d3-d40798632cc1 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:20.205942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ebc61-f184-4e1c-8c0a-90e8b9f6a935 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:20.206142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ebc61-f184-4e1c-8c0a-90e8b9f6a935 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:20.206415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ebc61-f184-4e1c-8c0a-90e8b9f6a935 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:20.208280 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 101/211] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:20.214100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5f5c-d9b1-49eb-8683-b4e939fe04b8 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:20.214665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5f5c-d9b1-49eb-8683-b4e939fe04b8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:20.215005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5f5c-d9b1-49eb-8683-b4e939fe04b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:20.223440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbfc63-dab3-4425-83d3-d40798632cc1 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:20.225590 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:20.232392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e96a5f5c-d9b1-49eb-8683-b4e939fe04b8 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:20.233664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e96a5f5c-d9b1-49eb-8683-b4e939fe04b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:20.272456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d328b1-bd14-4da2-aa35-a8798a8781ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:20.273576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d328b1-bd14-4da2-aa35-a8798a8781ce None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:20.274027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d328b1-bd14-4da2-aa35-a8798a8781ce None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:20.274467 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d328b1-bd14-4da2-aa35-a8798a8781ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:20.285404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:20.287989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d328b1-bd14-4da2-aa35-a8798a8781ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-02d328b1-bd14-4da2-aa35-a8798a8781ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:20.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:20.300063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:20.300850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:20.300850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:20.300850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:20.300850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:20.300850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:20.300850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:20.300850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:20.300850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:20.300850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:20.300850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:20.300850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:20.300850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:20.303800 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 111/212] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:20.310307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d328b1-bd14-4da2-aa35-a8798a8781ce None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:20.315285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 102/213] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:20.341030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5f5c-d9b1-49eb-8683-b4e939fe04b8 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:20.419643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d328b1-bd14-4da2-aa35-a8798a8781ce None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:20.445848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5f5c-d9b1-49eb-8683-b4e939fe04b8 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:20.459986 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dca860-7a9d-4a09-ab5f-1dcd95d00932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:20.460597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dca860-7a9d-4a09-ab5f-1dcd95d00932 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:20.460878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dca860-7a9d-4a09-ab5f-1dcd95d00932 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:20.461304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dca860-7a9d-4a09-ab5f-1dcd95d00932 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:20.462425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dca860-7a9d-4a09-ab5f-1dcd95d00932 None admin] RBAC: Adding query filter params (name=member) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:20.462790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dca860-7a9d-4a09-ab5f-1dcd95d00932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:20.464548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dca860-7a9d-4a09-ab5f-1dcd95d00932 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:20.475971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 112/214] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:20.482057 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dca860-7a9d-4a09-ab5f-1dcd95d00932 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:20.496977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a7d93-75ee-4607-ae7f-f1b688e98ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:20.498128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a7d93-75ee-4607-ae7f-f1b688e98ee4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:20.498623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a7d93-75ee-4607-ae7f-f1b688e98ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:20.499138 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a7d93-75ee-4607-ae7f-f1b688e98ee4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:20.500694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a7d93-75ee-4607-ae7f-f1b688e98ee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:20.502402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a7d93-75ee-4607-ae7f-f1b688e98ee4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:20.504865 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 103/215] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:20.514790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:20.515958 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a7d93-75ee-4607-ae7f-f1b688e98ee4 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:20.576999 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:20.599352 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dca860-7a9d-4a09-ab5f-1dcd95d00932 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:20.640947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a7d93-75ee-4607-ae7f-f1b688e98ee4 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:20.645888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145ccef-402c-40ff-8cac-b8d7b05e0a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:20.646801 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145ccef-402c-40ff-8cac-b8d7b05e0a8f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:20.647085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145ccef-402c-40ff-8cac-b8d7b05e0a8f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:20.647357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145ccef-402c-40ff-8cac-b8d7b05e0a8f None admin] PATH_INFO: `/v3/users/996017a97e97402ab902bc03ccaf1814` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:20.665704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145ccef-402c-40ff-8cac-b8d7b05e0a8f None admin] RBAC: Authorizing `identity:get_user(user_id=996017a97e97402ab902bc03ccaf1814)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:20.668348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145ccef-402c-40ff-8cac-b8d7b05e0a8f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:20.671298 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 113/216] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:20 2022] GET /identity/v3/users/996017a97e97402ab902bc03ccaf1814 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:20.676500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145ccef-402c-40ff-8cac-b8d7b05e0a8f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:20.678459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e284ad0-f451-4188-9562-bd6581e2a73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:20.679180 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e284ad0-f451-4188-9562-bd6581e2a73b None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:20.679464 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e284ad0-f451-4188-9562-bd6581e2a73b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:20.679741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e284ad0-f451-4188-9562-bd6581e2a73b None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:20.680513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e284ad0-f451-4188-9562-bd6581e2a73b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:20.682252 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e284ad0-f451-4188-9562-bd6581e2a73b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:20.712263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 104/217] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:35:20 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:35:20.773949 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:20.795941 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145ccef-402c-40ff-8cac-b8d7b05e0a8f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:20.797166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bb096-7143-4f9c-aeed-279d0656863c None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:20.797465 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bb096-7143-4f9c-aeed-279d0656863c None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:20.797748 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bb096-7143-4f9c-aeed-279d0656863c None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:20.799392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 105/218] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:35:20.810680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2ce1f-b059-4b82-a4f6-8a0b2ad4c32a None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:20.811042 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2ce1f-b059-4b82-a4f6-8a0b2ad4c32a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:20.811321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2ce1f-b059-4b82-a4f6-8a0b2ad4c32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:20.833618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-c8f2ce1f-b059-4b82-a4f6-8a0b2ad4c32a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:20.835313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c8f2ce1f-b059-4b82-a4f6-8a0b2ad4c32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:20.835947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad0574-eed8-440a-b73e-a3c5ae6ed0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:20.836631 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad0574-eed8-440a-b73e-a3c5ae6ed0ad None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:20.836909 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad0574-eed8-440a-b73e-a3c5ae6ed0ad None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:20.837183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad0574-eed8-440a-b73e-a3c5ae6ed0ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:20.925573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 106/219] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:20.938218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad0574-eed8-440a-b73e-a3c5ae6ed0ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:20.939756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad0574-eed8-440a-b73e-a3c5ae6ed0ad None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:20.948139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2ce1f-b059-4b82-a4f6-8a0b2ad4c32a None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:20.989774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:21.042221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:21.063231 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 114/220] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:21.069979 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad0574-eed8-440a-b73e-a3c5ae6ed0ad None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:21.078595 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2ce1f-b059-4b82-a4f6-8a0b2ad4c32a None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:21.126795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40503841-0592-4258-a1e3-a5be88146ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:21.128223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40503841-0592-4258-a1e3-a5be88146ec0 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:21.128509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40503841-0592-4258-a1e3-a5be88146ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:21.128864 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40503841-0592-4258-a1e3-a5be88146ec0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:21.140789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40503841-0592-4258-a1e3-a5be88146ec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-40503841-0592-4258-a1e3-a5be88146ec0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:21.149294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:21.150639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:21.151468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:21.151468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:21.151468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:21.151468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:21.151468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:21.151468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:21.151468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:21.151468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:21.151468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:21.151468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:21.151468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:21.151468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:21.151468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 107/221] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:35:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:35:21.160601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40503841-0592-4258-a1e3-a5be88146ec0 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:21.209943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad0574-eed8-440a-b73e-a3c5ae6ed0ad None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:21.247802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291ad27-cd2c-4a36-9cf8-589917cb7aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:21.249442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291ad27-cd2c-4a36-9cf8-589917cb7aeb None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:21.249910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291ad27-cd2c-4a36-9cf8-589917cb7aeb None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:21.250382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291ad27-cd2c-4a36-9cf8-589917cb7aeb None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:21.251818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291ad27-cd2c-4a36-9cf8-589917cb7aeb None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:21.253475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291ad27-cd2c-4a36-9cf8-589917cb7aeb None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:21.255719 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 115/222] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:21 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:21.262105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291ad27-cd2c-4a36-9cf8-589917cb7aeb None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:21.278350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40503841-0592-4258-a1e3-a5be88146ec0 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:21.283118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:21.315307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:21.318698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f855bdf-831e-4955-928b-bed6ee231d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:21.319439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f855bdf-831e-4955-928b-bed6ee231d52 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:21.319699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f855bdf-831e-4955-928b-bed6ee231d52 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:21.319985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f855bdf-831e-4955-928b-bed6ee231d52 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:21.321124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f855bdf-831e-4955-928b-bed6ee231d52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:21.321124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f855bdf-831e-4955-928b-bed6ee231d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:21.322551 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f855bdf-831e-4955-928b-bed6ee231d52 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:21.333212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 108/223] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:21.353515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f855bdf-831e-4955-928b-bed6ee231d52 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:21.376320 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291ad27-cd2c-4a36-9cf8-589917cb7aeb None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:21.423111 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6bc74-e04a-4449-880d-40ae70b6ff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:21.424024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6bc74-e04a-4449-880d-40ae70b6ff11 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:21.425009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6bc74-e04a-4449-880d-40ae70b6ff11 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:21.425443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6bc74-e04a-4449-880d-40ae70b6ff11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:21.428471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6bc74-e04a-4449-880d-40ae70b6ff11 None admin] RBAC: Adding query filter params (role.id=59a0f03d08fd401ebbd29ebd5f174abb, scope.project.id=398973d672844da38a2cfaf6f5093a9e, user.id=996017a97e97402ab902bc03ccaf1814) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:21.428926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6bc74-e04a-4449-880d-40ae70b6ff11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:21.430520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6bc74-e04a-4449-880d-40ae70b6ff11 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:21.441819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 116/224] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:21 2022] GET /identity/v3/role_assignments?user.id=996017a97e97402ab902bc03ccaf1814&scope.project.id=398973d672844da38a2cfaf6f5093a9e&role.id=59a0f03d08fd401ebbd29ebd5f174abb => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:21.524177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f855bdf-831e-4955-928b-bed6ee231d52 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:21.573172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab7529-695c-411c-aa84-826213bc7d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:21.574315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab7529-695c-411c-aa84-826213bc7d28 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:21.574730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab7529-695c-411c-aa84-826213bc7d28 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:21.575147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab7529-695c-411c-aa84-826213bc7d28 None admin] PATH_INFO: `/v3/users/5490de7e03e241feaf35fc9b2fb919fe` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:21.576600 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab7529-695c-411c-aa84-826213bc7d28 None admin] RBAC: Authorizing `identity:get_user(user_id=5490de7e03e241feaf35fc9b2fb919fe)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:21.578190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab7529-695c-411c-aa84-826213bc7d28 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:21.580343 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 109/225] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:21 2022] GET /identity/v3/users/5490de7e03e241feaf35fc9b2fb919fe => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:21.586198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6bc74-e04a-4449-880d-40ae70b6ff11 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:21.642546 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcee34-dd79-4e06-9068-98531bf0e31c None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:21.643109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcee34-dd79-4e06-9068-98531bf0e31c None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:21.644028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcee34-dd79-4e06-9068-98531bf0e31c None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:21.646325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 110/226] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:35:21.651566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc6bf0-15a6-458d-90cc-70726a84a1fd None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:21.651829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc6bf0-15a6-458d-90cc-70726a84a1fd None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:21.652120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc6bf0-15a6-458d-90cc-70726a84a1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:21.674641 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6dbc6bf0-15a6-458d-90cc-70726a84a1fd None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:21.675957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6dbc6bf0-15a6-458d-90cc-70726a84a1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:21.698668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:21.700927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6bc74-e04a-4449-880d-40ae70b6ff11 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:21.717385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:21.739676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25390337-916a-4b03-a160-2e87d0b11116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:21.740679 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25390337-916a-4b03-a160-2e87d0b11116 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:21.741029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25390337-916a-4b03-a160-2e87d0b11116 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:21.741370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25390337-916a-4b03-a160-2e87d0b11116 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:21.742792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25390337-916a-4b03-a160-2e87d0b11116 None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:21.744436 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25390337-916a-4b03-a160-2e87d0b11116 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:21.746512 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 117/227] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:21 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:21.752080 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25390337-916a-4b03-a160-2e87d0b11116 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:21.754967 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 111/228] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:21.791866 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc6bf0-15a6-458d-90cc-70726a84a1fd None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:21.856267 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25390337-916a-4b03-a160-2e87d0b11116 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:21.892346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dc566-e2ed-4822-a6e3-81b28e7e3c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:21.893378 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc566-e2ed-4822-a6e3-81b28e7e3c6f None admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:21.893792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc566-e2ed-4822-a6e3-81b28e7e3c6f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:21.894133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc566-e2ed-4822-a6e3-81b28e7e3c6f None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e/users/5490de7e03e241feaf35fc9b2fb919fe/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:21.896290 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675dc566-e2ed-4822-a6e3-81b28e7e3c6f None admin] RBAC: Authorizing `identity:create_grant(project_id=398973d672844da38a2cfaf6f5093a9e, user_id=5490de7e03e241feaf35fc9b2fb919fe, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:21.897849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675dc566-e2ed-4822-a6e3-81b28e7e3c6f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:21.925253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 118/229] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:35:21 2022] PUT /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e/users/5490de7e03e241feaf35fc9b2fb919fe/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:35:21.942120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc6bf0-15a6-458d-90cc-70726a84a1fd None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:21.986124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03a194-9cbd-4621-a823-e1048f8218c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:21.986987 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a194-9cbd-4621-a823-e1048f8218c5 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:21.987274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a194-9cbd-4621-a823-e1048f8218c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:21.987551 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a194-9cbd-4621-a823-e1048f8218c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:22.004878 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03a194-9cbd-4621-a823-e1048f8218c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-2b03a194-9cbd-4621-a823-e1048f8218c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:22.013801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:22.014680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:22.015515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:22.015515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:22.015515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:22.015515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:22.015515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:22.015515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:22.015515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:22.015515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:22.015515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:22.015515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:22.015515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:22.015515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:22.019630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 112/230] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:35:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:35:22.025556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dc566-e2ed-4822-a6e3-81b28e7e3c6f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:22.095886 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:22.159282 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dc566-e2ed-4822-a6e3-81b28e7e3c6f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:22.194636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f49ce-1fca-4072-94f9-4e24a26095a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:22.195353 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f49ce-1fca-4072-94f9-4e24a26095a8 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:22.195673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f49ce-1fca-4072-94f9-4e24a26095a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:22.195953 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f49ce-1fca-4072-94f9-4e24a26095a8 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:22.196709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f49ce-1fca-4072-94f9-4e24a26095a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:22.197056 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f49ce-1fca-4072-94f9-4e24a26095a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:22.198562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f49ce-1fca-4072-94f9-4e24a26095a8 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:22.207236 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 119/231] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:35:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:22.212766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03a194-9cbd-4621-a823-e1048f8218c5 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:22.234785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:22.334163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03a194-9cbd-4621-a823-e1048f8218c5 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:22.378339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381988fb-1bb8-433d-a848-64b53ed3301f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:22.379179 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381988fb-1bb8-433d-a848-64b53ed3301f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:22.379465 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381988fb-1bb8-433d-a848-64b53ed3301f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:22.379742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381988fb-1bb8-433d-a848-64b53ed3301f None admin] PATH_INFO: `/v3/users/5490de7e03e241feaf35fc9b2fb919fe` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:22.380996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381988fb-1bb8-433d-a848-64b53ed3301f None admin] RBAC: Authorizing `identity:get_user(user_id=5490de7e03e241feaf35fc9b2fb919fe)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:22.382527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381988fb-1bb8-433d-a848-64b53ed3301f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:22.384215 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 113/232] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:22 2022] GET /identity/v3/users/5490de7e03e241feaf35fc9b2fb919fe => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:22.390043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f49ce-1fca-4072-94f9-4e24a26095a8 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:22.496769 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f49ce-1fca-4072-94f9-4e24a26095a8 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:22.499235 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:22.531095 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d1672-3cfd-4624-9098-70f4f8ca18ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:22.531976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1672-3cfd-4624-9098-70f4f8ca18ac None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:22.532254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1672-3cfd-4624-9098-70f4f8ca18ac None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:22.532538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1672-3cfd-4624-9098-70f4f8ca18ac None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:22.533726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d1672-3cfd-4624-9098-70f4f8ca18ac None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:22.535221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d1672-3cfd-4624-9098-70f4f8ca18ac None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:22.537247 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 120/233] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:22 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:22.544071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381988fb-1bb8-433d-a848-64b53ed3301f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:22.670168 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:22.690812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381988fb-1bb8-433d-a848-64b53ed3301f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:22.738056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efad930-73ea-4706-a36c-b5d950a7f86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:22.738985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efad930-73ea-4706-a36c-b5d950a7f86f None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:22.739272 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efad930-73ea-4706-a36c-b5d950a7f86f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:22.739546 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efad930-73ea-4706-a36c-b5d950a7f86f None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e/users/5490de7e03e241feaf35fc9b2fb919fe/roles/4af08bea19b94c2c863a51b103f50b8b` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:22.741737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efad930-73ea-4706-a36c-b5d950a7f86f None admin] RBAC: Authorizing `identity:create_grant(project_id=398973d672844da38a2cfaf6f5093a9e, user_id=5490de7e03e241feaf35fc9b2fb919fe, role_id=4af08bea19b94c2c863a51b103f50b8b)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:22.743236 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efad930-73ea-4706-a36c-b5d950a7f86f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:22.772874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 114/234] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:35:22 2022] PUT /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e/users/5490de7e03e241feaf35fc9b2fb919fe/roles/4af08bea19b94c2c863a51b103f50b8b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:35:23.298228 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c69f41-0f06-4420-8900-42a5802ab3cf None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:23.298635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c69f41-0f06-4420-8900-42a5802ab3cf None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:23.298821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c69f41-0f06-4420-8900-42a5802ab3cf None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:23.300432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 121/235] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:23.305476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0103a3-07c2-4cc5-a578-20db74ad277e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:23.305937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0103a3-07c2-4cc5-a578-20db74ad277e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:23.306429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0103a3-07c2-4cc5-a578-20db74ad277e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:23.332005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-4f0103a3-07c2-4cc5-a578-20db74ad277e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:23.333430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4f0103a3-07c2-4cc5-a578-20db74ad277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:23.422573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 115/236] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:23.473623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c69f41-0f06-4420-8900-42a5802ab3cf None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:23.609326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c69f41-0f06-4420-8900-42a5802ab3cf None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:23.643776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc69ef6-9568-4eaa-b47d-a673bd6ab859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:23.644937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc69ef6-9568-4eaa-b47d-a673bd6ab859 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:23.645436 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc69ef6-9568-4eaa-b47d-a673bd6ab859 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:23.645900 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc69ef6-9568-4eaa-b47d-a673bd6ab859 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:23.656942 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc69ef6-9568-4eaa-b47d-a673bd6ab859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-dbc69ef6-9568-4eaa-b47d-a673bd6ab859 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:23.665177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:23.666121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:23.666939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:23.666939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:23.666939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:23.666939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:23.666939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:23.666939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:23.666939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:23.666939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:23.666939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:23.666939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:23.666939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:23.666939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:23.669670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 122/237] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:23.675647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0103a3-07c2-4cc5-a578-20db74ad277e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:23.767767 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:23.801530 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0103a3-07c2-4cc5-a578-20db74ad277e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:23.853753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03442e-3a42-4fc0-8870-59faffae198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:23.854554 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03442e-3a42-4fc0-8870-59faffae198d None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:23.854862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03442e-3a42-4fc0-8870-59faffae198d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:23.855142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03442e-3a42-4fc0-8870-59faffae198d None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:23.855916 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03442e-3a42-4fc0-8870-59faffae198d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:23.856223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03442e-3a42-4fc0-8870-59faffae198d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:23.857625 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03442e-3a42-4fc0-8870-59faffae198d None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:23.867198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 116/238] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:23.873040 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc69ef6-9568-4eaa-b47d-a673bd6ab859 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:23.910706 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:23.935794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1d5f6-fe3e-4550-9386-14d912883de0 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:23.936126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1d5f6-fe3e-4550-9386-14d912883de0 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:23.936346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1d5f6-fe3e-4550-9386-14d912883de0 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:23.937736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 117/239] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:35:23.942989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff93915-1d75-45a4-ad97-88b9b3cb5056 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:23.943282 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff93915-1d75-45a4-ad97-88b9b3cb5056 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:23.943552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff93915-1d75-45a4-ad97-88b9b3cb5056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:23.978971 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-7ff93915-1d75-45a4-ad97-88b9b3cb5056 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:23.980408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-7ff93915-1d75-45a4-ad97-88b9b3cb5056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:23.985001 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc69ef6-9568-4eaa-b47d-a673bd6ab859 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:24.026683 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d094e1-c629-42b8-af03-8ef1d34d24fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:24.028326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d094e1-c629-42b8-af03-8ef1d34d24fd None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:24.029087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d094e1-c629-42b8-af03-8ef1d34d24fd None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:24.029831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d094e1-c629-42b8-af03-8ef1d34d24fd None admin] PATH_INFO: `/v3/users/7a926807f5ab478d8c1d1fa032e02d7b` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:24.047863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d094e1-c629-42b8-af03-8ef1d34d24fd None admin] RBAC: Authorizing `identity:get_user(user_id=7a926807f5ab478d8c1d1fa032e02d7b)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:24.050043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d094e1-c629-42b8-af03-8ef1d34d24fd None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:24.052072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 118/240] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:24.052396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 123/241] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:23 2022] GET /identity/v3/users/7a926807f5ab478d8c1d1fa032e02d7b => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:24.053865 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3263c4-be46-4078-bbc0-e40c877c8ce2 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:24.054279 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3263c4-be46-4078-bbc0-e40c877c8ce2 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:24.054672 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3263c4-be46-4078-bbc0-e40c877c8ce2 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:24.056090 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 119/242] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:24.061038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d094e1-c629-42b8-af03-8ef1d34d24fd None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:24.062544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2faacc-bea6-4e7e-8a64-0926cce0b2af None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:24.063070 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2faacc-bea6-4e7e-8a64-0926cce0b2af None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:24.063532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2faacc-bea6-4e7e-8a64-0926cce0b2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:24.080120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-2c2faacc-bea6-4e7e-8a64-0926cce0b2af None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:24.081585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2c2faacc-bea6-4e7e-8a64-0926cce0b2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:24.147895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:24.160509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 120/243] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:24.170785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2faacc-bea6-4e7e-8a64-0926cce0b2af None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:24.170923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:24.178851 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d094e1-c629-42b8-af03-8ef1d34d24fd None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:24.216721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba6c10-1844-4b42-bd8d-391f3d1a70a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:24.217495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba6c10-1844-4b42-bd8d-391f3d1a70a3 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:24.217921 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba6c10-1844-4b42-bd8d-391f3d1a70a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:24.218159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba6c10-1844-4b42-bd8d-391f3d1a70a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:24.288271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba6c10-1844-4b42-bd8d-391f3d1a70a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:24.289900 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba6c10-1844-4b42-bd8d-391f3d1a70a3 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:24.290501 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2faacc-bea6-4e7e-8a64-0926cce0b2af None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:24.329219 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd00c9b-a334-4cae-85e2-9a73863fd6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:24.330379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd00c9b-a334-4cae-85e2-9a73863fd6a2 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:24.330906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd00c9b-a334-4cae-85e2-9a73863fd6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:24.331349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd00c9b-a334-4cae-85e2-9a73863fd6a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:24.332783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd00c9b-a334-4cae-85e2-9a73863fd6a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:24.334509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd00c9b-a334-4cae-85e2-9a73863fd6a2 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:24.336689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 121/244] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:24.337755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd00c9b-a334-4cae-85e2-9a73863fd6a2 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:24.389944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:24.402590 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 124/245] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:24.403208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba6c10-1844-4b42-bd8d-391f3d1a70a3 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:24.404332 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:24.446216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd00c9b-a334-4cae-85e2-9a73863fd6a2 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:24.484787 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34498dd9-1463-4d13-8626-f7e32d5749ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:24.485983 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34498dd9-1463-4d13-8626-f7e32d5749ec None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:24.486515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34498dd9-1463-4d13-8626-f7e32d5749ec None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:24.487010 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34498dd9-1463-4d13-8626-f7e32d5749ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:24.498924 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34498dd9-1463-4d13-8626-f7e32d5749ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-34498dd9-1463-4d13-8626-f7e32d5749ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:24.507188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:24.508066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:24.508857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:24.508857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:24.508857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:24.508857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:24.508857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:24.508857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:24.508857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:24.508857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:24.508857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:24.508857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:24.508857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:24.508857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:24.515925 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba6c10-1844-4b42-bd8d-391f3d1a70a3 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:24.516485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 122/246] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:24.517213 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34498dd9-1463-4d13-8626-f7e32d5749ec None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:24.548010 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f87152-b40c-4267-bb2f-4009dea47364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:24.549004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87152-b40c-4267-bb2f-4009dea47364 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:24.549503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87152-b40c-4267-bb2f-4009dea47364 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:24.550033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87152-b40c-4267-bb2f-4009dea47364 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:24.551099 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f87152-b40c-4267-bb2f-4009dea47364 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:24.552751 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f87152-b40c-4267-bb2f-4009dea47364 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:24.575667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 125/247] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:35:24 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:35:24.577163 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb60ffa-1196-405b-b966-514da1f67504 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:24.577559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb60ffa-1196-405b-b966-514da1f67504 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:24.577928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb60ffa-1196-405b-b966-514da1f67504 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:24.579686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 126/248] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:24.580259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb60ffa-1196-405b-b966-514da1f67504 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:24.651579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34498dd9-1463-4d13-8626-f7e32d5749ec None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:24.654254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:24.687529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:24.703184 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d077f-af75-4532-b839-fde8abf46d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:24.704728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d077f-af75-4532-b839-fde8abf46d82 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:24.705203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d077f-af75-4532-b839-fde8abf46d82 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:24.705665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d077f-af75-4532-b839-fde8abf46d82 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:24.707345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d077f-af75-4532-b839-fde8abf46d82 None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:24.709138 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d077f-af75-4532-b839-fde8abf46d82 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:24.711856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 123/249] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:24 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:24.713634 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687ff0d-851c-4686-a8b0-1713e81bbe50 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:24.714218 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687ff0d-851c-4686-a8b0-1713e81bbe50 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:24.714733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687ff0d-851c-4686-a8b0-1713e81bbe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:24.726688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb60ffa-1196-405b-b966-514da1f67504 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:24.734943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-1687ff0d-851c-4686-a8b0-1713e81bbe50 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:24.736627 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1687ff0d-851c-4686-a8b0-1713e81bbe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:24.775321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef1957-bc87-42cb-bbbb-e788df40724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:24.776015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef1957-bc87-42cb-bbbb-e788df40724a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:24.776295 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef1957-bc87-42cb-bbbb-e788df40724a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:24.776569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef1957-bc87-42cb-bbbb-e788df40724a None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:24.777331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef1957-bc87-42cb-bbbb-e788df40724a None admin] RBAC: Adding query filter params (name=member) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:24.777823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef1957-bc87-42cb-bbbb-e788df40724a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:24.779942 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef1957-bc87-42cb-bbbb-e788df40724a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:24.791630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 127/250] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:24.792870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef1957-bc87-42cb-bbbb-e788df40724a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:24.825844 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 124/251] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:24.827237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687ff0d-851c-4686-a8b0-1713e81bbe50 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:24.929977 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef1957-bc87-42cb-bbbb-e788df40724a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:24.942273 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:24.956509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687ff0d-851c-4686-a8b0-1713e81bbe50 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:24.974885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141ae7f-6812-43b4-a03f-d8b55ab23c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:24.975651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141ae7f-6812-43b4-a03f-d8b55ab23c95 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:24.976342 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141ae7f-6812-43b4-a03f-d8b55ab23c95 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:24.976829 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141ae7f-6812-43b4-a03f-d8b55ab23c95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:24.977687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141ae7f-6812-43b4-a03f-d8b55ab23c95 None admin] RBAC: Adding query filter params (role.id=fd5b8ebb128748d5b34cc4fa37a3d1e8, scope.project.id=398973d672844da38a2cfaf6f5093a9e, user.id=7a926807f5ab478d8c1d1fa032e02d7b) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:24.978125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141ae7f-6812-43b4-a03f-d8b55ab23c95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:24.979936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141ae7f-6812-43b4-a03f-d8b55ab23c95 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:24.986083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 128/252] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:24 2022] GET /identity/v3/role_assignments?user.id=7a926807f5ab478d8c1d1fa032e02d7b&scope.project.id=398973d672844da38a2cfaf6f5093a9e&role.id=fd5b8ebb128748d5b34cc4fa37a3d1e8 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:24.987061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141ae7f-6812-43b4-a03f-d8b55ab23c95 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:24.990594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:25.009780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50c4bc-c7e6-4073-a3e0-72c5b3ed106b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:25.011788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c4bc-c7e6-4073-a3e0-72c5b3ed106b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:25.012280 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c4bc-c7e6-4073-a3e0-72c5b3ed106b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:25.012724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c4bc-c7e6-4073-a3e0-72c5b3ed106b None admin] PATH_INFO: `/v3/users/996017a97e97402ab902bc03ccaf1814` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:25.014729 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50c4bc-c7e6-4073-a3e0-72c5b3ed106b None admin] RBAC: Authorizing `identity:get_user(user_id=996017a97e97402ab902bc03ccaf1814)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:25.016941 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50c4bc-c7e6-4073-a3e0-72c5b3ed106b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:25.019654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 125/253] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:24 2022] GET /identity/v3/users/996017a97e97402ab902bc03ccaf1814 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:25.025456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50c4bc-c7e6-4073-a3e0-72c5b3ed106b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:25.158974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50c4bc-c7e6-4073-a3e0-72c5b3ed106b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:25.161843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141ae7f-6812-43b4-a03f-d8b55ab23c95 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:25.207426 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319ddb0-0a34-4423-ad5a-92ed5cbd88ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:25.208551 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319ddb0-0a34-4423-ad5a-92ed5cbd88ed None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:25.209406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319ddb0-0a34-4423-ad5a-92ed5cbd88ed None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:25.210402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319ddb0-0a34-4423-ad5a-92ed5cbd88ed None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:25.216657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319ddb0-0a34-4423-ad5a-92ed5cbd88ed None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:25.218339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319ddb0-0a34-4423-ad5a-92ed5cbd88ed None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:25.224798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 126/254] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:25 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:25.227905 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319ddb0-0a34-4423-ad5a-92ed5cbd88ed None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:25.267513 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639308e-656e-4f80-9af5-89450d242d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:25.268793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639308e-656e-4f80-9af5-89450d242d0a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:25.268793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639308e-656e-4f80-9af5-89450d242d0a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:25.268983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639308e-656e-4f80-9af5-89450d242d0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:25.296212 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639308e-656e-4f80-9af5-89450d242d0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:25.298464 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-1639308e-656e-4f80-9af5-89450d242d0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:25.308343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:25.309459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:25.310311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:25.310311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:25.310311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:25.310311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:25.310311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:25.310311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:25.310311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:25.310311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:25.310311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:25.310311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:25.310311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:25.310311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:25.311328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 129/255] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:25.313465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c3b74-2bbe-4895-8d2a-311993980824 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:25.313783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c3b74-2bbe-4895-8d2a-311993980824 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:25.314065 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c3b74-2bbe-4895-8d2a-311993980824 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:25.315852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 130/256] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:25.324514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c3b74-2bbe-4895-8d2a-311993980824 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:25.376988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:25.397934 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319ddb0-0a34-4423-ad5a-92ed5cbd88ed None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:25.469193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e63e95-1c4e-4632-8b15-d44a4221ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:25.470029 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e63e95-1c4e-4632-8b15-d44a4221ff14 None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:25.470309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e63e95-1c4e-4632-8b15-d44a4221ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:25.470581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e63e95-1c4e-4632-8b15-d44a4221ff14 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e/users/996017a97e97402ab902bc03ccaf1814/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:25.474228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e63e95-1c4e-4632-8b15-d44a4221ff14 None admin] RBAC: Authorizing `identity:create_grant(project_id=398973d672844da38a2cfaf6f5093a9e, user_id=996017a97e97402ab902bc03ccaf1814, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:25.476065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e63e95-1c4e-4632-8b15-d44a4221ff14 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:25.502040 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c3b74-2bbe-4895-8d2a-311993980824 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:25.509658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 127/257] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:35:25 2022] PUT /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e/users/996017a97e97402ab902bc03ccaf1814/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:35:25.515780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb8df7-190a-44f9-99f3-c78529f6ab44 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:25.516076 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb8df7-190a-44f9-99f3-c78529f6ab44 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:25.516346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb8df7-190a-44f9-99f3-c78529f6ab44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:25.552737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-f0cb8df7-190a-44f9-99f3-c78529f6ab44 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:25.554017 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f0cb8df7-190a-44f9-99f3-c78529f6ab44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:25.587533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c326cab-b2fd-40a3-bc67-6d550136452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:25.588213 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c326cab-b2fd-40a3-bc67-6d550136452a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:25.588511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c326cab-b2fd-40a3-bc67-6d550136452a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:25.588721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c326cab-b2fd-40a3-bc67-6d550136452a None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:25.589489 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c326cab-b2fd-40a3-bc67-6d550136452a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:25.589801 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c326cab-b2fd-40a3-bc67-6d550136452a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:25.591664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c326cab-b2fd-40a3-bc67-6d550136452a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:25.619815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 131/258] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:25.629813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c326cab-b2fd-40a3-bc67-6d550136452a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:25.741768 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 128/259] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:25.769977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb8df7-190a-44f9-99f3-c78529f6ab44 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:25.816724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:25.823815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c326cab-b2fd-40a3-bc67-6d550136452a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:25.873075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ac2bd-9025-435d-9daf-6fecacecf8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:25.874466 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac2bd-9025-435d-9daf-6fecacecf8fb None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:25.875073 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac2bd-9025-435d-9daf-6fecacecf8fb None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:25.875176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:25.875630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac2bd-9025-435d-9daf-6fecacecf8fb None admin] PATH_INFO: `/v3/users/5490de7e03e241feaf35fc9b2fb919fe` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:25.877082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ac2bd-9025-435d-9daf-6fecacecf8fb None admin] RBAC: Authorizing `identity:get_user(user_id=5490de7e03e241feaf35fc9b2fb919fe)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:25.879200 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ac2bd-9025-435d-9daf-6fecacecf8fb None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:25.882569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 132/260] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:25 2022] GET /identity/v3/users/5490de7e03e241feaf35fc9b2fb919fe => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:25.888563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ac2bd-9025-435d-9daf-6fecacecf8fb None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:26.022529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb8df7-190a-44f9-99f3-c78529f6ab44 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:26.064918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ac2bd-9025-435d-9daf-6fecacecf8fb None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:26.108854 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b07d8-d3fa-4694-b76c-f1de39f2f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:26.109692 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b07d8-d3fa-4694-b76c-f1de39f2f4a3 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:26.109979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b07d8-d3fa-4694-b76c-f1de39f2f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:26.110246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b07d8-d3fa-4694-b76c-f1de39f2f4a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:26.139656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b07d8-d3fa-4694-b76c-f1de39f2f4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-dd6b07d8-d3fa-4694-b76c-f1de39f2f4a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:26.148188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:26.149052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:26.150241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:26.150241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:26.150241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:26.150241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:26.150241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:26.150241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:26.150241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:26.150241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:26.150241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:26.150241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:26.150241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:26.150241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:26.150241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 129/261] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:35:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:35:26.159835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b208fe2-db48-4d28-bbd0-160f74488ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:26.160453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b07d8-d3fa-4694-b76c-f1de39f2f4a3 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:26.160579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b208fe2-db48-4d28-bbd0-160f74488ec0 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:26.160793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b208fe2-db48-4d28-bbd0-160f74488ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:26.161067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b208fe2-db48-4d28-bbd0-160f74488ec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:26.243134 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:26.352151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b208fe2-db48-4d28-bbd0-160f74488ec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:26.352776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b07d8-d3fa-4694-b76c-f1de39f2f4a3 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:26.353691 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b208fe2-db48-4d28-bbd0-160f74488ec0 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:26.377287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:26.453640 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906d672-aac7-4f2b-9ab5-a5ce8092bfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:26.454674 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906d672-aac7-4f2b-9ab5-a5ce8092bfa8 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:26.454986 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906d672-aac7-4f2b-9ab5-a5ce8092bfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:26.455264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906d672-aac7-4f2b-9ab5-a5ce8092bfa8 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:26.456058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906d672-aac7-4f2b-9ab5-a5ce8092bfa8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:26.456368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906d672-aac7-4f2b-9ab5-a5ce8092bfa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:26.458075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906d672-aac7-4f2b-9ab5-a5ce8092bfa8 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:26.481328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 130/262] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:35:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:26.487375 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906d672-aac7-4f2b-9ab5-a5ce8092bfa8 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:26.552162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 133/263] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:26.557870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b208fe2-db48-4d28-bbd0-160f74488ec0 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:26.626746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906d672-aac7-4f2b-9ab5-a5ce8092bfa8 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:26.662710 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9d2ed-b667-41cd-ba79-73ac25bda914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:26.663997 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9d2ed-b667-41cd-ba79-73ac25bda914 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:26.664469 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9d2ed-b667-41cd-ba79-73ac25bda914 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:26.664929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9d2ed-b667-41cd-ba79-73ac25bda914 None admin] PATH_INFO: `/v3/users/5490de7e03e241feaf35fc9b2fb919fe` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:26.666401 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9d2ed-b667-41cd-ba79-73ac25bda914 None admin] RBAC: Authorizing `identity:get_user(user_id=5490de7e03e241feaf35fc9b2fb919fe)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:26.668200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9d2ed-b667-41cd-ba79-73ac25bda914 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:26.670024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:26.671983 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 131/264] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:26 2022] GET /identity/v3/users/5490de7e03e241feaf35fc9b2fb919fe => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:26.678859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9d2ed-b667-41cd-ba79-73ac25bda914 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:26.753787 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b208fe2-db48-4d28-bbd0-160f74488ec0 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:26.767208 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:26.812384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fea20-e597-47af-abdb-1938a5f4db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:26.813273 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fea20-e597-47af-abdb-1938a5f4db95 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:26.813552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fea20-e597-47af-abdb-1938a5f4db95 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:26.813824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fea20-e597-47af-abdb-1938a5f4db95 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:26.815104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fea20-e597-47af-abdb-1938a5f4db95 None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:26.816646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fea20-e597-47af-abdb-1938a5f4db95 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:26.818674 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 134/265] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:26 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:26.832523 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9d2ed-b667-41cd-ba79-73ac25bda914 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:26.836602 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fea20-e597-47af-abdb-1938a5f4db95 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:26.870896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058690e7-81d7-4186-8e61-84d84c743cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:26.871557 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058690e7-81d7-4186-8e61-84d84c743cc4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:26.871841 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058690e7-81d7-4186-8e61-84d84c743cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:26.872118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058690e7-81d7-4186-8e61-84d84c743cc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:26.944473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058690e7-81d7-4186-8e61-84d84c743cc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:26.945979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058690e7-81d7-4186-8e61-84d84c743cc4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:26.994170 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:27.057679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 132/266] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:27.064419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058690e7-81d7-4186-8e61-84d84c743cc4 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:27.092758 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fea20-e597-47af-abdb-1938a5f4db95 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:27.172513 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:27.174327 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058690e7-81d7-4186-8e61-84d84c743cc4 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:27.200094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b19ec-cdbf-470f-ba6d-1a18bd8d132b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:27.200775 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b19ec-cdbf-470f-ba6d-1a18bd8d132b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:27.201059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b19ec-cdbf-470f-ba6d-1a18bd8d132b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:27.201338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b19ec-cdbf-470f-ba6d-1a18bd8d132b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:27.202195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b19ec-cdbf-470f-ba6d-1a18bd8d132b None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=398973d672844da38a2cfaf6f5093a9e, user.id=5490de7e03e241feaf35fc9b2fb919fe) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:27.202503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b19ec-cdbf-470f-ba6d-1a18bd8d132b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:27.204015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b19ec-cdbf-470f-ba6d-1a18bd8d132b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:27.214566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680daaf9-aa30-4295-8a37-f2ea25520b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:27.215836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680daaf9-aa30-4295-8a37-f2ea25520b2c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:27.218805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 135/267] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:26 2022] GET /identity/v3/role_assignments?user.id=5490de7e03e241feaf35fc9b2fb919fe&scope.project.id=398973d672844da38a2cfaf6f5093a9e&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 608 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:27.219258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680daaf9-aa30-4295-8a37-f2ea25520b2c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:27.219792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680daaf9-aa30-4295-8a37-f2ea25520b2c None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:27.221393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680daaf9-aa30-4295-8a37-f2ea25520b2c None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:27.223110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680daaf9-aa30-4295-8a37-f2ea25520b2c None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:27.230177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 133/268] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:27 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:27.231601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b19ec-cdbf-470f-ba6d-1a18bd8d132b None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:27.396149 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b19ec-cdbf-470f-ba6d-1a18bd8d132b None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:27.444474 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe72202-ba63-42bb-a6c7-9d5e0b43fbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:27.445083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe72202-ba63-42bb-a6c7-9d5e0b43fbde None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:27.445366 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe72202-ba63-42bb-a6c7-9d5e0b43fbde None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:27.445641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe72202-ba63-42bb-a6c7-9d5e0b43fbde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:27.446485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe72202-ba63-42bb-a6c7-9d5e0b43fbde None admin] RBAC: Adding query filter params (role.id=4af08bea19b94c2c863a51b103f50b8b, scope.project.id=398973d672844da38a2cfaf6f5093a9e, user.id=5490de7e03e241feaf35fc9b2fb919fe) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:27.447023 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe72202-ba63-42bb-a6c7-9d5e0b43fbde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:27.448728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe72202-ba63-42bb-a6c7-9d5e0b43fbde None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:27.455561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 136/269] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:27 2022] GET /identity/v3/role_assignments?user.id=5490de7e03e241feaf35fc9b2fb919fe&scope.project.id=398973d672844da38a2cfaf6f5093a9e&role.id=4af08bea19b94c2c863a51b103f50b8b => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:27.569568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b0e16-61cd-42c5-8891-d5fb29bffd4f None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:27.570082 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b0e16-61cd-42c5-8891-d5fb29bffd4f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:27.570156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b0e16-61cd-42c5-8891-d5fb29bffd4f None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:27.571967 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 134/270] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:27.577745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96c79c-dabe-4d81-a292-b22278ff5ec1 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:27.578050 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96c79c-dabe-4d81-a292-b22278ff5ec1 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:27.578299 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96c79c-dabe-4d81-a292-b22278ff5ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:27.601202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-9b96c79c-dabe-4d81-a292-b22278ff5ec1 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:27.603358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9b96c79c-dabe-4d81-a292-b22278ff5ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:27.671421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:27.687103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 137/271] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:27.722276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b0e16-61cd-42c5-8891-d5fb29bffd4f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:27.732347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:27.839043 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b0e16-61cd-42c5-8891-d5fb29bffd4f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:27.877088 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6609be-8aa6-4957-a06d-2f2e671caeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:27.877901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6609be-8aa6-4957-a06d-2f2e671caeb7 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:27.878182 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6609be-8aa6-4957-a06d-2f2e671caeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:27.878457 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6609be-8aa6-4957-a06d-2f2e671caeb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:27.879711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6609be-8aa6-4957-a06d-2f2e671caeb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:27.881179 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6609be-8aa6-4957-a06d-2f2e671caeb7 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:27.883154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 135/272] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:27.889061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96c79c-dabe-4d81-a292-b22278ff5ec1 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:27.945073 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d89e9-3a25-4cbb-8d0c-8bf6bbd8580e None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:27.945399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d89e9-3a25-4cbb-8d0c-8bf6bbd8580e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:27.945634 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d89e9-3a25-4cbb-8d0c-8bf6bbd8580e None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:27.947462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 136/273] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:27.953534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7389390-84c6-4873-a3be-abcb5e32ee89 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:27.953534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7389390-84c6-4873-a3be-abcb5e32ee89 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:27.953534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7389390-84c6-4873-a3be-abcb5e32ee89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:27.972890 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-c7389390-84c6-4873-a3be-abcb5e32ee89 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:27.974346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c7389390-84c6-4873-a3be-abcb5e32ee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:28.022366 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96c79c-dabe-4d81-a292-b22278ff5ec1 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:28.057404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8164e2d-6eee-4d63-aa96-37b43bafcdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:28.058203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8164e2d-6eee-4d63-aa96-37b43bafcdd0 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:28.058497 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8164e2d-6eee-4d63-aa96-37b43bafcdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:28.058795 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8164e2d-6eee-4d63-aa96-37b43bafcdd0 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:28.059637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8164e2d-6eee-4d63-aa96-37b43bafcdd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:28.060457 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 137/274] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:28.061186 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8164e2d-6eee-4d63-aa96-37b43bafcdd0 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:28.064136 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb324b-1341-4cf1-871a-330a63d0c518 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:28.064637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb324b-1341-4cf1-871a-330a63d0c518 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:28.065105 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb324b-1341-4cf1-871a-330a63d0c518 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:28.066869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 138/275] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:28.074040 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5540c-dcd3-4487-905f-3ac861c8b8a7 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:28.074374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5540c-dcd3-4487-905f-3ac861c8b8a7 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:28.074627 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5540c-dcd3-4487-905f-3ac861c8b8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:28.096791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 138/276] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:35:27 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:35:28.096990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:28.097913 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8164e2d-6eee-4d63-aa96-37b43bafcdd0 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:28.102624 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-eee5540c-dcd3-4487-905f-3ac861c8b8a7 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:28.104358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-eee5540c-dcd3-4487-905f-3ac861c8b8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:28.150615 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:28.183657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 139/277] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:28.211715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5540c-dcd3-4487-905f-3ac861c8b8a7 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:28.224292 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8164e2d-6eee-4d63-aa96-37b43bafcdd0 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:28.262382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49428e2-c55c-4dd6-9c7d-7b1f618be063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:28.263266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49428e2-c55c-4dd6-9c7d-7b1f618be063 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:28.263547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49428e2-c55c-4dd6-9c7d-7b1f618be063 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:28.263824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49428e2-c55c-4dd6-9c7d-7b1f618be063 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:28.277545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49428e2-c55c-4dd6-9c7d-7b1f618be063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-b49428e2-c55c-4dd6-9c7d-7b1f618be063 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:28.286964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:28.287869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:28.288724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:28.288724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:28.288724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:28.288724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:28.288724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:28.288724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:28.288724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:28.288724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:28.288724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:28.288724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:28.288724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:28.288724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:28.288724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 139/278] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:28.294342 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49428e2-c55c-4dd6-9c7d-7b1f618be063 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:28.347669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5540c-dcd3-4487-905f-3ac861c8b8a7 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:28.391018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cf353-6887-45cd-b9d6-b9f2c8f8a53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:28.391856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cf353-6887-45cd-b9d6-b9f2c8f8a53a None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:28.392148 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cf353-6887-45cd-b9d6-b9f2c8f8a53a None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:28.392424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cf353-6887-45cd-b9d6-b9f2c8f8a53a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:28.395475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:28.409393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cf353-6887-45cd-b9d6-b9f2c8f8a53a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-d98cf353-6887-45cd-b9d6-b9f2c8f8a53a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:28.417829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:28.418951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:28.419761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:28.419761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:28.419761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:28.419761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:28.419761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:28.419761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:28.419761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:28.419761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:28.419761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:28.419761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:28.419761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:28.419761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:28.419761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 140/279] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:35:28.420768 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663ad4a-3518-4266-97d2-036fe904c5b8 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:28.420964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663ad4a-3518-4266-97d2-036fe904c5b8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:28.422817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663ad4a-3518-4266-97d2-036fe904c5b8 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:28.422817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 141/280] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:28.424047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49428e2-c55c-4dd6-9c7d-7b1f618be063 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:28.426835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:28.427726 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663ad4a-3518-4266-97d2-036fe904c5b8 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:28.467987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de99c0d-7bb1-460d-aa42-10da18cb9b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:28.468682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99c0d-7bb1-460d-aa42-10da18cb9b88 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:28.469124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99c0d-7bb1-460d-aa42-10da18cb9b88 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:28.469412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99c0d-7bb1-460d-aa42-10da18cb9b88 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:28.470185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de99c0d-7bb1-460d-aa42-10da18cb9b88 None admin] RBAC: Adding query filter params (name=member) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:28.470505 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de99c0d-7bb1-460d-aa42-10da18cb9b88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:28.472857 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de99c0d-7bb1-460d-aa42-10da18cb9b88 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:28.483813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 140/281] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:28.485618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a556b-ab2e-4008-aa8a-0b39d6faf64f None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:28.486175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a556b-ab2e-4008-aa8a-0b39d6faf64f None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:28.486467 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a556b-ab2e-4008-aa8a-0b39d6faf64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:28.507947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-cf3a556b-ab2e-4008-aa8a-0b39d6faf64f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:28.509505 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cf3a556b-ab2e-4008-aa8a-0b39d6faf64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:28.550504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663ad4a-3518-4266-97d2-036fe904c5b8 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:28.592298 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 141/282] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:28.592743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7e2e4-ac43-4f54-8cb6-05288ca05213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:28.593288 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a556b-ab2e-4008-aa8a-0b39d6faf64f None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:28.593550 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7e2e4-ac43-4f54-8cb6-05288ca05213 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:28.593847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7e2e4-ac43-4f54-8cb6-05288ca05213 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:28.594115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7e2e4-ac43-4f54-8cb6-05288ca05213 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:28.594927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7e2e4-ac43-4f54-8cb6-05288ca05213 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:28.595242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7e2e4-ac43-4f54-8cb6-05288ca05213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:28.596651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7e2e4-ac43-4f54-8cb6-05288ca05213 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:28.606683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 142/283] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:28.613463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7e2e4-ac43-4f54-8cb6-05288ca05213 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:28.673553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:28.720168 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a556b-ab2e-4008-aa8a-0b39d6faf64f None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:28.727475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7e2e4-ac43-4f54-8cb6-05288ca05213 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:28.735271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:28.767592 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31e89b-75e2-41d1-ac6d-474972daecfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:28.768767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e89b-75e2-41d1-ac6d-474972daecfa None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:28.769157 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e89b-75e2-41d1-ac6d-474972daecfa None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:28.769437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e89b-75e2-41d1-ac6d-474972daecfa None admin] PATH_INFO: `/v3/users/b23ea26f70004bc09cccf48e86f48905` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:28.776714 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a674d-83f3-45c2-a6d4-5be040e0bd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:28.777663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a674d-83f3-45c2-a6d4-5be040e0bd84 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:28.777945 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a674d-83f3-45c2-a6d4-5be040e0bd84 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:28.778263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a674d-83f3-45c2-a6d4-5be040e0bd84 None admin] PATH_INFO: `/v3/users/7a926807f5ab478d8c1d1fa032e02d7b` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:28.779531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a674d-83f3-45c2-a6d4-5be040e0bd84 None admin] RBAC: Authorizing `identity:get_user(user_id=7a926807f5ab478d8c1d1fa032e02d7b)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:28.780989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a674d-83f3-45c2-a6d4-5be040e0bd84 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:28.786961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 143/284] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:28 2022] GET /identity/v3/users/7a926807f5ab478d8c1d1fa032e02d7b => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:28.787754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31e89b-75e2-41d1-ac6d-474972daecfa None admin] RBAC: Authorizing `identity:get_user(user_id=b23ea26f70004bc09cccf48e86f48905)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:28.789233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31e89b-75e2-41d1-ac6d-474972daecfa None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:28.791626 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a674d-83f3-45c2-a6d4-5be040e0bd84 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:28.791736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 142/285] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:28 2022] GET /identity/v3/users/b23ea26f70004bc09cccf48e86f48905 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:28.792506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31e89b-75e2-41d1-ac6d-474972daecfa None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:28.909825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a674d-83f3-45c2-a6d4-5be040e0bd84 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:28.937702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31e89b-75e2-41d1-ac6d-474972daecfa None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:28.942094 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:28.955453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891efeb-335c-4293-9204-cda923bbed5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:28.956840 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891efeb-335c-4293-9204-cda923bbed5c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:28.957790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891efeb-335c-4293-9204-cda923bbed5c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:28.958262 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891efeb-335c-4293-9204-cda923bbed5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:28.973213 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891efeb-335c-4293-9204-cda923bbed5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-9891efeb-335c-4293-9204-cda923bbed5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:28.981507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:28.982423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:28.983594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:28.983594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:28.983594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:28.983594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:28.983594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:28.983594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:28.983594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:28.983594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:28.983594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:28.983594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:28.983594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:28.983594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:28.985203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3ff08-eb50-48f2-91b2-fea40a670573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:28.986375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3ff08-eb50-48f2-91b2-fea40a670573 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:28.986882 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3ff08-eb50-48f2-91b2-fea40a670573 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:28.987639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3ff08-eb50-48f2-91b2-fea40a670573 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:28.987740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 144/286] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:28.988524 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891efeb-335c-4293-9204-cda923bbed5c None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:28.989571 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3ff08-eb50-48f2-91b2-fea40a670573 None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:28.991538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3ff08-eb50-48f2-91b2-fea40a670573 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:28.999275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 143/287] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:28 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:28.999981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3ff08-eb50-48f2-91b2-fea40a670573 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:29.027914 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:29.110980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3ff08-eb50-48f2-91b2-fea40a670573 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:29.124519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891efeb-335c-4293-9204-cda923bbed5c None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:29.154264 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035c69d-c033-422c-a648-d5b3a91d159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:29.155548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035c69d-c033-422c-a648-d5b3a91d159a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:29.156003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035c69d-c033-422c-a648-d5b3a91d159a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:29.156447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035c69d-c033-422c-a648-d5b3a91d159a None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:29.157598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035c69d-c033-422c-a648-d5b3a91d159a None admin] RBAC: Adding query filter params (name=member) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:29.158075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035c69d-c033-422c-a648-d5b3a91d159a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:29.158630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ec0a6-d982-4b1e-addc-e977a0f18f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:29.159373 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec0a6-d982-4b1e-addc-e977a0f18f43 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:29.159725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec0a6-d982-4b1e-addc-e977a0f18f43 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:29.160052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec0a6-d982-4b1e-addc-e977a0f18f43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:29.160447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035c69d-c033-422c-a648-d5b3a91d159a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:29.161010 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ec0a6-d982-4b1e-addc-e977a0f18f43 None admin] RBAC: Adding query filter params (role.id=59a0f03d08fd401ebbd29ebd5f174abb, user.id=b23ea26f70004bc09cccf48e86f48905, scope.system=all) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:29.161383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ec0a6-d982-4b1e-addc-e977a0f18f43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:29.162929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ec0a6-d982-4b1e-addc-e977a0f18f43 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:29.168337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 145/288] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jun 30 03:35:28 2022] GET /identity/v3/role_assignments?user.id=b23ea26f70004bc09cccf48e86f48905&scope.system=all&role.id=59a0f03d08fd401ebbd29ebd5f174abb => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:29.171435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 144/289] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:29.176025 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ec0a6-d982-4b1e-addc-e977a0f18f43 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:29.177351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035c69d-c033-422c-a648-d5b3a91d159a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:29.267080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:29.315982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:29.343003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035c69d-c033-422c-a648-d5b3a91d159a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:29.353510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ec0a6-d982-4b1e-addc-e977a0f18f43 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:29.392578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3450350-1f5d-4b4e-84fb-6a84a76c220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:29.393882 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3450350-1f5d-4b4e-84fb-6a84a76c220e None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:29.394362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3450350-1f5d-4b4e-84fb-6a84a76c220e None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:29.394964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3450350-1f5d-4b4e-84fb-6a84a76c220e None admin] PATH_INFO: `/v3/users/996017a97e97402ab902bc03ccaf1814` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:29.396532 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3450350-1f5d-4b4e-84fb-6a84a76c220e None admin] RBAC: Authorizing `identity:get_user(user_id=996017a97e97402ab902bc03ccaf1814)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:29.398301 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3450350-1f5d-4b4e-84fb-6a84a76c220e None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:29.406118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 145/290] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:29 2022] GET /identity/v3/users/996017a97e97402ab902bc03ccaf1814 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:29.407968 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3450350-1f5d-4b4e-84fb-6a84a76c220e None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:29.421790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe960c-39dd-4cb7-ba32-4bfae112fd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:29.423120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe960c-39dd-4cb7-ba32-4bfae112fd37 None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:29.423559 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe960c-39dd-4cb7-ba32-4bfae112fd37 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:29.423969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe960c-39dd-4cb7-ba32-4bfae112fd37 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e/users/7a926807f5ab478d8c1d1fa032e02d7b/roles/fd5b8ebb128748d5b34cc4fa37a3d1e8` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:29.426373 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe960c-39dd-4cb7-ba32-4bfae112fd37 None admin] RBAC: Authorizing `identity:create_grant(project_id=398973d672844da38a2cfaf6f5093a9e, user_id=7a926807f5ab478d8c1d1fa032e02d7b, role_id=fd5b8ebb128748d5b34cc4fa37a3d1e8)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:29.428064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe960c-39dd-4cb7-ba32-4bfae112fd37 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:29.470648 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 146/291] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:35:29 2022] PUT /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e/users/7a926807f5ab478d8c1d1fa032e02d7b/roles/fd5b8ebb128748d5b34cc4fa37a3d1e8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:35:29.574212 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3450350-1f5d-4b4e-84fb-6a84a76c220e None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:29.623956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f06d40-77ae-4e34-a80b-69e140b970f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:29.624635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f06d40-77ae-4e34-a80b-69e140b970f1 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:29.624916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f06d40-77ae-4e34-a80b-69e140b970f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:29.625190 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f06d40-77ae-4e34-a80b-69e140b970f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:29.657152 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:29.711222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f06d40-77ae-4e34-a80b-69e140b970f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:29.712800 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f06d40-77ae-4e34-a80b-69e140b970f1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:29.815929 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 146/292] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:29.821754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe960c-39dd-4cb7-ba32-4bfae112fd37 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:30.053066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe960c-39dd-4cb7-ba32-4bfae112fd37 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:30.072949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:30.109868 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4be41-10c2-4843-8311-4ac0b665da6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:30.110758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4be41-10c2-4843-8311-4ac0b665da6c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:30.111064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4be41-10c2-4843-8311-4ac0b665da6c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:30.111343 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4be41-10c2-4843-8311-4ac0b665da6c None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:30.112573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4be41-10c2-4843-8311-4ac0b665da6c None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:30.114057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4be41-10c2-4843-8311-4ac0b665da6c None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:30.116824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 147/293] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:29 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:30.122196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f06d40-77ae-4e34-a80b-69e140b970f1 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:30.202797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:30.274433 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f06d40-77ae-4e34-a80b-69e140b970f1 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:30.325769 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa12bf8-ff1c-4e51-bcfa-b284f61f952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:30.326448 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa12bf8-ff1c-4e51-bcfa-b284f61f952c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:30.326730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa12bf8-ff1c-4e51-bcfa-b284f61f952c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:30.327040 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa12bf8-ff1c-4e51-bcfa-b284f61f952c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:30.327885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa12bf8-ff1c-4e51-bcfa-b284f61f952c None admin] RBAC: Adding query filter params (role.id=59a0f03d08fd401ebbd29ebd5f174abb, scope.project.id=398973d672844da38a2cfaf6f5093a9e, user.id=996017a97e97402ab902bc03ccaf1814) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:30.328199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa12bf8-ff1c-4e51-bcfa-b284f61f952c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:30.329657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa12bf8-ff1c-4e51-bcfa-b284f61f952c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:30.340167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 147/294] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:30 2022] GET /identity/v3/role_assignments?user.id=996017a97e97402ab902bc03ccaf1814&scope.project.id=398973d672844da38a2cfaf6f5093a9e&role.id=59a0f03d08fd401ebbd29ebd5f174abb => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:30.477027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4c40b-6e78-4af3-b81e-0858dbe5e9a5 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:30.477221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4c40b-6e78-4af3-b81e-0858dbe5e9a5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:30.477490 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4c40b-6e78-4af3-b81e-0858dbe5e9a5 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:30.479460 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 148/295] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:30.484832 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccc694-4586-4b2d-9ccd-fbadcd3c24d4 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:30.485117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccc694-4586-4b2d-9ccd-fbadcd3c24d4 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:30.485718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccc694-4586-4b2d-9ccd-fbadcd3c24d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:30.513659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-3eccc694-4586-4b2d-9ccd-fbadcd3c24d4 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:30.515941 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3eccc694-4586-4b2d-9ccd-fbadcd3c24d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:30.617975 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 148/296] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:30.637977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ccfde-054d-4fde-acb4-d72d432c5b48 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:30.638361 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ccfde-054d-4fde-acb4-d72d432c5b48 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:30.638915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ccfde-054d-4fde-acb4-d72d432c5b48 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:30.642515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccc694-4586-4b2d-9ccd-fbadcd3c24d4 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:30.644956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 149/297] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:30.650008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bffcfc-23a9-49d7-8083-18636c08cb0d None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:30.650563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bffcfc-23a9-49d7-8083-18636c08cb0d None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:30.651096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bffcfc-23a9-49d7-8083-18636c08cb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:30.671879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-68bffcfc-23a9-49d7-8083-18636c08cb0d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:30.673444 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-68bffcfc-23a9-49d7-8083-18636c08cb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:30.704854 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:30.776129 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 150/298] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:30.783624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccc694-4586-4b2d-9ccd-fbadcd3c24d4 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:30.808229 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bffcfc-23a9-49d7-8083-18636c08cb0d None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:30.820780 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef6623-4a59-4716-9ad5-ead1aead08ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:30.822268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef6623-4a59-4716-9ad5-ead1aead08ab None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:30.822687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef6623-4a59-4716-9ad5-ead1aead08ab None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:30.823594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef6623-4a59-4716-9ad5-ead1aead08ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:30.839670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef6623-4a59-4716-9ad5-ead1aead08ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-e4ef6623-4a59-4716-9ad5-ead1aead08ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:30.857578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:30.858594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:30.859596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:30.859596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:30.859596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:30.859596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:30.859596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:30.859596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:30.859596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:30.859596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:30.859596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:30.859596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:30.859596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:30.859596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:30.862293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 149/299] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:35:30.867784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef6623-4a59-4716-9ad5-ead1aead08ab None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:30.959755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bffcfc-23a9-49d7-8083-18636c08cb0d None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:30.970937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:30.995740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef6623-4a59-4716-9ad5-ead1aead08ab None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:31.005984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:31.007367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce110c-919a-4df4-ade9-31f24cc6259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:31.008663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce110c-919a-4df4-ade9-31f24cc6259f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:31.009722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce110c-919a-4df4-ade9-31f24cc6259f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:31.010154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce110c-919a-4df4-ade9-31f24cc6259f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:31.012371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce110c-919a-4df4-ade9-31f24cc6259f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:31.014644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce110c-919a-4df4-ade9-31f24cc6259f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:31.017345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 151/300] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:31.023038 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce110c-919a-4df4-ade9-31f24cc6259f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:31.039595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f82b9c-fbf2-41a4-b9a5-f5e7557fe4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:31.040902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f82b9c-fbf2-41a4-b9a5-f5e7557fe4ee None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:31.041333 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f82b9c-fbf2-41a4-b9a5-f5e7557fe4ee None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:31.041771 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f82b9c-fbf2-41a4-b9a5-f5e7557fe4ee None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:31.042744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f82b9c-fbf2-41a4-b9a5-f5e7557fe4ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:31.043302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f82b9c-fbf2-41a4-b9a5-f5e7557fe4ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:31.044902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f82b9c-fbf2-41a4-b9a5-f5e7557fe4ee None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:31.054321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 150/301] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:31.060063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f82b9c-fbf2-41a4-b9a5-f5e7557fe4ee None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:31.138232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce110c-919a-4df4-ade9-31f24cc6259f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:31.176978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfea7d-78a8-43a5-8fdc-a1211a8a0edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:31.177930 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfea7d-78a8-43a5-8fdc-a1211a8a0edd None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:31.178353 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfea7d-78a8-43a5-8fdc-a1211a8a0edd None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:31.178886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfea7d-78a8-43a5-8fdc-a1211a8a0edd None admin] PATH_INFO: `/v3/groups` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:31.179737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfea7d-78a8-43a5-8fdc-a1211a8a0edd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:31.181443 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfea7d-78a8-43a5-8fdc-a1211a8a0edd None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:31.197616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f82b9c-fbf2-41a4-b9a5-f5e7557fe4ee None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:31.201119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 152/302] 10.222.0.26 () {60 vars in 1134 bytes} [Thu Jun 30 03:35:31 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:35:31.247406 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4311e6-f235-401a-90d3-6e3312e068b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:31.248783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4311e6-f235-401a-90d3-6e3312e068b5 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:31.249265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4311e6-f235-401a-90d3-6e3312e068b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:31.249736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4311e6-f235-401a-90d3-6e3312e068b5 None admin] PATH_INFO: `/v3/users/bee4ae1a7c874fdd8575fd5d07e2b471` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:31.269693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4311e6-f235-401a-90d3-6e3312e068b5 None admin] RBAC: Authorizing `identity:get_user(user_id=bee4ae1a7c874fdd8575fd5d07e2b471)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:31.271709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4311e6-f235-401a-90d3-6e3312e068b5 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:31.274237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 151/303] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:31 2022] GET /identity/v3/users/bee4ae1a7c874fdd8575fd5d07e2b471 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:31.283985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfea7d-78a8-43a5-8fdc-a1211a8a0edd None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:31.325620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:31.407346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfea7d-78a8-43a5-8fdc-a1211a8a0edd None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:31.443884 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494a0d9-3ebe-4bc8-b8e5-4049b8ff3641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:31.444559 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494a0d9-3ebe-4bc8-b8e5-4049b8ff3641 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:31.444842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494a0d9-3ebe-4bc8-b8e5-4049b8ff3641 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:31.445120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494a0d9-3ebe-4bc8-b8e5-4049b8ff3641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:31.446033 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494a0d9-3ebe-4bc8-b8e5-4049b8ff3641 None admin] RBAC: Adding query filter params (role.id=fd5b8ebb128748d5b34cc4fa37a3d1e8, user.id=bee4ae1a7c874fdd8575fd5d07e2b471, scope.system=all) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:31.446851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494a0d9-3ebe-4bc8-b8e5-4049b8ff3641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:31.448582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494a0d9-3ebe-4bc8-b8e5-4049b8ff3641 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:31.455805 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 153/304] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jun 30 03:35:31 2022] GET /identity/v3/role_assignments?user.id=bee4ae1a7c874fdd8575fd5d07e2b471&scope.system=all&role.id=fd5b8ebb128748d5b34cc4fa37a3d1e8 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:31.759915 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aadf7-5973-4366-91f8-8f10d7737246 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:31.760321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aadf7-5973-4366-91f8-8f10d7737246 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:31.760511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aadf7-5973-4366-91f8-8f10d7737246 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:31.762097 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 152/305] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:31.767722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad296b06-7d49-4fe8-bf75-3781fe7a1a70 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:31.768282 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad296b06-7d49-4fe8-bf75-3781fe7a1a70 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:31.768752 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad296b06-7d49-4fe8-bf75-3781fe7a1a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:31.787040 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-ad296b06-7d49-4fe8-bf75-3781fe7a1a70 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:31.788580 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ad296b06-7d49-4fe8-bf75-3781fe7a1a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:31.861102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 154/306] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:31.884369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6aadf7-5973-4366-91f8-8f10d7737246 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:31.913843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:31.997261 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6aadf7-5973-4366-91f8-8f10d7737246 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:32.001971 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9c1c-a248-451d-8c48-88542d797d46 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:32.002902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9c1c-a248-451d-8c48-88542d797d46 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:32.003368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9c1c-a248-451d-8c48-88542d797d46 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:32.005005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 155/307] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:35:32.010490 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945517a9-3e40-4cc1-b1ff-670634f324cc None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:32.011123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945517a9-3e40-4cc1-b1ff-670634f324cc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:32.011676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945517a9-3e40-4cc1-b1ff-670634f324cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:32.031665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-945517a9-3e40-4cc1-b1ff-670634f324cc None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:32.033167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-945517a9-3e40-4cc1-b1ff-670634f324cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:32.033643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d6550-98b0-4060-a4a8-ae4d149f052a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:32.034457 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d6550-98b0-4060-a4a8-ae4d149f052a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:32.034738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d6550-98b0-4060-a4a8-ae4d149f052a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:32.035134 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d6550-98b0-4060-a4a8-ae4d149f052a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:32.046301 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d6550-98b0-4060-a4a8-ae4d149f052a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-3a6d6550-98b0-4060-a4a8-ae4d149f052a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:32.054572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:32.055478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:32.056375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:32.056375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:32.056375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:32.056375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:32.056375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:32.056375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:32.056375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:32.056375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:32.056375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:32.056375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:32.056375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:32.056375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:32.057693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 153/308] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:32.062882 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d6550-98b0-4060-a4a8-ae4d149f052a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:32.071144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:32.116040 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 156/309] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:32.138149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945517a9-3e40-4cc1-b1ff-670634f324cc None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:32.167993 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:32.185350 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d6550-98b0-4060-a4a8-ae4d149f052a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:32.220998 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0001bce-cb6e-4bd0-9d8a-e6ba296792c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:32.222047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001bce-cb6e-4bd0-9d8a-e6ba296792c4 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:32.222545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001bce-cb6e-4bd0-9d8a-e6ba296792c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:32.223035 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001bce-cb6e-4bd0-9d8a-e6ba296792c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:32.224068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0001bce-cb6e-4bd0-9d8a-e6ba296792c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:32.224622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0001bce-cb6e-4bd0-9d8a-e6ba296792c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:32.226542 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0001bce-cb6e-4bd0-9d8a-e6ba296792c4 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:32.236374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 154/310] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:32.246794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0001bce-cb6e-4bd0-9d8a-e6ba296792c4 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:32.246940 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945517a9-3e40-4cc1-b1ff-670634f324cc None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:32.281122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0ae72-5cc6-4f15-a16f-ef9478b0cd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:32.281928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0ae72-5cc6-4f15-a16f-ef9478b0cd0e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:32.282230 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0ae72-5cc6-4f15-a16f-ef9478b0cd0e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:32.282479 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0ae72-5cc6-4f15-a16f-ef9478b0cd0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:32.293021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0ae72-5cc6-4f15-a16f-ef9478b0cd0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-afd0ae72-5cc6-4f15-a16f-ef9478b0cd0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:32.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:32.301681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:32.302450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:32.302450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:32.302450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:32.302450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:32.302450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:32.302450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:32.302450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:32.302450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:32.302450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:32.302450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:32.302450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:32.302450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:32.302450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 157/311] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:32.307982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0ae72-5cc6-4f15-a16f-ef9478b0cd0e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:32.357565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:32.363981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0001bce-cb6e-4bd0-9d8a-e6ba296792c4 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:32.399944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c2000-65ee-426d-a336-8d47634ceeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:32.401039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c2000-65ee-426d-a336-8d47634ceeb4 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:32.401326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c2000-65ee-426d-a336-8d47634ceeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:32.401597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c2000-65ee-426d-a336-8d47634ceeb4 None admin] PATH_INFO: `/v3/users/b23ea26f70004bc09cccf48e86f48905` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:32.403141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c2000-65ee-426d-a336-8d47634ceeb4 None admin] RBAC: Authorizing `identity:get_user(user_id=b23ea26f70004bc09cccf48e86f48905)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:32.404748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c2000-65ee-426d-a336-8d47634ceeb4 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:32.411441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 155/312] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:32 2022] GET /identity/v3/users/b23ea26f70004bc09cccf48e86f48905 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:32.412498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c2000-65ee-426d-a336-8d47634ceeb4 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:32.425064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0ae72-5cc6-4f15-a16f-ef9478b0cd0e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:32.432487 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:32.463175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4135b42-7658-4a92-8c6e-9b18fe17ae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:32.464203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4135b42-7658-4a92-8c6e-9b18fe17ae60 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:32.464702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4135b42-7658-4a92-8c6e-9b18fe17ae60 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:32.465112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4135b42-7658-4a92-8c6e-9b18fe17ae60 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:32.465997 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4135b42-7658-4a92-8c6e-9b18fe17ae60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:32.466434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4135b42-7658-4a92-8c6e-9b18fe17ae60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:32.468187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4135b42-7658-4a92-8c6e-9b18fe17ae60 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:32.482145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 158/313] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:32.483606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4135b42-7658-4a92-8c6e-9b18fe17ae60 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:32.521054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c2000-65ee-426d-a336-8d47634ceeb4 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:32.556792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce1096-4ebb-4cf6-ae24-6944d207524b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:32.557715 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce1096-4ebb-4cf6-ae24-6944d207524b None admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:32.558036 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce1096-4ebb-4cf6-ae24-6944d207524b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:32.558313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce1096-4ebb-4cf6-ae24-6944d207524b None admin] PATH_INFO: `/v3/system/users/b23ea26f70004bc09cccf48e86f48905/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:32.559879 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce1096-4ebb-4cf6-ae24-6944d207524b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b23ea26f70004bc09cccf48e86f48905, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:32.561921 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce1096-4ebb-4cf6-ae24-6944d207524b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:32.566842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:32.582843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 156/314] 10.222.0.26 () {58 vars in 1334 bytes} [Thu Jun 30 03:35:32 2022] PUT /identity/v3/system/users/b23ea26f70004bc09cccf48e86f48905/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:35:32.597849 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4135b42-7658-4a92-8c6e-9b18fe17ae60 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:32.642725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3aa42-7ee7-45fa-8654-7149217aa196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:32.644067 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3aa42-7ee7-45fa-8654-7149217aa196 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:32.644558 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3aa42-7ee7-45fa-8654-7149217aa196 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:32.645040 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3aa42-7ee7-45fa-8654-7149217aa196 None admin] PATH_INFO: `/v3/users/7a926807f5ab478d8c1d1fa032e02d7b` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:32.646651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3aa42-7ee7-45fa-8654-7149217aa196 None admin] RBAC: Authorizing `identity:get_user(user_id=7a926807f5ab478d8c1d1fa032e02d7b)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:32.648423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3aa42-7ee7-45fa-8654-7149217aa196 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:32.655916 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 159/315] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:32 2022] GET /identity/v3/users/7a926807f5ab478d8c1d1fa032e02d7b => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:32.657748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce1096-4ebb-4cf6-ae24-6944d207524b None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:32.755138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:32.776654 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce1096-4ebb-4cf6-ae24-6944d207524b None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:32.811927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b3132-2e0b-46e8-93c7-1e8a9cc00a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:32.812503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b3132-2e0b-46e8-93c7-1e8a9cc00a84 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:32.812786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b3132-2e0b-46e8-93c7-1e8a9cc00a84 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:32.813063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b3132-2e0b-46e8-93c7-1e8a9cc00a84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:32.886742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b3132-2e0b-46e8-93c7-1e8a9cc00a84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:32.888277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b3132-2e0b-46e8-93c7-1e8a9cc00a84 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:32.974623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:33.001878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 157/316] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:33.003305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3aa42-7ee7-45fa-8654-7149217aa196 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:33.110003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3aa42-7ee7-45fa-8654-7149217aa196 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:33.150584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af2a90-b956-46fb-960d-c9860389a2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:33.151524 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2a90-b956-46fb-960d-c9860389a2a5 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:33.151810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2a90-b956-46fb-960d-c9860389a2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:33.152091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2a90-b956-46fb-960d-c9860389a2a5 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:33.153326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af2a90-b956-46fb-960d-c9860389a2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:33.154901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af2a90-b956-46fb-960d-c9860389a2a5 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:33.158938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 160/317] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:33 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:33.163043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b3132-2e0b-46e8-93c7-1e8a9cc00a84 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:33.269183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b3132-2e0b-46e8-93c7-1e8a9cc00a84 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:33.304355 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff4cfb-102e-4488-97c2-8c01bbd86782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:33.305074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff4cfb-102e-4488-97c2-8c01bbd86782 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:33.305359 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff4cfb-102e-4488-97c2-8c01bbd86782 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:33.305688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff4cfb-102e-4488-97c2-8c01bbd86782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:33.306524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff4cfb-102e-4488-97c2-8c01bbd86782 None admin] RBAC: Adding query filter params (role.id=fd5b8ebb128748d5b34cc4fa37a3d1e8, scope.project.id=398973d672844da38a2cfaf6f5093a9e, user.id=7a926807f5ab478d8c1d1fa032e02d7b) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:33.306861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff4cfb-102e-4488-97c2-8c01bbd86782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:33.308315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff4cfb-102e-4488-97c2-8c01bbd86782 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:33.314684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 158/318] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:33 2022] GET /identity/v3/role_assignments?user.id=7a926807f5ab478d8c1d1fa032e02d7b&scope.project.id=398973d672844da38a2cfaf6f5093a9e&role.id=fd5b8ebb128748d5b34cc4fa37a3d1e8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:33.332710 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c9227-eed5-4e30-9c1e-d3b99da358a3 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:33.333054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c9227-eed5-4e30-9c1e-d3b99da358a3 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:33.333251 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c9227-eed5-4e30-9c1e-d3b99da358a3 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:33.334723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 161/319] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:33.340975 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f66b8-9455-4f35-b5c7-8fb67030cf47 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:33.341287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f66b8-9455-4f35-b5c7-8fb67030cf47 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:33.341533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f66b8-9455-4f35-b5c7-8fb67030cf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:33.362625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6b9f66b8-9455-4f35-b5c7-8fb67030cf47 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:33.363811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6b9f66b8-9455-4f35-b5c7-8fb67030cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:33.409612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:33.439533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 159/320] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:33.463053 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c9227-eed5-4e30-9c1e-d3b99da358a3 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:33.484163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:33.573755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c9227-eed5-4e30-9c1e-d3b99da358a3 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:33.597764 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e594b8-461d-435c-b8d6-ee9299140370 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:33.598378 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e594b8-461d-435c-b8d6-ee9299140370 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:33.598722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e594b8-461d-435c-b8d6-ee9299140370 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:33.600796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 160/321] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:33.605741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e96ad-5339-4b6d-a7ca-8fbd3a44fc45 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:33.606113 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e96ad-5339-4b6d-a7ca-8fbd3a44fc45 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:33.606280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e96ad-5339-4b6d-a7ca-8fbd3a44fc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:33.609456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2919a-6858-4037-9206-eee5900277cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:33.610321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2919a-6858-4037-9206-eee5900277cc None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:33.610608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2919a-6858-4037-9206-eee5900277cc None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:33.610912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2919a-6858-4037-9206-eee5900277cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:33.613149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2919a-6858-4037-9206-eee5900277cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:33.614616 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2919a-6858-4037-9206-eee5900277cc None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:33.621115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 162/322] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:33.622421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2919a-6858-4037-9206-eee5900277cc None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:33.623548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-d90e96ad-5339-4b6d-a7ca-8fbd3a44fc45 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:33.624782 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d90e96ad-5339-4b6d-a7ca-8fbd3a44fc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:33.699682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 161/323] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:33.717842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:33.721852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e96ad-5339-4b6d-a7ca-8fbd3a44fc45 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:33.738166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2919a-6858-4037-9206-eee5900277cc None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:33.775324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a5000-0916-422d-859e-3fe4b7870ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:33.775992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a5000-0916-422d-859e-3fe4b7870ea7 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:33.776270 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a5000-0916-422d-859e-3fe4b7870ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:33.776540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a5000-0916-422d-859e-3fe4b7870ea7 None admin] PATH_INFO: `/v3/groups` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:33.777241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a5000-0916-422d-859e-3fe4b7870ea7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:33.778689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a5000-0916-422d-859e-3fe4b7870ea7 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:33.794207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 163/324] 10.222.0.26 () {60 vars in 1134 bytes} [Thu Jun 30 03:35:33 2022] POST /identity/v3/groups => generated 226 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:35:33.838940 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e96ad-5339-4b6d-a7ca-8fbd3a44fc45 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:33.841648 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:33.889654 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb0ea4-2d80-446c-9541-98a051494be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:33.890480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb0ea4-2d80-446c-9541-98a051494be4 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:33.890781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb0ea4-2d80-446c-9541-98a051494be4 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:33.891066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb0ea4-2d80-446c-9541-98a051494be4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:33.903679 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb0ea4-2d80-446c-9541-98a051494be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-97cb0ea4-2d80-446c-9541-98a051494be4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:33.911749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:33.912701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:33.918657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:33.918657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:33.918657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:33.918657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:33.918657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:33.918657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:33.918657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:33.918657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:33.918657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:33.918657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:33.918657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:33.918657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:33.918657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 162/325] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:35:33.919758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a5000-0916-422d-859e-3fe4b7870ea7 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:34.025224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a5000-0916-422d-859e-3fe4b7870ea7 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:34.061762 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359bff2-8c8c-48c8-97a9-ec4a10aec063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:34.062439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359bff2-8c8c-48c8-97a9-ec4a10aec063 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:34.062725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359bff2-8c8c-48c8-97a9-ec4a10aec063 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:34.063030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359bff2-8c8c-48c8-97a9-ec4a10aec063 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:34.063794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359bff2-8c8c-48c8-97a9-ec4a10aec063 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:34.064102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359bff2-8c8c-48c8-97a9-ec4a10aec063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:34.065506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359bff2-8c8c-48c8-97a9-ec4a10aec063 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:34.075462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 164/326] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:34.081225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb0ea4-2d80-446c-9541-98a051494be4 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:34.187102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb0ea4-2d80-446c-9541-98a051494be4 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:34.222117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef091d74-6bc6-47e2-b928-cf6930abe068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:34.223089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef091d74-6bc6-47e2-b928-cf6930abe068 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:34.223372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef091d74-6bc6-47e2-b928-cf6930abe068 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:34.223643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef091d74-6bc6-47e2-b928-cf6930abe068 None admin] PATH_INFO: `/v3/users/bee4ae1a7c874fdd8575fd5d07e2b471` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:34.224876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef091d74-6bc6-47e2-b928-cf6930abe068 None admin] RBAC: Authorizing `identity:get_user(user_id=bee4ae1a7c874fdd8575fd5d07e2b471)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:34.226685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef091d74-6bc6-47e2-b928-cf6930abe068 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:34.228799 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 163/327] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:34 2022] GET /identity/v3/users/bee4ae1a7c874fdd8575fd5d07e2b471 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:34.234637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359bff2-8c8c-48c8-97a9-ec4a10aec063 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:34.245751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:34.344854 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359bff2-8c8c-48c8-97a9-ec4a10aec063 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:34.392481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cad055-d2d0-4e40-bfa6-eef7772f398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:34.393359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cad055-d2d0-4e40-bfa6-eef7772f398a None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:34.393639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cad055-d2d0-4e40-bfa6-eef7772f398a None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:34.393914 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cad055-d2d0-4e40-bfa6-eef7772f398a None admin] PATH_INFO: `/v3/system/users/bee4ae1a7c874fdd8575fd5d07e2b471/roles/fd5b8ebb128748d5b34cc4fa37a3d1e8` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:34.395426 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cad055-d2d0-4e40-bfa6-eef7772f398a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bee4ae1a7c874fdd8575fd5d07e2b471, role_id=fd5b8ebb128748d5b34cc4fa37a3d1e8)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:34.396869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cad055-d2d0-4e40-bfa6-eef7772f398a None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:34.407971 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 165/328] 10.222.0.26 () {58 vars in 1334 bytes} [Thu Jun 30 03:35:34 2022] PUT /identity/v3/system/users/bee4ae1a7c874fdd8575fd5d07e2b471/roles/fd5b8ebb128748d5b34cc4fa37a3d1e8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:35:34.790258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df425e2d-8894-4173-b61a-e584b8795373 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:34.790656 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df425e2d-8894-4173-b61a-e584b8795373 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:34.790885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df425e2d-8894-4173-b61a-e584b8795373 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:34.792469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 164/329] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:34.797811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ebea4-df35-4897-8cb6-73ecca679906 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:34.798339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ebea4-df35-4897-8cb6-73ecca679906 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:34.798833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ebea4-df35-4897-8cb6-73ecca679906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:34.817424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-4b0ebea4-df35-4897-8cb6-73ecca679906 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:34.818992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4b0ebea4-df35-4897-8cb6-73ecca679906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:34.908862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:34.913781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 166/330] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:34.949460 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df425e2d-8894-4173-b61a-e584b8795373 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:34.996962 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:35.089192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df425e2d-8894-4173-b61a-e584b8795373 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:35.139382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3ae89-84e7-461b-b133-e90fe0129615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:35.140199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3ae89-84e7-461b-b133-e90fe0129615 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:35.140483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3ae89-84e7-461b-b133-e90fe0129615 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:35.140757 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3ae89-84e7-461b-b133-e90fe0129615 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:35.151711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3ae89-84e7-461b-b133-e90fe0129615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-5cd3ae89-84e7-461b-b133-e90fe0129615 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:35.159897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:35.160776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:35.161557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:35.161557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:35.161557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:35.161557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:35.161557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:35.161557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:35.161557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:35.161557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:35.161557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:35.161557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:35.161557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:35.161557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:35.161557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 165/331] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:35.167508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ebea4-df35-4897-8cb6-73ecca679906 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:35.306912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ebea4-df35-4897-8cb6-73ecca679906 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:35.350858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace432f6-ba26-477a-bf7d-16e3659f7ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:35.351549 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace432f6-ba26-477a-bf7d-16e3659f7ec8 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:35.351837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace432f6-ba26-477a-bf7d-16e3659f7ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:35.352117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace432f6-ba26-477a-bf7d-16e3659f7ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:35.353190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace432f6-ba26-477a-bf7d-16e3659f7ec8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:35.353499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace432f6-ba26-477a-bf7d-16e3659f7ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:35.355098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace432f6-ba26-477a-bf7d-16e3659f7ec8 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:35.366574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 167/332] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:35.371886 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3ae89-84e7-461b-b133-e90fe0129615 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:35.487907 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:35.500984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3ae89-84e7-461b-b133-e90fe0129615 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:35.545407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c84a1-db2c-4da5-89aa-07e0b6497018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:35.546666 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c84a1-db2c-4da5-89aa-07e0b6497018 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:35.547196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c84a1-db2c-4da5-89aa-07e0b6497018 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:35.547663 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c84a1-db2c-4da5-89aa-07e0b6497018 None admin] PATH_INFO: `/v3/users/b23ea26f70004bc09cccf48e86f48905` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:35.551463 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c84a1-db2c-4da5-89aa-07e0b6497018 None admin] RBAC: Authorizing `identity:get_user(user_id=b23ea26f70004bc09cccf48e86f48905)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:35.553135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c84a1-db2c-4da5-89aa-07e0b6497018 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:35.555404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 166/333] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:35 2022] GET /identity/v3/users/b23ea26f70004bc09cccf48e86f48905 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:35.561102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace432f6-ba26-477a-bf7d-16e3659f7ec8 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:35.679222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:35.730374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace432f6-ba26-477a-bf7d-16e3659f7ec8 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:35.774326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd13696-7c58-4d45-83f9-754aac4a5e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:35.775037 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd13696-7c58-4d45-83f9-754aac4a5e41 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:35.775321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd13696-7c58-4d45-83f9-754aac4a5e41 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:35.775596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd13696-7c58-4d45-83f9-754aac4a5e41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:35.776609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd13696-7c58-4d45-83f9-754aac4a5e41 None admin] RBAC: Adding query filter params (role.id=59a0f03d08fd401ebbd29ebd5f174abb, user.id=b23ea26f70004bc09cccf48e86f48905, scope.system=all) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:35.776925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd13696-7c58-4d45-83f9-754aac4a5e41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:35.778399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd13696-7c58-4d45-83f9-754aac4a5e41 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:35.794478 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 168/334] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jun 30 03:35:35 2022] GET /identity/v3/role_assignments?user.id=b23ea26f70004bc09cccf48e86f48905&scope.system=all&role.id=59a0f03d08fd401ebbd29ebd5f174abb => generated 510 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:36.740992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9b0f6-ee58-4639-b9a0-efe2a30678fb None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:36.741515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9b0f6-ee58-4639-b9a0-efe2a30678fb None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:36.741515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9b0f6-ee58-4639-b9a0-efe2a30678fb None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:36.743262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 167/335] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:36.748838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8634d63-e0ec-4505-a2db-1a446eca2500 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:36.749255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8634d63-e0ec-4505-a2db-1a446eca2500 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:36.749424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8634d63-e0ec-4505-a2db-1a446eca2500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:36.771852 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-b8634d63-e0ec-4505-a2db-1a446eca2500 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:36.773047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b8634d63-e0ec-4505-a2db-1a446eca2500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:36.865269 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 169/336] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:36.905437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9b0f6-ee58-4639-b9a0-efe2a30678fb None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:37.037752 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9b0f6-ee58-4639-b9a0-efe2a30678fb None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:37.077399 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c4c8b-38fb-4ba6-9ce5-6309f192afed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:37.078639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c4c8b-38fb-4ba6-9ce5-6309f192afed None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:37.079132 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c4c8b-38fb-4ba6-9ce5-6309f192afed None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:37.079621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c4c8b-38fb-4ba6-9ce5-6309f192afed None admin] PATH_INFO: `/v3/roles/member` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:37.094652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c4c8b-38fb-4ba6-9ce5-6309f192afed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:37.097718 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b17a8-9fc1-4580-8617-9d41001c7162 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:37.098261 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b17a8-9fc1-4580-8617-9d41001c7162 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:37.098735 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b17a8-9fc1-4580-8617-9d41001c7162 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:37.100922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 170/337] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-f17c4c8b-38fb-4ba6-9ce5-6309f192afed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:37.105885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:37.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:37.107621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:37.107621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:37.107621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:37.107621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:37.107621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:37.107621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:37.107621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:37.107621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:37.107621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:37.107621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:37.107621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:37.107621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:37.108232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cba2f-c168-462e-ab8d-c6b1349fbf6e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:37.108232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cba2f-c168-462e-ab8d-c6b1349fbf6e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:37.108232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cba2f-c168-462e-ab8d-c6b1349fbf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:37.110458 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 168/338] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:37.115852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c4c8b-38fb-4ba6-9ce5-6309f192afed None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:37.136806 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-f41cba2f-c168-462e-ab8d-c6b1349fbf6e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:37.138320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f41cba2f-c168-462e-ab8d-c6b1349fbf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:37.163959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:37.222430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:37.260749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 171/339] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:37.292728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c4c8b-38fb-4ba6-9ce5-6309f192afed None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:37.309655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cba2f-c168-462e-ab8d-c6b1349fbf6e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:37.334805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064ef4-86eb-4cd2-bbcf-d1b021b9f9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:37.334805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064ef4-86eb-4cd2-bbcf-d1b021b9f9c3 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:37.334805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064ef4-86eb-4cd2-bbcf-d1b021b9f9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:37.334805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064ef4-86eb-4cd2-bbcf-d1b021b9f9c3 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:37.335217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e064ef4-86eb-4cd2-bbcf-d1b021b9f9c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:37.335217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e064ef4-86eb-4cd2-bbcf-d1b021b9f9c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:37.335217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e064ef4-86eb-4cd2-bbcf-d1b021b9f9c3 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:37.344340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 169/340] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:37.356279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064ef4-86eb-4cd2-bbcf-d1b021b9f9c3 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:37.455353 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cba2f-c168-462e-ab8d-c6b1349fbf6e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:37.500381 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198c8a7-9bb0-47fa-ac61-d24cc56e5c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:37.501561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198c8a7-9bb0-47fa-ac61-d24cc56e5c8d None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:37.502033 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198c8a7-9bb0-47fa-ac61-d24cc56e5c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:37.502495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198c8a7-9bb0-47fa-ac61-d24cc56e5c8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:37.514357 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198c8a7-9bb0-47fa-ac61-d24cc56e5c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-d198c8a7-9bb0-47fa-ac61-d24cc56e5c8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:37.525492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:37.526411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:37.527234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:37.527234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:37.527234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:37.527234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:37.527234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:37.527234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:37.527234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:37.527234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:37.527234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:37.527234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:37.527234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:37.527234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:37.530099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 172/341] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:35:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:37.535572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198c8a7-9bb0-47fa-ac61-d24cc56e5c8d None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:37.576396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:37.646112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:37.649886 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064ef4-86eb-4cd2-bbcf-d1b021b9f9c3 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:37.655199 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198c8a7-9bb0-47fa-ac61-d24cc56e5c8d None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:37.690702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540245af-850d-450e-95d4-6865861bd46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:37.691855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540245af-850d-450e-95d4-6865861bd46c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:37.692349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540245af-850d-450e-95d4-6865861bd46c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:37.692806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540245af-850d-450e-95d4-6865861bd46c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:37.697725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2cb5b-f253-4836-ba5a-df45c6cd3f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:37.698430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2cb5b-f253-4836-ba5a-df45c6cd3f57 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:37.698718 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2cb5b-f253-4836-ba5a-df45c6cd3f57 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:37.699018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2cb5b-f253-4836-ba5a-df45c6cd3f57 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:37.699789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2cb5b-f253-4836-ba5a-df45c6cd3f57 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:37.700093 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2cb5b-f253-4836-ba5a-df45c6cd3f57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:37.701505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2cb5b-f253-4836-ba5a-df45c6cd3f57 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:37.713709 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 173/342] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:35:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:37.715103 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be8e5c-d451-4036-aae1-5d6b4b91fad8 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:37.715636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be8e5c-d451-4036-aae1-5d6b4b91fad8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:37.715920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be8e5c-d451-4036-aae1-5d6b4b91fad8 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:37.717856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 174/343] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:37.719040 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2670b-1085-48c1-aa02-99566ac10e34 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:37.719324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2670b-1085-48c1-aa02-99566ac10e34 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:37.719598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2670b-1085-48c1-aa02-99566ac10e34 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:37.721622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 175/344] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:37.726732 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e2834-9719-4f41-9c8b-d5f40f4be1a5 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:37.726732 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e2834-9719-4f41-9c8b-d5f40f4be1a5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:37.726732 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e2834-9719-4f41-9c8b-d5f40f4be1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:37.760644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-cb0e2834-9719-4f41-9c8b-d5f40f4be1a5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:37.762339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-cb0e2834-9719-4f41-9c8b-d5f40f4be1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:37.789308 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540245af-850d-450e-95d4-6865861bd46c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:37.791588 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540245af-850d-450e-95d4-6865861bd46c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:37.853592 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 176/345] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:37.855525 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e2834-9719-4f41-9c8b-d5f40f4be1a5 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:37.899963 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:37.917226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:37.953556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 170/346] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 03:35:37.959778 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d730-8ceb-408f-b217-6afadcf0e5d5 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:37.960059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d730-8ceb-408f-b217-6afadcf0e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:37.960331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d730-8ceb-408f-b217-6afadcf0e5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:37.984917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-86b2d730-8ceb-408f-b217-6afadcf0e5d5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:37.987148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-86b2d730-8ceb-408f-b217-6afadcf0e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:38.005922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e2834-9719-4f41-9c8b-d5f40f4be1a5 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:38.043498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370983cb-1c7d-411b-aab0-a7314ef8d385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:38.044502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370983cb-1c7d-411b-aab0-a7314ef8d385 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:38.045018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370983cb-1c7d-411b-aab0-a7314ef8d385 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:38.045572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370983cb-1c7d-411b-aab0-a7314ef8d385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:38.059597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 171/347] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:38.060467 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2d730-8ceb-408f-b217-6afadcf0e5d5 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:38.129954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370983cb-1c7d-411b-aab0-a7314ef8d385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:38.132466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370983cb-1c7d-411b-aab0-a7314ef8d385 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:38.179168 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:38.195054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2d730-8ceb-408f-b217-6afadcf0e5d5 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:38.209891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:38.231853 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580abbde-25ab-4eef-a2ef-89954c395cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:38.232667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580abbde-25ab-4eef-a2ef-89954c395cbb None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:38.232946 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580abbde-25ab-4eef-a2ef-89954c395cbb None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:38.233217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580abbde-25ab-4eef-a2ef-89954c395cbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:38.244234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580abbde-25ab-4eef-a2ef-89954c395cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-580abbde-25ab-4eef-a2ef-89954c395cbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:38.252164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:38.253123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:38.253918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:38.253918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:38.253918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:38.253918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:38.253918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:38.253918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:38.253918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:38.253918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:38.253918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:38.253918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:38.253918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:38.253918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:38.253918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 172/348] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:38.254586 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580abbde-25ab-4eef-a2ef-89954c395cbb None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:38.269072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 177/349] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:38.270280 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370983cb-1c7d-411b-aab0-a7314ef8d385 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:38.382291 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580abbde-25ab-4eef-a2ef-89954c395cbb None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:38.406294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370983cb-1c7d-411b-aab0-a7314ef8d385 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:38.424491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60049038-2c51-4458-9713-fe98b38b3f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:38.425374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60049038-2c51-4458-9713-fe98b38b3f1f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:38.425655 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60049038-2c51-4458-9713-fe98b38b3f1f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:38.434842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60049038-2c51-4458-9713-fe98b38b3f1f None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:38.434842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60049038-2c51-4458-9713-fe98b38b3f1f None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:38.434842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60049038-2c51-4458-9713-fe98b38b3f1f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:38.434842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 173/350] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:38 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:38.434842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b756cb-a420-4c0b-a92e-e72fd3583358 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:38.434842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b756cb-a420-4c0b-a92e-e72fd3583358 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:38.437104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b756cb-a420-4c0b-a92e-e72fd3583358 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:38.437104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 174/351] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:38.437104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b756cb-a420-4c0b-a92e-e72fd3583358 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:38.463053 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:38.469284 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb23ff5-e5d5-41ff-a046-c8ff3f31f349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:38.470390 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23ff5-e5d5-41ff-a046-c8ff3f31f349 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:38.470741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23ff5-e5d5-41ff-a046-c8ff3f31f349 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:38.471121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23ff5-e5d5-41ff-a046-c8ff3f31f349 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:38.490189 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb23ff5-e5d5-41ff-a046-c8ff3f31f349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-5cb23ff5-e5d5-41ff-a046-c8ff3f31f349 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:38.498598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:38.499601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:38.500365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:38.500365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:38.500365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:38.500365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:38.500365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:38.500365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:38.500365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:38.500365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:38.500365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:38.500365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:38.500365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 03:35:38.500365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:38.501332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:38.501426 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 178/352] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:38.502544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb23ff5-e5d5-41ff-a046-c8ff3f31f349 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:38.575844 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b756cb-a420-4c0b-a92e-e72fd3583358 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:38.617699 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab912165-675d-45fa-93e7-d1136a70766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:38.619917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab912165-675d-45fa-93e7-d1136a70766f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:38.619917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab912165-675d-45fa-93e7-d1136a70766f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:38.619917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab912165-675d-45fa-93e7-d1136a70766f None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:38.619917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab912165-675d-45fa-93e7-d1136a70766f None admin] RBAC: Adding query filter params (name=member) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:38.620312 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab912165-675d-45fa-93e7-d1136a70766f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:38.621819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab912165-675d-45fa-93e7-d1136a70766f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:38.633779 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 175/353] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:38.634895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab912165-675d-45fa-93e7-d1136a70766f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:38.641832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb23ff5-e5d5-41ff-a046-c8ff3f31f349 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:38.679828 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac2669-9d07-4cd1-aff5-9b1a98521e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:38.680767 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac2669-9d07-4cd1-aff5-9b1a98521e53 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:38.681050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac2669-9d07-4cd1-aff5-9b1a98521e53 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:38.681322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac2669-9d07-4cd1-aff5-9b1a98521e53 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:38.682632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac2669-9d07-4cd1-aff5-9b1a98521e53 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:38.684179 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac2669-9d07-4cd1-aff5-9b1a98521e53 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:38.685946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 179/354] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:38 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:38.687176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acbb01-c04c-467c-b1f5-d0fddda3f5dd None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:38.687451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acbb01-c04c-467c-b1f5-d0fddda3f5dd None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:38.687730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acbb01-c04c-467c-b1f5-d0fddda3f5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:38.704589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-84acbb01-c04c-467c-b1f5-d0fddda3f5dd None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:38.705782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-84acbb01-c04c-467c-b1f5-d0fddda3f5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:38.766377 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab912165-675d-45fa-93e7-d1136a70766f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:38.768928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:38.776588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:38.791888 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 180/355] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:38.793280 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acbb01-c04c-467c-b1f5-d0fddda3f5dd None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:38.817253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc74d5c-24e5-45e2-a16e-f763549be0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:38.818123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74d5c-24e5-45e2-a16e-f763549be0a8 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:38.818396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74d5c-24e5-45e2-a16e-f763549be0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:38.818662 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74d5c-24e5-45e2-a16e-f763549be0a8 None admin] PATH_INFO: `/v3/groups/8dd83df04f7f469396b26583e321905f` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:38.825781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc74d5c-24e5-45e2-a16e-f763549be0a8 None admin] RBAC: Authorizing `identity:get_group(group_id=8dd83df04f7f469396b26583e321905f)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:38.827322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc74d5c-24e5-45e2-a16e-f763549be0a8 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:38.829193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 176/356] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:38 2022] GET /identity/v3/groups/8dd83df04f7f469396b26583e321905f => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:38.829806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc74d5c-24e5-45e2-a16e-f763549be0a8 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:38.922745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acbb01-c04c-467c-b1f5-d0fddda3f5dd None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:38.948950 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc74d5c-24e5-45e2-a16e-f763549be0a8 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:38.967019 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc19a4e-83df-43e5-87d9-2991285cbf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:38.967708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc19a4e-83df-43e5-87d9-2991285cbf03 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:38.967985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc19a4e-83df-43e5-87d9-2991285cbf03 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:38.968752 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc19a4e-83df-43e5-87d9-2991285cbf03 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:38.969526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc19a4e-83df-43e5-87d9-2991285cbf03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:38.969833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc19a4e-83df-43e5-87d9-2991285cbf03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:38.971262 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc19a4e-83df-43e5-87d9-2991285cbf03 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:38.980560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 181/357] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:38.981230 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc19a4e-83df-43e5-87d9-2991285cbf03 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:38.994205 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ef99c-b186-49fe-a4ef-82014829d799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:38.994205 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ef99c-b186-49fe-a4ef-82014829d799 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:38.994593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ef99c-b186-49fe-a4ef-82014829d799 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:38.994937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ef99c-b186-49fe-a4ef-82014829d799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:39.036370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:39.042945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:39.082485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ef99c-b186-49fe-a4ef-82014829d799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:39.084029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ef99c-b186-49fe-a4ef-82014829d799 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:39.094487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc19a4e-83df-43e5-87d9-2991285cbf03 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:39.137333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca224f9-1664-49db-aabc-15ccd7a199b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:39.138336 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca224f9-1664-49db-aabc-15ccd7a199b0 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:39.138621 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca224f9-1664-49db-aabc-15ccd7a199b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:39.139074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca224f9-1664-49db-aabc-15ccd7a199b0 None admin] PATH_INFO: `/v3/groups/8dd83df04f7f469396b26583e321905f` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:39.140601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca224f9-1664-49db-aabc-15ccd7a199b0 None admin] RBAC: Authorizing `identity:get_group(group_id=8dd83df04f7f469396b26583e321905f)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:39.142224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca224f9-1664-49db-aabc-15ccd7a199b0 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:39.144054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 182/358] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:38 2022] GET /identity/v3/groups/8dd83df04f7f469396b26583e321905f => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:39.144652 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca224f9-1664-49db-aabc-15ccd7a199b0 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:39.207332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 177/359] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:39.208396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ef99c-b186-49fe-a4ef-82014829d799 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:39.261641 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca224f9-1664-49db-aabc-15ccd7a199b0 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:39.280553 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:39.283223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:39.299980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d9c89-54b5-472c-94f9-0e61c8f5eeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:39.300904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d9c89-54b5-472c-94f9-0e61c8f5eeed None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:39.301190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d9c89-54b5-472c-94f9-0e61c8f5eeed None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:39.301466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d9c89-54b5-472c-94f9-0e61c8f5eeed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:39.312636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d9c89-54b5-472c-94f9-0e61c8f5eeed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-ce3d9c89-54b5-472c-94f9-0e61c8f5eeed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:39.321028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:39.322314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:39.323157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:39.323157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:39.323157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:39.323157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:39.323157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:39.323157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:39.323157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:39.323157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:39.323157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:39.323157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:39.323157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:39.323157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:39.323157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 183/360] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:35:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:39.323808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78084279-7768-426a-925a-89024bcbd3ee None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:39.324381 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78084279-7768-426a-925a-89024bcbd3ee None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:39.324381 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78084279-7768-426a-925a-89024bcbd3ee None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:39.325601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 184/361] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:39.328393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78084279-7768-426a-925a-89024bcbd3ee None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:39.333092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ef99c-b186-49fe-a4ef-82014829d799 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:39.376992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d666d66-aee9-4698-bde1-c68424ae80ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:39.377659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d666d66-aee9-4698-bde1-c68424ae80ea None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:39.377944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d666d66-aee9-4698-bde1-c68424ae80ea None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:39.378223 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d666d66-aee9-4698-bde1-c68424ae80ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:39.379099 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d666d66-aee9-4698-bde1-c68424ae80ea None admin] RBAC: Adding query filter params (group.id=8dd83df04f7f469396b26583e321905f, role.id=59a0f03d08fd401ebbd29ebd5f174abb, scope.project.id=113460ea611c4df1b58899d547c12317) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:39.379901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d666d66-aee9-4698-bde1-c68424ae80ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:39.380869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d666d66-aee9-4698-bde1-c68424ae80ea None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:39.389039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 178/362] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 03:35:39 2022] GET /identity/v3/role_assignments?group.id=8dd83df04f7f469396b26583e321905f&scope.project.id=113460ea611c4df1b58899d547c12317&role.id=59a0f03d08fd401ebbd29ebd5f174abb => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:39.389950 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d666d66-aee9-4698-bde1-c68424ae80ea None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:39.458121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78084279-7768-426a-925a-89024bcbd3ee None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:39.506802 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3070e29-21e5-49ab-a9a3-ec7e425d2ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:39.508961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3070e29-21e5-49ab-a9a3-ec7e425d2ae7 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:39.508961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3070e29-21e5-49ab-a9a3-ec7e425d2ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:39.508961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3070e29-21e5-49ab-a9a3-ec7e425d2ae7 None admin] PATH_INFO: `/v3/users/bee4ae1a7c874fdd8575fd5d07e2b471` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:39.510175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3070e29-21e5-49ab-a9a3-ec7e425d2ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=bee4ae1a7c874fdd8575fd5d07e2b471)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:39.511739 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3070e29-21e5-49ab-a9a3-ec7e425d2ae7 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:39.514039 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 185/363] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:35:39 2022] GET /identity/v3/users/bee4ae1a7c874fdd8575fd5d07e2b471 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:39.514976 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3070e29-21e5-49ab-a9a3-ec7e425d2ae7 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:39.533491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d666d66-aee9-4698-bde1-c68424ae80ea None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:39.572166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:39.580145 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bb60c-f040-450a-9dd9-4c2e8a19d018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:39.580820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bb60c-f040-450a-9dd9-4c2e8a19d018 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:39.581101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bb60c-f040-450a-9dd9-4c2e8a19d018 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:39.581378 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bb60c-f040-450a-9dd9-4c2e8a19d018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:39.582219 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bb60c-f040-450a-9dd9-4c2e8a19d018 None admin] RBAC: Adding query filter params (group.id=8dd83df04f7f469396b26583e321905f, role.id=4af08bea19b94c2c863a51b103f50b8b, scope.project.id=113460ea611c4df1b58899d547c12317) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:39.582531 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bb60c-f040-450a-9dd9-4c2e8a19d018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:39.584027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bb60c-f040-450a-9dd9-4c2e8a19d018 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:39.590329 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 179/364] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 03:35:39 2022] GET /identity/v3/role_assignments?group.id=8dd83df04f7f469396b26583e321905f&scope.project.id=113460ea611c4df1b58899d547c12317&role.id=4af08bea19b94c2c863a51b103f50b8b => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:39.591177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bb60c-f040-450a-9dd9-4c2e8a19d018 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:39.607224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:39.662802 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3070e29-21e5-49ab-a9a3-ec7e425d2ae7 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:39.732864 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c463415-2cb5-40c3-8e95-f894699cd5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:39.733689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c463415-2cb5-40c3-8e95-f894699cd5e1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:39.733971 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c463415-2cb5-40c3-8e95-f894699cd5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:39.734250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c463415-2cb5-40c3-8e95-f894699cd5e1 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:39.735872 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c463415-2cb5-40c3-8e95-f894699cd5e1 None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:39.737350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c463415-2cb5-40c3-8e95-f894699cd5e1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:39.740162 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 186/365] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:39 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:39.741763 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846f10d-690f-4adb-bc97-005299781d73 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:39.742050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846f10d-690f-4adb-bc97-005299781d73 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:39.742335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846f10d-690f-4adb-bc97-005299781d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:39.743569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bb60c-f040-450a-9dd9-4c2e8a19d018 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:39.773057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-8846f10d-690f-4adb-bc97-005299781d73 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:39.774582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8846f10d-690f-4adb-bc97-005299781d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:39.797986 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff185230-c882-4416-85da-af637e6877d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:39.799098 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff185230-c882-4416-85da-af637e6877d6 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:39.800325 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff185230-c882-4416-85da-af637e6877d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:39.800802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff185230-c882-4416-85da-af637e6877d6 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:39.801786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff185230-c882-4416-85da-af637e6877d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:39.802308 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff185230-c882-4416-85da-af637e6877d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:39.803975 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff185230-c882-4416-85da-af637e6877d6 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:39.815015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 180/366] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:35:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:39.816378 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff185230-c882-4416-85da-af637e6877d6 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:39.863985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 187/367] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:39.864863 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846f10d-690f-4adb-bc97-005299781d73 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:39.895365 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:39.943271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:39.959060 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff185230-c882-4416-85da-af637e6877d6 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:39.998148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabfa9b-a3e5-44d5-85aa-097183b40216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:39.998724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabfa9b-a3e5-44d5-85aa-097183b40216 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:39.999035 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabfa9b-a3e5-44d5-85aa-097183b40216 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:39.999351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabfa9b-a3e5-44d5-85aa-097183b40216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:40.000184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabfa9b-a3e5-44d5-85aa-097183b40216 None admin] RBAC: Adding query filter params (role.id=fd5b8ebb128748d5b34cc4fa37a3d1e8, user.id=bee4ae1a7c874fdd8575fd5d07e2b471, scope.system=all) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:40.000585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabfa9b-a3e5-44d5-85aa-097183b40216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:40.004208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabfa9b-a3e5-44d5-85aa-097183b40216 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:40.011148 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846f10d-690f-4adb-bc97-005299781d73 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:40.026329 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 181/368] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jun 30 03:35:39 2022] GET /identity/v3/role_assignments?user.id=bee4ae1a7c874fdd8575fd5d07e2b471&scope.system=all&role.id=fd5b8ebb128748d5b34cc4fa37a3d1e8 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:40.027671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabfa9b-a3e5-44d5-85aa-097183b40216 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:40.064444 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45989b1c-aa6d-4bc3-8e43-b6fdf9c30a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:40.065473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45989b1c-aa6d-4bc3-8e43-b6fdf9c30a42 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:40.065756 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45989b1c-aa6d-4bc3-8e43-b6fdf9c30a42 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:40.066028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45989b1c-aa6d-4bc3-8e43-b6fdf9c30a42 None admin] PATH_INFO: `/v3/groups/8dd83df04f7f469396b26583e321905f` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:40.067389 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45989b1c-aa6d-4bc3-8e43-b6fdf9c30a42 None admin] RBAC: Authorizing `identity:get_group(group_id=8dd83df04f7f469396b26583e321905f)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:40.068956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45989b1c-aa6d-4bc3-8e43-b6fdf9c30a42 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:40.071142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 188/369] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:39 2022] GET /identity/v3/groups/8dd83df04f7f469396b26583e321905f => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:40.071940 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45989b1c-aa6d-4bc3-8e43-b6fdf9c30a42 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:40.205122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabfa9b-a3e5-44d5-85aa-097183b40216 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:40.238104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:40.260639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45989b1c-aa6d-4bc3-8e43-b6fdf9c30a42 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:40.280018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea53cd1-ded8-442d-acee-02c4a7b8b473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:40.280680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:40.280785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea53cd1-ded8-442d-acee-02c4a7b8b473 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:40.281022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea53cd1-ded8-442d-acee-02c4a7b8b473 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:40.281292 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea53cd1-ded8-442d-acee-02c4a7b8b473 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:40.317789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c44058-b0df-4fe9-b611-6d202615f6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:40.318610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c44058-b0df-4fe9-b611-6d202615f6be None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:40.318919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c44058-b0df-4fe9-b611-6d202615f6be None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:40.319193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c44058-b0df-4fe9-b611-6d202615f6be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:40.342459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c44058-b0df-4fe9-b611-6d202615f6be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-a0c44058-b0df-4fe9-b611-6d202615f6be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:40.350495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:40.351397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:40.352317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:40.352317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:40.352317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:40.352317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:40.352317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:40.352317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:40.352317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:40.352317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:40.352317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:40.352317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:40.352317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:40.352317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:40.352317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 189/370] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:35:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:40.353185 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c44058-b0df-4fe9-b611-6d202615f6be None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:40.382103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea53cd1-ded8-442d-acee-02c4a7b8b473 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:40.384106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea53cd1-ded8-442d-acee-02c4a7b8b473 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:40.466963 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c44058-b0df-4fe9-b611-6d202615f6be None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:40.501309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71ce65-767c-4465-bdbb-be786aa35734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:40.502285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71ce65-767c-4465-bdbb-be786aa35734 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:40.502285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71ce65-767c-4465-bdbb-be786aa35734 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:40.502536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71ce65-767c-4465-bdbb-be786aa35734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:40.503371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71ce65-767c-4465-bdbb-be786aa35734 None admin] RBAC: Adding query filter params (group.id=8dd83df04f7f469396b26583e321905f, role.id=59a0f03d08fd401ebbd29ebd5f174abb, scope.project.id=398973d672844da38a2cfaf6f5093a9e) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:40.503683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71ce65-767c-4465-bdbb-be786aa35734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:40.505131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71ce65-767c-4465-bdbb-be786aa35734 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:40.510823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 190/371] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 03:35:40 2022] GET /identity/v3/role_assignments?group.id=8dd83df04f7f469396b26583e321905f&scope.project.id=398973d672844da38a2cfaf6f5093a9e&role.id=59a0f03d08fd401ebbd29ebd5f174abb => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:40.511582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71ce65-767c-4465-bdbb-be786aa35734 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:40.547584 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 182/372] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:40.556280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea53cd1-ded8-442d-acee-02c4a7b8b473 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:40.558190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:40.575063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:40.646834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71ce65-767c-4465-bdbb-be786aa35734 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:40.678558 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea53cd1-ded8-442d-acee-02c4a7b8b473 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:40.694270 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7d4f8-1253-4cc7-9966-4e7064c35f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:40.695521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d4f8-1253-4cc7-9966-4e7064c35f77 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:40.696764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d4f8-1253-4cc7-9966-4e7064c35f77 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:40.697315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d4f8-1253-4cc7-9966-4e7064c35f77 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:40.698361 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7d4f8-1253-4cc7-9966-4e7064c35f77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:40.698937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7d4f8-1253-4cc7-9966-4e7064c35f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:40.700793 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7d4f8-1253-4cc7-9966-4e7064c35f77 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:40.719904 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28c0fb-7d4d-4845-a387-7fa5d182c0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:40.720583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 191/373] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:40.722193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28c0fb-7d4d-4845-a387-7fa5d182c0f9 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:40.722193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28c0fb-7d4d-4845-a387-7fa5d182c0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:40.722193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28c0fb-7d4d-4845-a387-7fa5d182c0f9 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:40.722598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28c0fb-7d4d-4845-a387-7fa5d182c0f9 None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:40.724092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28c0fb-7d4d-4845-a387-7fa5d182c0f9 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:40.725868 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7d4f8-1253-4cc7-9966-4e7064c35f77 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:40.726469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 183/374] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:40 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:40.731909 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28c0fb-7d4d-4845-a387-7fa5d182c0f9 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:40.823252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:40.844449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28c0fb-7d4d-4845-a387-7fa5d182c0f9 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:40.868830 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:40.872346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7d4f8-1253-4cc7-9966-4e7064c35f77 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:40.883406 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f7b3f-3fb1-4cdd-b3e8-78c1d1f2a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:40.884757 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f7b3f-3fb1-4cdd-b3e8-78c1d1f2a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:40.884757 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f7b3f-3fb1-4cdd-b3e8-78c1d1f2a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:40.884898 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f7b3f-3fb1-4cdd-b3e8-78c1d1f2a4b4 None admin] PATH_INFO: `/v3/groups/8dd83df04f7f469396b26583e321905f` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:40.886126 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f7b3f-3fb1-4cdd-b3e8-78c1d1f2a4b4 None admin] RBAC: Authorizing `identity:get_group(group_id=8dd83df04f7f469396b26583e321905f)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:40.887748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f7b3f-3fb1-4cdd-b3e8-78c1d1f2a4b4 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:40.889756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 184/375] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:40 2022] GET /identity/v3/groups/8dd83df04f7f469396b26583e321905f => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:40.895585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f7b3f-3fb1-4cdd-b3e8-78c1d1f2a4b4 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:40.913522 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f851f-0ae2-41ad-9783-d6c5859d2db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:40.914747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f851f-0ae2-41ad-9783-d6c5859d2db8 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:40.915730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f851f-0ae2-41ad-9783-d6c5859d2db8 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:40.916216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f851f-0ae2-41ad-9783-d6c5859d2db8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:40.991237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f851f-0ae2-41ad-9783-d6c5859d2db8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:40.993714 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f851f-0ae2-41ad-9783-d6c5859d2db8 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:41.003843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f7b3f-3fb1-4cdd-b3e8-78c1d1f2a4b4 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:41.043994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe640fa2-023f-4948-bf4e-ed9040de82b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:41.044622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe640fa2-023f-4948-bf4e-ed9040de82b2 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:41.044905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe640fa2-023f-4948-bf4e-ed9040de82b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:41.045178 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe640fa2-023f-4948-bf4e-ed9040de82b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:41.046026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe640fa2-023f-4948-bf4e-ed9040de82b2 None admin] RBAC: Adding query filter params (group.id=8dd83df04f7f469396b26583e321905f, role.id=4af08bea19b94c2c863a51b103f50b8b, scope.project.id=398973d672844da38a2cfaf6f5093a9e) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:41.046328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe640fa2-023f-4948-bf4e-ed9040de82b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:41.047944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe640fa2-023f-4948-bf4e-ed9040de82b2 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:41.057380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 185/376] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 03:35:40 2022] GET /identity/v3/role_assignments?group.id=8dd83df04f7f469396b26583e321905f&scope.project.id=398973d672844da38a2cfaf6f5093a9e&role.id=4af08bea19b94c2c863a51b103f50b8b => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:41.105955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:41.110571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 192/377] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:41.115960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe640fa2-023f-4948-bf4e-ed9040de82b2 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:41.138016 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:41.257688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe640fa2-023f-4948-bf4e-ed9040de82b2 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:41.297466 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763babe9-6bcc-4a9d-ac24-1d7f64bc0d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:41.298341 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763babe9-6bcc-4a9d-ac24-1d7f64bc0d6f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:41.298619 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763babe9-6bcc-4a9d-ac24-1d7f64bc0d6f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:41.298917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763babe9-6bcc-4a9d-ac24-1d7f64bc0d6f None admin] PATH_INFO: `/v3/projects/26fd4a4f105a4803a50f2696df78fba5` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:41.303522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763babe9-6bcc-4a9d-ac24-1d7f64bc0d6f None admin] RBAC: Authorizing `identity:get_project(project_id=26fd4a4f105a4803a50f2696df78fba5)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:41.305128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763babe9-6bcc-4a9d-ac24-1d7f64bc0d6f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:41.307477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 186/378] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:41 2022] GET /identity/v3/projects/26fd4a4f105a4803a50f2696df78fba5 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:41.312748 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f851f-0ae2-41ad-9783-d6c5859d2db8 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:41.440425 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f851f-0ae2-41ad-9783-d6c5859d2db8 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:41.483334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf07c1-fe96-4693-9a95-24c3ad4f0792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:41.484449 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf07c1-fe96-4693-9a95-24c3ad4f0792 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:41.484901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf07c1-fe96-4693-9a95-24c3ad4f0792 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:41.485318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf07c1-fe96-4693-9a95-24c3ad4f0792 None admin] PATH_INFO: `/v3/groups/46f1f0cf2e8a4743a17272d6d5999874` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:41.492178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf07c1-fe96-4693-9a95-24c3ad4f0792 None admin] RBAC: Authorizing `identity:get_group(group_id=46f1f0cf2e8a4743a17272d6d5999874)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:41.494569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf07c1-fe96-4693-9a95-24c3ad4f0792 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:41.497013 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 193/379] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:41 2022] GET /identity/v3/groups/46f1f0cf2e8a4743a17272d6d5999874 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:41.502454 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763babe9-6bcc-4a9d-ac24-1d7f64bc0d6f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:41.591673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:41.620380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763babe9-6bcc-4a9d-ac24-1d7f64bc0d6f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:41.669441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0024d-f137-456f-a8db-a572b1863da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:41.670398 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0024d-f137-456f-a8db-a572b1863da4 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:41.670859 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0024d-f137-456f-a8db-a572b1863da4 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:41.671303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0024d-f137-456f-a8db-a572b1863da4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:41.672304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0024d-f137-456f-a8db-a572b1863da4 None admin] RBAC: Adding query filter params (group.id=46f1f0cf2e8a4743a17272d6d5999874, role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=26fd4a4f105a4803a50f2696df78fba5) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:41.672777 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0024d-f137-456f-a8db-a572b1863da4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:41.674490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0024d-f137-456f-a8db-a572b1863da4 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:41.688533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 187/380] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 03:35:41 2022] GET /identity/v3/role_assignments?group.id=46f1f0cf2e8a4743a17272d6d5999874&scope.project.id=26fd4a4f105a4803a50f2696df78fba5&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:41.741938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ef3d-2049-4103-84f3-f5b7afaceab4 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:41.742131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ef3d-2049-4103-84f3-f5b7afaceab4 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:41.742461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ef3d-2049-4103-84f3-f5b7afaceab4 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:41.744919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 194/381] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:41.750831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571fe30-b8bf-4156-afa9-e9e1fe07d8e8 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:41.751254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571fe30-b8bf-4156-afa9-e9e1fe07d8e8 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:41.751631 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571fe30-b8bf-4156-afa9-e9e1fe07d8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:41.770273 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6571fe30-b8bf-4156-afa9-e9e1fe07d8e8 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:41.771525 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6571fe30-b8bf-4156-afa9-e9e1fe07d8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:41.869319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 188/382] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:41.897977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50ef3d-2049-4103-84f3-f5b7afaceab4 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:41.974108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:42.028225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50ef3d-2049-4103-84f3-f5b7afaceab4 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:42.070846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571872a8-2241-4135-9eab-8f29ef89afd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:42.071704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571872a8-2241-4135-9eab-8f29ef89afd3 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:42.071989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571872a8-2241-4135-9eab-8f29ef89afd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:42.072268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571872a8-2241-4135-9eab-8f29ef89afd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:42.084867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571872a8-2241-4135-9eab-8f29ef89afd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-571872a8-2241-4135-9eab-8f29ef89afd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:42.093003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:42.093939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:42.094789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:42.094789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:42.094789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:42.094789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:42.094789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:42.094789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:42.094789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:42.094789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:42.094789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:42.094789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:42.094789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:42.094789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:42.097974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 195/383] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:42.101038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571fe30-b8bf-4156-afa9-e9e1fe07d8e8 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:42.200701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:42.232953 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571fe30-b8bf-4156-afa9-e9e1fe07d8e8 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:42.277967 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d62ab-6003-4d90-9567-aa400b500da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:42.278710 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d62ab-6003-4d90-9567-aa400b500da1 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:42.278967 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d62ab-6003-4d90-9567-aa400b500da1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:42.279250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d62ab-6003-4d90-9567-aa400b500da1 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:42.280005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d62ab-6003-4d90-9567-aa400b500da1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:42.280312 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d62ab-6003-4d90-9567-aa400b500da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:42.281709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d62ab-6003-4d90-9567-aa400b500da1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:42.290878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 189/384] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:42.296228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571872a8-2241-4135-9eab-8f29ef89afd3 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:42.380055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a3e74-f70c-48c8-9b94-6724dd2ca61f None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:42.380400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a3e74-f70c-48c8-9b94-6724dd2ca61f None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:42.380615 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a3e74-f70c-48c8-9b94-6724dd2ca61f None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:42.381992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 190/385] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:42.389435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d3c2-b173-4b5d-bd1f-4791ed12d77b None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:42.389958 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d3c2-b173-4b5d-bd1f-4791ed12d77b None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:42.390436 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d3c2-b173-4b5d-bd1f-4791ed12d77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:42.411101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-8b50d3c2-b173-4b5d-bd1f-4791ed12d77b None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:42.412614 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8b50d3c2-b173-4b5d-bd1f-4791ed12d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:42.497577 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 191/386] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:42.510167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571872a8-2241-4135-9eab-8f29ef89afd3 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:42.525586 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d3c2-b173-4b5d-bd1f-4791ed12d77b None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:42.552088 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:42.580943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3737eda-7647-4ad3-a3a6-a1e740d35c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:42.581829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3737eda-7647-4ad3-a3a6-a1e740d35c16 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:42.582111 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3737eda-7647-4ad3-a3a6-a1e740d35c16 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:42.582385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3737eda-7647-4ad3-a3a6-a1e740d35c16 None admin] PATH_INFO: `/v3/groups/8dd83df04f7f469396b26583e321905f` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:42.583716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3737eda-7647-4ad3-a3a6-a1e740d35c16 None admin] RBAC: Authorizing `identity:get_group(group_id=8dd83df04f7f469396b26583e321905f)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:42.585258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3737eda-7647-4ad3-a3a6-a1e740d35c16 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:42.587022 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 196/387] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:42 2022] GET /identity/v3/groups/8dd83df04f7f469396b26583e321905f => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:42.598914 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3737eda-7647-4ad3-a3a6-a1e740d35c16 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:42.621030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:42.678201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d3c2-b173-4b5d-bd1f-4791ed12d77b None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:42.740275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5ea65-270a-46dc-92de-b3262bcb2202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:42.741529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5ea65-270a-46dc-92de-b3262bcb2202 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:42.742007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5ea65-270a-46dc-92de-b3262bcb2202 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:42.742541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5ea65-270a-46dc-92de-b3262bcb2202 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:42.765936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5ea65-270a-46dc-92de-b3262bcb2202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-e1a5ea65-270a-46dc-92de-b3262bcb2202 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:42.776809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:42.777761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:42.778546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:42.778546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:42.778546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:42.778546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:42.778546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:42.778546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:42.778546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:42.778546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:42.778546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:42.778546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:42.778546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:42.778546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:42.798664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 192/388] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:35:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:35:42.804867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3737eda-7647-4ad3-a3a6-a1e740d35c16 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:42.808728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5ea65-270a-46dc-92de-b3262bcb2202 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:42.869580 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40735542-504a-4ed0-8e8e-3678f62e8988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:42.870876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40735542-504a-4ed0-8e8e-3678f62e8988 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:42.871477 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40735542-504a-4ed0-8e8e-3678f62e8988 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:42.871949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40735542-504a-4ed0-8e8e-3678f62e8988 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:42.873366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40735542-504a-4ed0-8e8e-3678f62e8988 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:42.875208 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40735542-504a-4ed0-8e8e-3678f62e8988 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:42.877534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 197/389] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:42 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:42.884460 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40735542-504a-4ed0-8e8e-3678f62e8988 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:42.952790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:42.995342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40735542-504a-4ed0-8e8e-3678f62e8988 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:43.002335 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5ea65-270a-46dc-92de-b3262bcb2202 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:43.033258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c5f0c-4c0f-4210-a860-98f921e792c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:43.034539 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c5f0c-4c0f-4210-a860-98f921e792c4 None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:43.035077 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c5f0c-4c0f-4210-a860-98f921e792c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:43.035587 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c5f0c-4c0f-4210-a860-98f921e792c4 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317/groups/8dd83df04f7f469396b26583e321905f/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:43.038335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c5f0c-4c0f-4210-a860-98f921e792c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=113460ea611c4df1b58899d547c12317, group_id=8dd83df04f7f469396b26583e321905f, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:43.040742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c5f0c-4c0f-4210-a860-98f921e792c4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:43.046678 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:43.059237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 198/390] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 30 03:35:42 2022] PUT /identity/v3/projects/113460ea611c4df1b58899d547c12317/groups/8dd83df04f7f469396b26583e321905f/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:35:43.067683 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d78a3c-7c91-40aa-9b78-0bb97f9725ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:43.068399 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d78a3c-7c91-40aa-9b78-0bb97f9725ff None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:43.068685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d78a3c-7c91-40aa-9b78-0bb97f9725ff None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:43.068956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d78a3c-7c91-40aa-9b78-0bb97f9725ff None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:43.069738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d78a3c-7c91-40aa-9b78-0bb97f9725ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:43.070042 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d78a3c-7c91-40aa-9b78-0bb97f9725ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:43.071604 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d78a3c-7c91-40aa-9b78-0bb97f9725ff None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:43.087252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 193/391] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:35:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:43.092829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c5f0c-4c0f-4210-a860-98f921e792c4 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:43.163978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770b50c-63e2-4359-b205-6f8d78e69a4a None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:43.164797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770b50c-63e2-4359-b205-6f8d78e69a4a None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:43.164797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770b50c-63e2-4359-b205-6f8d78e69a4a None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:43.171275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 194/392] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:35:43.172233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc831ab-2e51-4e1f-8e2d-a7bcdc8a64eb None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:43.172514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc831ab-2e51-4e1f-8e2d-a7bcdc8a64eb None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:43.172793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc831ab-2e51-4e1f-8e2d-a7bcdc8a64eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:43.191351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-9fc831ab-2e51-4e1f-8e2d-a7bcdc8a64eb None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:43.192570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9fc831ab-2e51-4e1f-8e2d-a7bcdc8a64eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:43.263705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c5f0c-4c0f-4210-a860-98f921e792c4 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:43.288760 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:43.304587 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 195/393] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:43.306086 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd887652-b038-45cb-a84a-78e00c4038e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:43.307293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd887652-b038-45cb-a84a-78e00c4038e2 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:43.307789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd887652-b038-45cb-a84a-78e00c4038e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:43.308268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd887652-b038-45cb-a84a-78e00c4038e2 None admin] PATH_INFO: `/v3/groups/8dd83df04f7f469396b26583e321905f` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:43.309742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd887652-b038-45cb-a84a-78e00c4038e2 None admin] RBAC: Authorizing `identity:get_group(group_id=8dd83df04f7f469396b26583e321905f)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:43.311579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd887652-b038-45cb-a84a-78e00c4038e2 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:43.313725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 199/394] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:43 2022] GET /identity/v3/groups/8dd83df04f7f469396b26583e321905f => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:43.322848 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc831ab-2e51-4e1f-8e2d-a7bcdc8a64eb None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:43.331195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd887652-b038-45cb-a84a-78e00c4038e2 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:43.449789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd887652-b038-45cb-a84a-78e00c4038e2 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:43.472794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc831ab-2e51-4e1f-8e2d-a7bcdc8a64eb None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:43.491199 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f70b3d-8ba3-4f8e-a6b0-c18445ee6829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:43.492102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f70b3d-8ba3-4f8e-a6b0-c18445ee6829 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:43.492580 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f70b3d-8ba3-4f8e-a6b0-c18445ee6829 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:43.493505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f70b3d-8ba3-4f8e-a6b0-c18445ee6829 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:43.501259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:43.505301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f70b3d-8ba3-4f8e-a6b0-c18445ee6829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-05f70b3d-8ba3-4f8e-a6b0-c18445ee6829 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:43.515193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:43.516117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:43.517212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:43.517212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:43.517212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:43.517212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:43.517212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:43.517212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:43.517212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:43.517212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:43.517212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:43.517212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:43.517212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:43.517212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:43.517212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 200/395] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:35:43.520362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03604976-0b70-472e-bd9b-3e4779aefced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:43.521522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604976-0b70-472e-bd9b-3e4779aefced None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:43.521982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604976-0b70-472e-bd9b-3e4779aefced None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:43.522423 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604976-0b70-472e-bd9b-3e4779aefced None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:43.522704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f70b3d-8ba3-4f8e-a6b0-c18445ee6829 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:43.524050 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03604976-0b70-472e-bd9b-3e4779aefced None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:43.525680 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03604976-0b70-472e-bd9b-3e4779aefced None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:43.529275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 196/396] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:43 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:43.534444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03604976-0b70-472e-bd9b-3e4779aefced None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:43.580128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:43.640269 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f70b3d-8ba3-4f8e-a6b0-c18445ee6829 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:43.672849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03604976-0b70-472e-bd9b-3e4779aefced None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:43.683606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626f9a4-3a29-4bda-bea4-46562cd5cc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:43.684350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626f9a4-3a29-4bda-bea4-46562cd5cc04 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:43.684638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626f9a4-3a29-4bda-bea4-46562cd5cc04 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:43.684966 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626f9a4-3a29-4bda-bea4-46562cd5cc04 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:43.685745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626f9a4-3a29-4bda-bea4-46562cd5cc04 None admin] RBAC: Adding query filter params (name=member) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:43.686061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626f9a4-3a29-4bda-bea4-46562cd5cc04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:43.687495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626f9a4-3a29-4bda-bea4-46562cd5cc04 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:43.707649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 201/397] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:43.713429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626f9a4-3a29-4bda-bea4-46562cd5cc04 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:43.748376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3d107-01ea-4551-b233-ed67b76dbe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:43.749280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d107-01ea-4551-b233-ed67b76dbe8e None admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:43.749560 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d107-01ea-4551-b233-ed67b76dbe8e None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:43.749833 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d107-01ea-4551-b233-ed67b76dbe8e None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317/groups/8dd83df04f7f469396b26583e321905f/roles/4af08bea19b94c2c863a51b103f50b8b` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:43.758005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3d107-01ea-4551-b233-ed67b76dbe8e None admin] RBAC: Authorizing `identity:create_grant(project_id=113460ea611c4df1b58899d547c12317, group_id=8dd83df04f7f469396b26583e321905f, role_id=4af08bea19b94c2c863a51b103f50b8b)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:43.758005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3d107-01ea-4551-b233-ed67b76dbe8e None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:43.777302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 197/398] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 30 03:35:43 2022] PUT /identity/v3/projects/113460ea611c4df1b58899d547c12317/groups/8dd83df04f7f469396b26583e321905f/roles/4af08bea19b94c2c863a51b103f50b8b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:35:43.778742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeda670-56c7-4343-8977-6c78a68f1d86 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:43.779067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeda670-56c7-4343-8977-6c78a68f1d86 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:43.779450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeda670-56c7-4343-8977-6c78a68f1d86 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:43.781114 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 198/399] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:43.798404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521ad91-b5bb-45ae-8419-892b79165359 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:43.798726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521ad91-b5bb-45ae-8419-892b79165359 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:43.799001 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521ad91-b5bb-45ae-8419-892b79165359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:43.831770 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-9521ad91-b5bb-45ae-8419-892b79165359 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:43.832914 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9521ad91-b5bb-45ae-8419-892b79165359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:43.909756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:43.941725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626f9a4-3a29-4bda-bea4-46562cd5cc04 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:43.945793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 199/400] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:43.957793 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:43.969412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521ad91-b5bb-45ae-8419-892b79165359 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:43.990896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1812c5-b052-4052-ac9d-838a8b68d6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:43.991780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1812c5-b052-4052-ac9d-838a8b68d6b1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:43.992057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1812c5-b052-4052-ac9d-838a8b68d6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:43.992396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1812c5-b052-4052-ac9d-838a8b68d6b1 None admin] PATH_INFO: `/v3/groups/8dd83df04f7f469396b26583e321905f` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:43.993596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1812c5-b052-4052-ac9d-838a8b68d6b1 None admin] RBAC: Authorizing `identity:get_group(group_id=8dd83df04f7f469396b26583e321905f)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:43.995321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1812c5-b052-4052-ac9d-838a8b68d6b1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:43.997432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 202/401] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:43 2022] GET /identity/v3/groups/8dd83df04f7f469396b26583e321905f => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:44.002838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1812c5-b052-4052-ac9d-838a8b68d6b1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:44.085141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521ad91-b5bb-45ae-8419-892b79165359 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:44.116923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1812c5-b052-4052-ac9d-838a8b68d6b1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:44.124834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bbe0b-b74c-42d2-95f2-abe9fda3b3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:44.125668 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bbe0b-b74c-42d2-95f2-abe9fda3b3a6 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:44.125951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bbe0b-b74c-42d2-95f2-abe9fda3b3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:44.126226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bbe0b-b74c-42d2-95f2-abe9fda3b3a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:44.138372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bbe0b-b74c-42d2-95f2-abe9fda3b3a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-eb4bbe0b-b74c-42d2-95f2-abe9fda3b3a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:44.147239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:44.148158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:44.149045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:44.149045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:44.149045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:44.149045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:44.149045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:44.149045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:44.149045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:44.149045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:44.149045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:44.149045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:44.149045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:44.149045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:44.149672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 200/402] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:35:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:44.159985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bbe0b-b74c-42d2-95f2-abe9fda3b3a6 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:44.165935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eee10f-f912-4852-b306-6a501370f1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:44.167161 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eee10f-f912-4852-b306-6a501370f1f7 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:44.167694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eee10f-f912-4852-b306-6a501370f1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:44.168165 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eee10f-f912-4852-b306-6a501370f1f7 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:44.169644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eee10f-f912-4852-b306-6a501370f1f7 None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:44.171354 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eee10f-f912-4852-b306-6a501370f1f7 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:44.173622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 203/403] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:44 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:44.179592 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eee10f-f912-4852-b306-6a501370f1f7 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:44.235166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:44.239154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:44.300708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bbe0b-b74c-42d2-95f2-abe9fda3b3a6 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:44.339173 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae96d-78eb-42d6-b3f4-9bba47329ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:44.340090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae96d-78eb-42d6-b3f4-9bba47329ac9 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:44.340630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae96d-78eb-42d6-b3f4-9bba47329ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:44.341048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae96d-78eb-42d6-b3f4-9bba47329ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:44.342045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ae96d-78eb-42d6-b3f4-9bba47329ac9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:44.342493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ae96d-78eb-42d6-b3f4-9bba47329ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:44.344074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ae96d-78eb-42d6-b3f4-9bba47329ac9 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:44.344204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eee10f-f912-4852-b306-6a501370f1f7 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:44.354777 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 201/404] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:35:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:44.366580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae96d-78eb-42d6-b3f4-9bba47329ac9 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:44.396023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6d7dd-2d68-4faa-99fe-a72a0dfa3942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:44.397633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6d7dd-2d68-4faa-99fe-a72a0dfa3942 None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:44.397914 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6d7dd-2d68-4faa-99fe-a72a0dfa3942 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:44.398199 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6d7dd-2d68-4faa-99fe-a72a0dfa3942 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e/groups/8dd83df04f7f469396b26583e321905f/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:44.400720 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6d7dd-2d68-4faa-99fe-a72a0dfa3942 None admin] RBAC: Authorizing `identity:create_grant(project_id=398973d672844da38a2cfaf6f5093a9e, group_id=8dd83df04f7f469396b26583e321905f, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:44.402986 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6d7dd-2d68-4faa-99fe-a72a0dfa3942 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:44.428175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 204/405] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 30 03:35:44 2022] PUT /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e/groups/8dd83df04f7f469396b26583e321905f/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:35:44.464141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae77de-c093-4028-bbb9-2fb5fcf23557 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:44.464461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae77de-c093-4028-bbb9-2fb5fcf23557 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:44.464698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae77de-c093-4028-bbb9-2fb5fcf23557 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:44.466236 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 205/406] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:35:44.471876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5203f-da70-4ef3-a24f-a46278025758 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:44.472160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5203f-da70-4ef3-a24f-a46278025758 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:44.472432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5203f-da70-4ef3-a24f-a46278025758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:44.497853 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-79c5203f-da70-4ef3-a24f-a46278025758 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:44.499385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-79c5203f-da70-4ef3-a24f-a46278025758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:44.566547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:44.574245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae96d-78eb-42d6-b3f4-9bba47329ac9 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:44.596612 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 206/407] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 30 03:35:44.612935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d3e81-457f-45bf-9a26-fbbcc68047d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:44.613818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d3e81-457f-45bf-9a26-fbbcc68047d7 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:44.614098 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d3e81-457f-45bf-9a26-fbbcc68047d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:44.614370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d3e81-457f-45bf-9a26-fbbcc68047d7 None admin] PATH_INFO: `/v3/groups/8dd83df04f7f469396b26583e321905f` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:44.615603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d3e81-457f-45bf-9a26-fbbcc68047d7 None admin] RBAC: Authorizing `identity:get_group(group_id=8dd83df04f7f469396b26583e321905f)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:44.617091 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d3e81-457f-45bf-9a26-fbbcc68047d7 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:44.620238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 202/408] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:44 2022] GET /identity/v3/groups/8dd83df04f7f469396b26583e321905f => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:44.625261 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5203f-da70-4ef3-a24f-a46278025758 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:44.625424 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d3e81-457f-45bf-9a26-fbbcc68047d7 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:44.666168 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:44.747842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5203f-da70-4ef3-a24f-a46278025758 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:44.766203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d3e81-457f-45bf-9a26-fbbcc68047d7 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:44.785049 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893c344-0f07-4c33-b753-3186c6da4c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:44.785927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893c344-0f07-4c33-b753-3186c6da4c01 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:44.786212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893c344-0f07-4c33-b753-3186c6da4c01 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:44.786492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893c344-0f07-4c33-b753-3186c6da4c01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:44.812939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893c344-0f07-4c33-b753-3186c6da4c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-d893c344-0f07-4c33-b753-3186c6da4c01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:44.828341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:44.829298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:44.830089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:44.830089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:44.830089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:44.830089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:44.830089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:44.830089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:44.830089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:44.830089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:44.830089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:44.830089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:44.830089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:44.830089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:44.830089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 207/409] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:44.835444 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893c344-0f07-4c33-b753-3186c6da4c01 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:44.847046 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226f2c8-3267-408d-9cce-c4b3bd401112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:44.847872 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226f2c8-3267-408d-9cce-c4b3bd401112 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:44.848159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226f2c8-3267-408d-9cce-c4b3bd401112 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:44.848436 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226f2c8-3267-408d-9cce-c4b3bd401112 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:44.853945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226f2c8-3267-408d-9cce-c4b3bd401112 None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:44.855527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226f2c8-3267-408d-9cce-c4b3bd401112 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:44.857602 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 203/410] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:44 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:44.863059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226f2c8-3267-408d-9cce-c4b3bd401112 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:44.925230 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:44.940321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:44.947157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893c344-0f07-4c33-b753-3186c6da4c01 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:44.996716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd634c2b-6801-4a68-af06-d6716285ae9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:44.997482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd634c2b-6801-4a68-af06-d6716285ae9f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:44.997763 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd634c2b-6801-4a68-af06-d6716285ae9f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:44.998037 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd634c2b-6801-4a68-af06-d6716285ae9f None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:44.998818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd634c2b-6801-4a68-af06-d6716285ae9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:44.999126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd634c2b-6801-4a68-af06-d6716285ae9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:45.000637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd634c2b-6801-4a68-af06-d6716285ae9f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:45.018001 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 208/411] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:45.020024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226f2c8-3267-408d-9cce-c4b3bd401112 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:45.027758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd634c2b-6801-4a68-af06-d6716285ae9f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:45.057141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234095a9-8d9c-4725-bde6-83cadd3b3bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:45.058147 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234095a9-8d9c-4725-bde6-83cadd3b3bc2 None admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:45.058434 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234095a9-8d9c-4725-bde6-83cadd3b3bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:45.058712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234095a9-8d9c-4725-bde6-83cadd3b3bc2 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e/groups/8dd83df04f7f469396b26583e321905f/roles/4af08bea19b94c2c863a51b103f50b8b` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:45.061018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234095a9-8d9c-4725-bde6-83cadd3b3bc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=398973d672844da38a2cfaf6f5093a9e, group_id=8dd83df04f7f469396b26583e321905f, role_id=4af08bea19b94c2c863a51b103f50b8b)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:45.062487 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234095a9-8d9c-4725-bde6-83cadd3b3bc2 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:45.078218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 204/412] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 30 03:35:44 2022] PUT /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e/groups/8dd83df04f7f469396b26583e321905f/roles/4af08bea19b94c2c863a51b103f50b8b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:35:45.201600 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd634c2b-6801-4a68-af06-d6716285ae9f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:45.257983 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27d3b0-c078-4a6e-96c7-f53cd39e5783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:45.259348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27d3b0-c078-4a6e-96c7-f53cd39e5783 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:45.259831 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27d3b0-c078-4a6e-96c7-f53cd39e5783 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:45.260345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27d3b0-c078-4a6e-96c7-f53cd39e5783 None admin] PATH_INFO: `/v3/groups/46f1f0cf2e8a4743a17272d6d5999874` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:45.261754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27d3b0-c078-4a6e-96c7-f53cd39e5783 None admin] RBAC: Authorizing `identity:get_group(group_id=46f1f0cf2e8a4743a17272d6d5999874)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:45.263463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27d3b0-c078-4a6e-96c7-f53cd39e5783 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:45.265612 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 209/413] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:45 2022] GET /identity/v3/groups/46f1f0cf2e8a4743a17272d6d5999874 => generated 229 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:45.272194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234095a9-8d9c-4725-bde6-83cadd3b3bc2 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:45.395802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:45.402267 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234095a9-8d9c-4725-bde6-83cadd3b3bc2 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:45.444688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7eded8-2c4c-4612-9ae6-fc0c33b143c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:45.445702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eded8-2c4c-4612-9ae6-fc0c33b143c3 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:45.446135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eded8-2c4c-4612-9ae6-fc0c33b143c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:45.446527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eded8-2c4c-4612-9ae6-fc0c33b143c3 None admin] PATH_INFO: `/v3/projects/26fd4a4f105a4803a50f2696df78fba5` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:45.447693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7eded8-2c4c-4612-9ae6-fc0c33b143c3 None admin] RBAC: Authorizing `identity:get_project(project_id=26fd4a4f105a4803a50f2696df78fba5)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:45.449176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7eded8-2c4c-4612-9ae6-fc0c33b143c3 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:45.451274 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 205/414] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:45 2022] GET /identity/v3/projects/26fd4a4f105a4803a50f2696df78fba5 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:45.456670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27d3b0-c078-4a6e-96c7-f53cd39e5783 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:45.512276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:45.610996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27d3b0-c078-4a6e-96c7-f53cd39e5783 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:45.661758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d3a5d-9202-4a6c-a575-c46c3e348d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:45.662651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d3a5d-9202-4a6c-a575-c46c3e348d66 None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:45.662956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d3a5d-9202-4a6c-a575-c46c3e348d66 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:45.663232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d3a5d-9202-4a6c-a575-c46c3e348d66 None admin] PATH_INFO: `/v3/projects/26fd4a4f105a4803a50f2696df78fba5/groups/46f1f0cf2e8a4743a17272d6d5999874/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:45.668040 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d3a5d-9202-4a6c-a575-c46c3e348d66 None admin] RBAC: Authorizing `identity:create_grant(project_id=26fd4a4f105a4803a50f2696df78fba5, group_id=46f1f0cf2e8a4743a17272d6d5999874, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:45.669482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d3a5d-9202-4a6c-a575-c46c3e348d66 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:45.703266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 210/415] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 30 03:35:45 2022] PUT /identity/v3/projects/26fd4a4f105a4803a50f2696df78fba5/groups/46f1f0cf2e8a4743a17272d6d5999874/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:35:46.026842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3d562-acea-45ed-8097-28dbc7e68041 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:46.027240 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3d562-acea-45ed-8097-28dbc7e68041 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:46.027411 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3d562-acea-45ed-8097-28dbc7e68041 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:46.029017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 206/416] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:46.034137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4145b-89cb-4764-bcb2-215d0a25d2f0 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:46.034583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4145b-89cb-4764-bcb2-215d0a25d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:46.034668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4145b-89cb-4764-bcb2-215d0a25d2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:46.059394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-49b4145b-89cb-4764-bcb2-215d0a25d2f0 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:46.060583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-49b4145b-89cb-4764-bcb2-215d0a25d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:46.152769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 211/417] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:46.188021 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3d562-acea-45ed-8097-28dbc7e68041 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:46.316425 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea8674-0f7d-4c2a-af0e-42e951d2f9d4 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:46.316755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea8674-0f7d-4c2a-af0e-42e951d2f9d4 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:46.316985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea8674-0f7d-4c2a-af0e-42e951d2f9d4 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:46.318610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 212/418] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:46.323729 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3d562-acea-45ed-8097-28dbc7e68041 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:46.340273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75256d95-a71e-4904-9973-76194f0c16cc None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:46.340551 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75256d95-a71e-4904-9973-76194f0c16cc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:46.340982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75256d95-a71e-4904-9973-76194f0c16cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:46.363607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2a688-0e56-4cbe-8b88-78eae5ddbd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:46.364427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2a688-0e56-4cbe-8b88-78eae5ddbd6a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:46.364709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2a688-0e56-4cbe-8b88-78eae5ddbd6a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:46.364985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2a688-0e56-4cbe-8b88-78eae5ddbd6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:46.377530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2a688-0e56-4cbe-8b88-78eae5ddbd6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:46.383839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-75256d95-a71e-4904-9973-76194f0c16cc None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:46.385184 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-75256d95-a71e-4904-9973-76194f0c16cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-79c2a688-0e56-4cbe-8b88-78eae5ddbd6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:46.386092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:46.387138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:46.388197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:46.388197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:46.388197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:46.388197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:46.388197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:46.388197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:46.388197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:46.388197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:46.388197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:46.388197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:46.388197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:46.388197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:46.388197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 207/419] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:46.396882 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2a688-0e56-4cbe-8b88-78eae5ddbd6a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:46.410892 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:46.429093 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:46.515044 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2a688-0e56-4cbe-8b88-78eae5ddbd6a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:46.554576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0579f-ecaa-4e99-92b6-6f219635c155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:46.556552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0579f-ecaa-4e99-92b6-6f219635c155 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:46.557090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0579f-ecaa-4e99-92b6-6f219635c155 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:46.557561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0579f-ecaa-4e99-92b6-6f219635c155 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:46.558515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0579f-ecaa-4e99-92b6-6f219635c155 None admin] RBAC: Adding query filter params (name=member) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:46.559048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0579f-ecaa-4e99-92b6-6f219635c155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:46.561467 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0579f-ecaa-4e99-92b6-6f219635c155 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:46.573154 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 208/420] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:46.580052 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0579f-ecaa-4e99-92b6-6f219635c155 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:46.592512 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 213/421] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:46.635581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75256d95-a71e-4904-9973-76194f0c16cc None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:46.766824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75256d95-a71e-4904-9973-76194f0c16cc None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:46.784134 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:46.804358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab882f-33bd-4419-8da2-184cceecef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:46.805624 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab882f-33bd-4419-8da2-184cceecef13 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:46.805910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab882f-33bd-4419-8da2-184cceecef13 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:46.806186 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab882f-33bd-4419-8da2-184cceecef13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:46.816754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab882f-33bd-4419-8da2-184cceecef13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-4bab882f-33bd-4419-8da2-184cceecef13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:46.827585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:46.828585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:46.829365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:46.829365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:46.829365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:46.829365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:46.829365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:46.829365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:46.829365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:46.829365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:46.829365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:46.829365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:46.829365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:46.829365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:46.829365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 214/422] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:35:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:46.835438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab882f-33bd-4419-8da2-184cceecef13 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:46.850819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0579f-ecaa-4e99-92b6-6f219635c155 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:46.851137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:46.944778 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6ab3c-444f-49a8-9627-2d3c6b67adda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:46.945736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6ab3c-444f-49a8-9627-2d3c6b67adda None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:46.946020 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6ab3c-444f-49a8-9627-2d3c6b67adda None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:46.946296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6ab3c-444f-49a8-9627-2d3c6b67adda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:46.949713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab882f-33bd-4419-8da2-184cceecef13 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:46.993947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac1370-d803-476f-a77c-afa559263684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:46.994637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac1370-d803-476f-a77c-afa559263684 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:46.994947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac1370-d803-476f-a77c-afa559263684 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:46.995221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac1370-d803-476f-a77c-afa559263684 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:46.995987 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac1370-d803-476f-a77c-afa559263684 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:46.996934 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac1370-d803-476f-a77c-afa559263684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:46.998346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac1370-d803-476f-a77c-afa559263684 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:47.017999 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 215/423] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:35:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:47.028031 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac1370-d803-476f-a77c-afa559263684 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:47.081756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6ab3c-444f-49a8-9627-2d3c6b67adda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:47.083267 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6ab3c-444f-49a8-9627-2d3c6b67adda None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:47.114617 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:47.160992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac1370-d803-476f-a77c-afa559263684 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:47.205319 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6963b-f89b-41b6-8f0c-0daf9271a36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:47.205557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:47.206281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6963b-f89b-41b6-8f0c-0daf9271a36c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:47.206574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6963b-f89b-41b6-8f0c-0daf9271a36c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:47.206944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6963b-f89b-41b6-8f0c-0daf9271a36c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:47.227838 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 209/424] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:47.229024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0ac27-b731-462f-9970-2ed7097b1a69 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:47.229310 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0ac27-b731-462f-9970-2ed7097b1a69 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:47.229590 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0ac27-b731-462f-9970-2ed7097b1a69 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:47.230995 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 210/425] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:47.235624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0ac27-b731-462f-9970-2ed7097b1a69 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:47.307396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6963b-f89b-41b6-8f0c-0daf9271a36c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:47.309241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6963b-f89b-41b6-8f0c-0daf9271a36c None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:47.372134 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0ac27-b731-462f-9970-2ed7097b1a69 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:47.392930 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:47.424716 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cb036-71ba-47c1-bf7b-1866d83e0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:47.426541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cb036-71ba-47c1-bf7b-1866d83e0572 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:47.427150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cb036-71ba-47c1-bf7b-1866d83e0572 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:47.427438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cb036-71ba-47c1-bf7b-1866d83e0572 None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:47.428809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cb036-71ba-47c1-bf7b-1866d83e0572 None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:47.430445 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cb036-71ba-47c1-bf7b-1866d83e0572 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:47.436903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 211/426] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:47 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:47.436903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33bc57-8e27-49f4-88b7-ca4484789883 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:47.436903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33bc57-8e27-49f4-88b7-ca4484789883 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:47.436903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33bc57-8e27-49f4-88b7-ca4484789883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:47.438741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 216/427] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:47.439907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6963b-f89b-41b6-8f0c-0daf9271a36c None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:47.457431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ff33bc57-8e27-49f4-88b7-ca4484789883 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:47.458643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ff33bc57-8e27-49f4-88b7-ca4484789883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:47.516719 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:47.542695 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 212/428] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:47.543870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33bc57-8e27-49f4-88b7-ca4484789883 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:47.581428 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6963b-f89b-41b6-8f0c-0daf9271a36c None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:47.617713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2a0b2-e0ef-4e15-aac8-e2e0c2afc629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:47.618746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a0b2-e0ef-4e15-aac8-e2e0c2afc629 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:47.619150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a0b2-e0ef-4e15-aac8-e2e0c2afc629 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:47.619436 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a0b2-e0ef-4e15-aac8-e2e0c2afc629 None admin] PATH_INFO: `/v3/groups/8dd83df04f7f469396b26583e321905f` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:47.620736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2a0b2-e0ef-4e15-aac8-e2e0c2afc629 None admin] RBAC: Authorizing `identity:get_group(group_id=8dd83df04f7f469396b26583e321905f)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:47.622320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2a0b2-e0ef-4e15-aac8-e2e0c2afc629 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:47.626913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 217/429] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:47 2022] GET /identity/v3/groups/8dd83df04f7f469396b26583e321905f => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:47.626913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f8c53-6c53-4b76-9a40-1a43e6721901 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:47.626913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f8c53-6c53-4b76-9a40-1a43e6721901 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:47.626913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f8c53-6c53-4b76-9a40-1a43e6721901 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:47.627815 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 218/430] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:47.628518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f8c53-6c53-4b76-9a40-1a43e6721901 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:47.668633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33bc57-8e27-49f4-88b7-ca4484789883 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:47.672816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:47.705551 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa345fe-4c1d-4a29-84b9-2a887c80096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:47.706432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa345fe-4c1d-4a29-84b9-2a887c80096d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:47.706715 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa345fe-4c1d-4a29-84b9-2a887c80096d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:47.707023 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa345fe-4c1d-4a29-84b9-2a887c80096d None admin] PATH_INFO: `/v3/projects/113460ea611c4df1b58899d547c12317` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:47.708227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa345fe-4c1d-4a29-84b9-2a887c80096d None admin] RBAC: Authorizing `identity:get_project(project_id=113460ea611c4df1b58899d547c12317)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:47.709676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa345fe-4c1d-4a29-84b9-2a887c80096d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:47.711442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 213/431] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:47 2022] GET /identity/v3/projects/113460ea611c4df1b58899d547c12317 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:47.712199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa345fe-4c1d-4a29-84b9-2a887c80096d None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:47.755309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f8c53-6c53-4b76-9a40-1a43e6721901 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:47.767604 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:47.790226 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965225e0-6457-4cff-bf1c-09860d16287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:47.791048 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965225e0-6457-4cff-bf1c-09860d16287e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:47.791335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965225e0-6457-4cff-bf1c-09860d16287e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:47.791604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965225e0-6457-4cff-bf1c-09860d16287e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:47.802104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965225e0-6457-4cff-bf1c-09860d16287e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-965225e0-6457-4cff-bf1c-09860d16287e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:47.809869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:47.810737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:47.811676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:47.811676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:47.811676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:47.811676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:47.811676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:47.811676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:47.811676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:47.811676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:47.811676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:47.811676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:47.811676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 03:35:47.811676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:47.811676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 219/432] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:47.812341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb958891-4751-4340-b30a-9dbbfed61c6e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:47.812822 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb958891-4751-4340-b30a-9dbbfed61c6e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:47.812822 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb958891-4751-4340-b30a-9dbbfed61c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:47.825339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa345fe-4c1d-4a29-84b9-2a887c80096d None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:47.832391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-eb958891-4751-4340-b30a-9dbbfed61c6e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:47.833528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-eb958891-4751-4340-b30a-9dbbfed61c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:47.863218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd9771-fa25-4229-a44f-b2ab21ae0264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:47.863883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd9771-fa25-4229-a44f-b2ab21ae0264 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:47.864164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd9771-fa25-4229-a44f-b2ab21ae0264 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:47.864442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd9771-fa25-4229-a44f-b2ab21ae0264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:47.865271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd9771-fa25-4229-a44f-b2ab21ae0264 None admin] RBAC: Adding query filter params (group.id=8dd83df04f7f469396b26583e321905f, role.id=59a0f03d08fd401ebbd29ebd5f174abb, scope.project.id=113460ea611c4df1b58899d547c12317) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:47.865584 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd9771-fa25-4229-a44f-b2ab21ae0264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:47.867087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd9771-fa25-4229-a44f-b2ab21ae0264 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:47.872837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 214/433] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 03:35:47 2022] GET /identity/v3/role_assignments?group.id=8dd83df04f7f469396b26583e321905f&scope.project.id=113460ea611c4df1b58899d547c12317&role.id=59a0f03d08fd401ebbd29ebd5f174abb => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:47.873611 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd9771-fa25-4229-a44f-b2ab21ae0264 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:47.926146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 220/434] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:47.927333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb958891-4751-4340-b30a-9dbbfed61c6e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:47.961571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:48.021647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd9771-fa25-4229-a44f-b2ab21ae0264 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:48.041369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:48.062172 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbe261-51f7-4fc9-970e-e0e3869a5f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:48.063074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbe261-51f7-4fc9-970e-e0e3869a5f25 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:48.063355 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbe261-51f7-4fc9-970e-e0e3869a5f25 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:48.063454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb958891-4751-4340-b30a-9dbbfed61c6e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:48.063627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbe261-51f7-4fc9-970e-e0e3869a5f25 None admin] PATH_INFO: `/v3/groups/8dd83df04f7f469396b26583e321905f` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:48.065556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbe261-51f7-4fc9-970e-e0e3869a5f25 None admin] RBAC: Authorizing `identity:get_group(group_id=8dd83df04f7f469396b26583e321905f)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:48.067096 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbe261-51f7-4fc9-970e-e0e3869a5f25 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:48.074082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 215/435] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:47 2022] GET /identity/v3/groups/8dd83df04f7f469396b26583e321905f => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:48.075004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbe261-51f7-4fc9-970e-e0e3869a5f25 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:48.100944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885c88a-1b47-49e7-8a08-1a53eed353dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:48.101675 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885c88a-1b47-49e7-8a08-1a53eed353dc None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:48.101954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885c88a-1b47-49e7-8a08-1a53eed353dc None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:48.102217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885c88a-1b47-49e7-8a08-1a53eed353dc None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:48.103005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885c88a-1b47-49e7-8a08-1a53eed353dc None admin] RBAC: Adding query filter params (name=member) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:48.103311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885c88a-1b47-49e7-8a08-1a53eed353dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:48.106287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885c88a-1b47-49e7-8a08-1a53eed353dc None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:48.115602 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 221/436] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:35:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:48.116231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885c88a-1b47-49e7-8a08-1a53eed353dc None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:48.183644 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbe261-51f7-4fc9-970e-e0e3869a5f25 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:48.221862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:48.227381 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c3798-7111-401a-ba49-0dbbee331ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:48.228481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c3798-7111-401a-ba49-0dbbee331ea6 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:48.228481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c3798-7111-401a-ba49-0dbbee331ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:48.228753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c3798-7111-401a-ba49-0dbbee331ea6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:48.237578 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885c88a-1b47-49e7-8a08-1a53eed353dc None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:48.242240 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c3798-7111-401a-ba49-0dbbee331ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-062c3798-7111-401a-ba49-0dbbee331ea6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:48.250493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:48.251471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:48.252296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:48.252296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:48.252296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:48.252296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:48.252296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:48.252296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:48.252296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:48.252296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:48.252296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:48.252296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:48.252296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:48.252296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:48.252296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 216/437] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:35:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:48.253222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051b730-e7a8-4e38-baf2-9a6ee760e361 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:48.253507 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051b730-e7a8-4e38-baf2-9a6ee760e361 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:48.253788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051b730-e7a8-4e38-baf2-9a6ee760e361 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:48.255209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 217/438] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:48.260123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051b730-e7a8-4e38-baf2-9a6ee760e361 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:48.281543 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111845bd-20ee-4d35-b5e7-0257f673ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:48.282207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111845bd-20ee-4d35-b5e7-0257f673ed8a None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:48.282486 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111845bd-20ee-4d35-b5e7-0257f673ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:48.282756 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111845bd-20ee-4d35-b5e7-0257f673ed8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:48.283616 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111845bd-20ee-4d35-b5e7-0257f673ed8a None admin] RBAC: Adding query filter params (group.id=8dd83df04f7f469396b26583e321905f, role.id=4af08bea19b94c2c863a51b103f50b8b, scope.project.id=113460ea611c4df1b58899d547c12317) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:48.283923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111845bd-20ee-4d35-b5e7-0257f673ed8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:48.285364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111845bd-20ee-4d35-b5e7-0257f673ed8a None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:48.291528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 222/439] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 03:35:48 2022] GET /identity/v3/role_assignments?group.id=8dd83df04f7f469396b26583e321905f&scope.project.id=113460ea611c4df1b58899d547c12317&role.id=4af08bea19b94c2c863a51b103f50b8b => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:48.292600 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de105f09-eac5-448a-b47d-63de7a5febb8 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:48.292884 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de105f09-eac5-448a-b47d-63de7a5febb8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:48.293169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de105f09-eac5-448a-b47d-63de7a5febb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:48.310144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-de105f09-eac5-448a-b47d-63de7a5febb8 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:48.311189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:48.311447 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-de105f09-eac5-448a-b47d-63de7a5febb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:48.384325 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051b730-e7a8-4e38-baf2-9a6ee760e361 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:48.386400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 223/440] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:48.387313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de105f09-eac5-448a-b47d-63de7a5febb8 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:48.433503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6922bc-8612-4052-a44b-679a5de679fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:48.434180 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6922bc-8612-4052-a44b-679a5de679fc None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:48.434462 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6922bc-8612-4052-a44b-679a5de679fc None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:48.434739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6922bc-8612-4052-a44b-679a5de679fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:48.487286 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:48.514329 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de105f09-eac5-448a-b47d-63de7a5febb8 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:48.520832 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6922bc-8612-4052-a44b-679a5de679fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:48.522328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6922bc-8612-4052-a44b-679a5de679fc None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:48.558598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19427f7-7bcf-4e39-bb62-ace84624a289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:48.559306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19427f7-7bcf-4e39-bb62-ace84624a289 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:48.559581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19427f7-7bcf-4e39-bb62-ace84624a289 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:48.559854 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19427f7-7bcf-4e39-bb62-ace84624a289 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:48.561174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19427f7-7bcf-4e39-bb62-ace84624a289 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:48.561174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19427f7-7bcf-4e39-bb62-ace84624a289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:48.562512 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19427f7-7bcf-4e39-bb62-ace84624a289 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:48.573277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:48.575161 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 224/441] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:35:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:48.576373 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19427f7-7bcf-4e39-bb62-ace84624a289 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:48.636198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 218/442] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:48.641596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6922bc-8612-4052-a44b-679a5de679fc None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:48.690515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19427f7-7bcf-4e39-bb62-ace84624a289 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:48.723800 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87b243-7ce3-4dcd-9ca8-8391547e8280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:48.724938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87b243-7ce3-4dcd-9ca8-8391547e8280 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:48.725242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87b243-7ce3-4dcd-9ca8-8391547e8280 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:48.725517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87b243-7ce3-4dcd-9ca8-8391547e8280 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:48.736390 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87b243-7ce3-4dcd-9ca8-8391547e8280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:48.741066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6922bc-8612-4052-a44b-679a5de679fc None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-ea87b243-7ce3-4dcd-9ca8-8391547e8280 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:48.744212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:48.745106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:48.745901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:48.745901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:48.745901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:48.745901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:48.745901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:48.745901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:48.745901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:48.745901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:48.745901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:48.745901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:48.745901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:35:48.745901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:48.745901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 225/443] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:35:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:48.746563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87b243-7ce3-4dcd-9ca8-8391547e8280 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:48.751351 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:48.778469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b5649-8b01-4469-83b0-650e7f633235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:48.779153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5649-8b01-4469-83b0-650e7f633235 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:48.779431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5649-8b01-4469-83b0-650e7f633235 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:48.779700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5649-8b01-4469-83b0-650e7f633235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:48.794294 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:48.846635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87b243-7ce3-4dcd-9ca8-8391547e8280 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:48.851161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b5649-8b01-4469-83b0-650e7f633235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:48.853309 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b5649-8b01-4469-83b0-650e7f633235 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:48.884744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b0461-6eaf-4583-b8d6-f69ed94af7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:48.885621 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b0461-6eaf-4583-b8d6-f69ed94af7c1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:48.885904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b0461-6eaf-4583-b8d6-f69ed94af7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:48.886175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b0461-6eaf-4583-b8d6-f69ed94af7c1 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:48.887467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b0461-6eaf-4583-b8d6-f69ed94af7c1 None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:48.888860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b0461-6eaf-4583-b8d6-f69ed94af7c1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:48.890560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 226/444] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:48 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:48.891348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b0461-6eaf-4583-b8d6-f69ed94af7c1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:48.953676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 219/445] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:48.954617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b5649-8b01-4469-83b0-650e7f633235 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:48.967511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:48.999072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b0461-6eaf-4583-b8d6-f69ed94af7c1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:49.001032 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:49.032759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9404bb7-5bd3-4f5b-8e26-36d09d6d0395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:49.033423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404bb7-5bd3-4f5b-8e26-36d09d6d0395 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:49.033722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404bb7-5bd3-4f5b-8e26-36d09d6d0395 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:49.033998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404bb7-5bd3-4f5b-8e26-36d09d6d0395 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:49.034754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9404bb7-5bd3-4f5b-8e26-36d09d6d0395 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:49.035096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9404bb7-5bd3-4f5b-8e26-36d09d6d0395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:49.036485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9404bb7-5bd3-4f5b-8e26-36d09d6d0395 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:49.045130 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 227/446] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:49.045915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9404bb7-5bd3-4f5b-8e26-36d09d6d0395 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:49.055938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b5649-8b01-4469-83b0-650e7f633235 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:49.089664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a67b7-ea04-4668-abdf-027f9486d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:49.090527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a67b7-ea04-4668-abdf-027f9486d978 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:49.090840 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a67b7-ea04-4668-abdf-027f9486d978 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:49.091115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a67b7-ea04-4668-abdf-027f9486d978 None admin] PATH_INFO: `/v3/groups/8dd83df04f7f469396b26583e321905f` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:49.092273 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a67b7-ea04-4668-abdf-027f9486d978 None admin] RBAC: Authorizing `identity:get_group(group_id=8dd83df04f7f469396b26583e321905f)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:49.093732 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a67b7-ea04-4668-abdf-027f9486d978 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:49.095389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 220/447] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:48 2022] GET /identity/v3/groups/8dd83df04f7f469396b26583e321905f => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:49.096145 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a67b7-ea04-4668-abdf-027f9486d978 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:49.150810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9404bb7-5bd3-4f5b-8e26-36d09d6d0395 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:49.184363 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbe515-ab46-4e76-a59f-6ed42a9cad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:49.185235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbe515-ab46-4e76-a59f-6ed42a9cad67 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:49.185537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbe515-ab46-4e76-a59f-6ed42a9cad67 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:49.185812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbe515-ab46-4e76-a59f-6ed42a9cad67 None admin] PATH_INFO: `/v3/projects/398973d672844da38a2cfaf6f5093a9e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:49.187097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbe515-ab46-4e76-a59f-6ed42a9cad67 None admin] RBAC: Authorizing `identity:get_project(project_id=398973d672844da38a2cfaf6f5093a9e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:49.188567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbe515-ab46-4e76-a59f-6ed42a9cad67 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:49.190563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 228/448] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:49 2022] GET /identity/v3/projects/398973d672844da38a2cfaf6f5093a9e => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:49.191349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbe515-ab46-4e76-a59f-6ed42a9cad67 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:49.193771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:49.198786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a67b7-ea04-4668-abdf-027f9486d978 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:49.212320 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:49.234291 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a0259-1ae4-425b-a095-d5d6a0837e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:49.234969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a0259-1ae4-425b-a095-d5d6a0837e25 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:49.235244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a0259-1ae4-425b-a095-d5d6a0837e25 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:49.235497 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a0259-1ae4-425b-a095-d5d6a0837e25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:49.292971 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbe515-ab46-4e76-a59f-6ed42a9cad67 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:49.302337 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a0259-1ae4-425b-a095-d5d6a0837e25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:49.303834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a0259-1ae4-425b-a095-d5d6a0837e25 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:49.329118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c53578-5a44-40aa-a0c7-88f515cf64d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:49.329550 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53578-5a44-40aa-a0c7-88f515cf64d2 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:49.329834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53578-5a44-40aa-a0c7-88f515cf64d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:49.330102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53578-5a44-40aa-a0c7-88f515cf64d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:49.330957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c53578-5a44-40aa-a0c7-88f515cf64d2 None admin] RBAC: Adding query filter params (group.id=8dd83df04f7f469396b26583e321905f, role.id=59a0f03d08fd401ebbd29ebd5f174abb, scope.project.id=398973d672844da38a2cfaf6f5093a9e) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:49.331271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c53578-5a44-40aa-a0c7-88f515cf64d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:49.332705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c53578-5a44-40aa-a0c7-88f515cf64d2 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:49.352817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 229/449] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 03:35:49 2022] GET /identity/v3/role_assignments?group.id=8dd83df04f7f469396b26583e321905f&scope.project.id=398973d672844da38a2cfaf6f5093a9e&role.id=59a0f03d08fd401ebbd29ebd5f174abb => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:49.352817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c53578-5a44-40aa-a0c7-88f515cf64d2 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:49.414275 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:49.426247 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 221/450] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:49.427748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a0259-1ae4-425b-a095-d5d6a0837e25 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:49.442420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:49.457248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c53578-5a44-40aa-a0c7-88f515cf64d2 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:49.493215 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a4aa4-cf89-43b5-8a1d-6ddf773d17cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:49.494094 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a4aa4-cf89-43b5-8a1d-6ddf773d17cc None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:49.494372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a4aa4-cf89-43b5-8a1d-6ddf773d17cc None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:49.494635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a4aa4-cf89-43b5-8a1d-6ddf773d17cc None admin] PATH_INFO: `/v3/groups/8dd83df04f7f469396b26583e321905f` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:49.495874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a4aa4-cf89-43b5-8a1d-6ddf773d17cc None admin] RBAC: Authorizing `identity:get_group(group_id=8dd83df04f7f469396b26583e321905f)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:49.497321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a4aa4-cf89-43b5-8a1d-6ddf773d17cc None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:49.499146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 230/451] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:49 2022] GET /identity/v3/groups/8dd83df04f7f469396b26583e321905f => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:49.505199 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a4aa4-cf89-43b5-8a1d-6ddf773d17cc None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:49.551655 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a0259-1ae4-425b-a095-d5d6a0837e25 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:49.600809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820175da-55e5-4457-9683-f160608aab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:49.601955 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820175da-55e5-4457-9683-f160608aab54 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:49.602096 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820175da-55e5-4457-9683-f160608aab54 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:49.602258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820175da-55e5-4457-9683-f160608aab54 None admin] PATH_INFO: `/v3/projects/26fd4a4f105a4803a50f2696df78fba5` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:49.603573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820175da-55e5-4457-9683-f160608aab54 None admin] RBAC: Authorizing `identity:get_project(project_id=26fd4a4f105a4803a50f2696df78fba5)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:49.605280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820175da-55e5-4457-9683-f160608aab54 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:49.607357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 222/452] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:35:49 2022] GET /identity/v3/projects/26fd4a4f105a4803a50f2696df78fba5 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:49.612602 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820175da-55e5-4457-9683-f160608aab54 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:49.623391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a4aa4-cf89-43b5-8a1d-6ddf773d17cc None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:49.662888 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f48416-a180-4055-bd6b-c6f99b8724df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:49.663591 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f48416-a180-4055-bd6b-c6f99b8724df None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:49.663895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f48416-a180-4055-bd6b-c6f99b8724df None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:49.664361 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f48416-a180-4055-bd6b-c6f99b8724df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:49.665260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f48416-a180-4055-bd6b-c6f99b8724df None admin] RBAC: Adding query filter params (group.id=8dd83df04f7f469396b26583e321905f, role.id=4af08bea19b94c2c863a51b103f50b8b, scope.project.id=398973d672844da38a2cfaf6f5093a9e) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:49.665577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f48416-a180-4055-bd6b-c6f99b8724df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:49.667145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f48416-a180-4055-bd6b-c6f99b8724df None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:49.669109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:49.674702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 231/453] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 03:35:49 2022] GET /identity/v3/role_assignments?group.id=8dd83df04f7f469396b26583e321905f&scope.project.id=398973d672844da38a2cfaf6f5093a9e&role.id=4af08bea19b94c2c863a51b103f50b8b => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:49.708830 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:49.737795 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820175da-55e5-4457-9683-f160608aab54 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:49.774862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33998a5-20c4-4b1e-85cd-4f3477432c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:49.775755 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33998a5-20c4-4b1e-85cd-4f3477432c08 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:49.776032 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33998a5-20c4-4b1e-85cd-4f3477432c08 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:49.776302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33998a5-20c4-4b1e-85cd-4f3477432c08 None admin] PATH_INFO: `/v3/groups/46f1f0cf2e8a4743a17272d6d5999874` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:49.777516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33998a5-20c4-4b1e-85cd-4f3477432c08 None admin] RBAC: Authorizing `identity:get_group(group_id=46f1f0cf2e8a4743a17272d6d5999874)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:49.779008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33998a5-20c4-4b1e-85cd-4f3477432c08 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:49.780667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 223/454] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 03:35:49 2022] GET /identity/v3/groups/46f1f0cf2e8a4743a17272d6d5999874 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:49.786825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f48416-a180-4055-bd6b-c6f99b8724df None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:49.894501 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f48416-a180-4055-bd6b-c6f99b8724df None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:49.943528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418278b8-7fc2-43b8-9816-cffec3bf797e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:49.944157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418278b8-7fc2-43b8-9816-cffec3bf797e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:49.944475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418278b8-7fc2-43b8-9816-cffec3bf797e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:49.944780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418278b8-7fc2-43b8-9816-cffec3bf797e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:49.945702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418278b8-7fc2-43b8-9816-cffec3bf797e None admin] RBAC: Adding query filter params (group.id=46f1f0cf2e8a4743a17272d6d5999874, role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=26fd4a4f105a4803a50f2696df78fba5) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:49.946014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418278b8-7fc2-43b8-9816-cffec3bf797e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:49.947524 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418278b8-7fc2-43b8-9816-cffec3bf797e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:49.954650 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 232/455] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 03:35:49 2022] GET /identity/v3/role_assignments?group.id=46f1f0cf2e8a4743a17272d6d5999874&scope.project.id=26fd4a4f105a4803a50f2696df78fba5&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:52.424120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077995bd-1333-42eb-86ce-7e1f81cafd36 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:52.424649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077995bd-1333-42eb-86ce-7e1f81cafd36 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:52.424649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077995bd-1333-42eb-86ce-7e1f81cafd36 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:52.426278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 224/456] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:52.435564 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759bf4-9fca-4a4a-9c50-add5d99cc175 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:52.436405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759bf4-9fca-4a4a-9c50-add5d99cc175 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:52.436891 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759bf4-9fca-4a4a-9c50-add5d99cc175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:52.463784 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-59759bf4-9fca-4a4a-9c50-add5d99cc175 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:52.465347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-59759bf4-9fca-4a4a-9c50-add5d99cc175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:52.539994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:52.552096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 233/457] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:52.588924 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303540c-674e-4713-9c48-daefb52a3c41 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:52.589543 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303540c-674e-4713-9c48-daefb52a3c41 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:52.590010 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303540c-674e-4713-9c48-daefb52a3c41 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:52.591637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 225/458] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:52.595550 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759bf4-9fca-4a4a-9c50-add5d99cc175 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:52.597242 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a0bdc-91f2-4898-8f7b-ba7add9452eb None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:52.597750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a0bdc-91f2-4898-8f7b-ba7add9452eb None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:52.598214 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a0bdc-91f2-4898-8f7b-ba7add9452eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:52.631738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-f66a0bdc-91f2-4898-8f7b-ba7add9452eb None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:52.632979 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-f66a0bdc-91f2-4898-8f7b-ba7add9452eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:52.769152 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 226/459] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:52.780435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d02f6a-3501-496e-ad8c-6e744b670668 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:52.781005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d02f6a-3501-496e-ad8c-6e744b670668 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:52.781494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d02f6a-3501-496e-ad8c-6e744b670668 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:52.785636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 227/460] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:52 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:52.792161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e45ed-b0fd-4b11-9d82-6d89a884099d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:52.793061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e45ed-b0fd-4b11-9d82-6d89a884099d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:52.794210 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e45ed-b0fd-4b11-9d82-6d89a884099d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:52.816806 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759bf4-9fca-4a4a-9c50-add5d99cc175 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:52.832698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-d81e45ed-b0fd-4b11-9d82-6d89a884099d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:52.835034 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d81e45ed-b0fd-4b11-9d82-6d89a884099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:52.874863 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcc01e-c3d7-4944-9f86-d934fc954429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:52.876065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcc01e-c3d7-4944-9f86-d934fc954429 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:52.876568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcc01e-c3d7-4944-9f86-d934fc954429 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:52.876997 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcc01e-c3d7-4944-9f86-d934fc954429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:52.889349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcc01e-c3d7-4944-9f86-d934fc954429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:52.891086 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcc01e-c3d7-4944-9f86-d934fc954429 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-21dcc01e-c3d7-4944-9f86-d934fc954429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:35:52.911087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:52.912036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:52.912870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:35:52.912870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:35:52.912870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:52.912870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:52.916453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 234/461] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:52.917661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcc01e-c3d7-4944-9f86-d934fc954429 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:52.930058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 228/462] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:52.931421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e45ed-b0fd-4b11-9d82-6d89a884099d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:52.943477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:53.001129 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:53.105274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcc01e-c3d7-4944-9f86-d934fc954429 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:53.109167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e45ed-b0fd-4b11-9d82-6d89a884099d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:53.182390 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d59945-338a-4f76-8d11-dc1c1657946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:53.183272 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d59945-338a-4f76-8d11-dc1c1657946e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:53.183561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d59945-338a-4f76-8d11-dc1c1657946e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:53.184413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d59945-338a-4f76-8d11-dc1c1657946e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:53.185556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4d6b1-9a6b-47c2-8ab4-b91dd0edc518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:53.186233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4d6b1-9a6b-47c2-8ab4-b91dd0edc518 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:53.186512 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4d6b1-9a6b-47c2-8ab4-b91dd0edc518 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:53.186945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4d6b1-9a6b-47c2-8ab4-b91dd0edc518 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:53.187595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4d6b1-9a6b-47c2-8ab4-b91dd0edc518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:53.187901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4d6b1-9a6b-47c2-8ab4-b91dd0edc518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:53.189712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4d6b1-9a6b-47c2-8ab4-b91dd0edc518 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:53.203307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d59945-338a-4f76-8d11-dc1c1657946e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:53.205065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d59945-338a-4f76-8d11-dc1c1657946e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:53.210425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 229/463] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:53.216320 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4d6b1-9a6b-47c2-8ab4-b91dd0edc518 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-a2d59945-338a-4f76-8d11-dc1c1657946e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:35:53.225776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:53.226664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:53.227794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:35:53.227794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:35:53.227794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:53.227794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:53.230178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 235/464] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:53.231290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d59945-338a-4f76-8d11-dc1c1657946e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:53.286734 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:53.323164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4d6b1-9a6b-47c2-8ab4-b91dd0edc518 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:53.338784 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:53.345326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d59945-338a-4f76-8d11-dc1c1657946e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:53.358715 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1721c-c660-499f-9696-ba4a54b4ae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:53.359482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1721c-c660-499f-9696-ba4a54b4ae43 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:53.359763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1721c-c660-499f-9696-ba4a54b4ae43 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:53.360039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1721c-c660-499f-9696-ba4a54b4ae43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:53.372188 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1721c-c660-499f-9696-ba4a54b4ae43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:53.373658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1721c-c660-499f-9696-ba4a54b4ae43 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:53.384028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e3acb-f8b0-4741-8ed6-6118cb9e351c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:53.384709 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e3acb-f8b0-4741-8ed6-6118cb9e351c None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:53.384993 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e3acb-f8b0-4741-8ed6-6118cb9e351c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:53.385272 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e3acb-f8b0-4741-8ed6-6118cb9e351c None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:53.385993 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e3acb-f8b0-4741-8ed6-6118cb9e351c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:53.387481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e3acb-f8b0-4741-8ed6-6118cb9e351c None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-fed1721c-c660-499f-9696-ba4a54b4ae43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:35:53.391932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:53.392727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:53.393984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:35:53.393984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:35:53.393984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:53.393984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:53.393984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 230/465] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:53.394594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1721c-c660-499f-9696-ba4a54b4ae43 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:53.415044 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 236/466] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:35:53 2022] POST /identity/v3/users => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:35:53.421181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe47c3-050f-40c9-9732-d68b2e7077f1 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:53.421843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe47c3-050f-40c9-9732-d68b2e7077f1 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:53.422260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe47c3-050f-40c9-9732-d68b2e7077f1 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:53.425009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 237/467] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:53.426268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe47c3-050f-40c9-9732-d68b2e7077f1 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:53.527184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1721c-c660-499f-9696-ba4a54b4ae43 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:53.550131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:53.569725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610f08f-650d-4a90-a2b2-2441799dae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:53.570641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610f08f-650d-4a90-a2b2-2441799dae45 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:53.571389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610f08f-650d-4a90-a2b2-2441799dae45 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:53.571770 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610f08f-650d-4a90-a2b2-2441799dae45 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:53.572662 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610f08f-650d-4a90-a2b2-2441799dae45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:53.573078 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610f08f-650d-4a90-a2b2-2441799dae45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:53.574615 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610f08f-650d-4a90-a2b2-2441799dae45 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:53.579798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe47c3-050f-40c9-9732-d68b2e7077f1 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:53.589652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 231/468] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:53.591574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67930-c9cc-43f2-80f5-e9d3eeed9045 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:53.591875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67930-c9cc-43f2-80f5-e9d3eeed9045 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:53.592152 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67930-c9cc-43f2-80f5-e9d3eeed9045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:53.611833 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-efb67930-c9cc-43f2-80f5-e9d3eeed9045 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:53.612980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-efb67930-c9cc-43f2-80f5-e9d3eeed9045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:53.630630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd512df5-bef6-44d1-b1d0-5c7082a35fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:53.631337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd512df5-bef6-44d1-b1d0-5c7082a35fa7 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:53.631623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd512df5-bef6-44d1-b1d0-5c7082a35fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:53.631906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd512df5-bef6-44d1-b1d0-5c7082a35fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:53.632787 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd512df5-bef6-44d1-b1d0-5c7082a35fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:53.633572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd512df5-bef6-44d1-b1d0-5c7082a35fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:53.634702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd512df5-bef6-44d1-b1d0-5c7082a35fa7 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:53.649827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 238/469] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:53.650817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd512df5-bef6-44d1-b1d0-5c7082a35fa7 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:53.669104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:53.704036 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 232/470] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:53.704881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb67930-c9cc-43f2-80f5-e9d3eeed9045 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:53.768632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd512df5-bef6-44d1-b1d0-5c7082a35fa7 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:53.804587 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe609b-0550-4881-beff-34939a22d854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:53.805846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe609b-0550-4881-beff-34939a22d854 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:53.806133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe609b-0550-4881-beff-34939a22d854 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:53.806414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe609b-0550-4881-beff-34939a22d854 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:53.807171 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe609b-0550-4881-beff-34939a22d854 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:53.808630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe609b-0550-4881-beff-34939a22d854 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:53.809418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb67930-c9cc-43f2-80f5-e9d3eeed9045 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:53.822904 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:53.835362 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 239/471] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:35:53 2022] POST /identity/v3/users => generated 248 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:35:53.836649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe609b-0550-4881-beff-34939a22d854 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:53.902269 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f155c66-f4d8-4b26-ac6b-77e4409ef8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:53.903336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f155c66-f4d8-4b26-ac6b-77e4409ef8db None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:53.903760 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f155c66-f4d8-4b26-ac6b-77e4409ef8db None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:53.904178 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f155c66-f4d8-4b26-ac6b-77e4409ef8db None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:53.905030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f155c66-f4d8-4b26-ac6b-77e4409ef8db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:53.906660 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f155c66-f4d8-4b26-ac6b-77e4409ef8db None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:53.932412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:53.960448 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 233/472] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:35:53 2022] POST /identity/v3/users => generated 248 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:35:53.976962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe609b-0550-4881-beff-34939a22d854 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:54.017808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a5084-d791-4cce-8ecb-1c82b0027b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:54.018632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a5084-d791-4cce-8ecb-1c82b0027b8f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:54.018950 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a5084-d791-4cce-8ecb-1c82b0027b8f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:54.019227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a5084-d791-4cce-8ecb-1c82b0027b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:54.033164 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a5084-d791-4cce-8ecb-1c82b0027b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:54.034686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a5084-d791-4cce-8ecb-1c82b0027b8f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:54.041002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38282a88-2ccf-4a5b-8ebf-9937534ac543 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:54.041316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38282a88-2ccf-4a5b-8ebf-9937534ac543 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:54.041574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38282a88-2ccf-4a5b-8ebf-9937534ac543 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:54.043316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 234/473] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:35:54.049015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa46ae-9b79-47ac-a6f6-af0dd981b8d5 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:54.049322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa46ae-9b79-47ac-a6f6-af0dd981b8d5 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:54.049587 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa46ae-9b79-47ac-a6f6-af0dd981b8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-dc1a5084-d791-4cce-8ecb-1c82b0027b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:35:54.054482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:54.055518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:54.056460 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:35:54.056460 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:35:54.056460 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:54.056460 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:54.057611 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 240/474] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:54.063409 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a5084-d791-4cce-8ecb-1c82b0027b8f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:54.070320 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-31aa46ae-9b79-47ac-a6f6-af0dd981b8d5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:54.071919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-31aa46ae-9b79-47ac-a6f6-af0dd981b8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:54.167432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 235/475] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:54.191691 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa46ae-9b79-47ac-a6f6-af0dd981b8d5 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:54.202677 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a5084-d791-4cce-8ecb-1c82b0027b8f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:54.228746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:54.255760 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00a372-cc52-41b7-8d99-cbb9ead29a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:54.256441 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a372-cc52-41b7-8d99-cbb9ead29a04 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:54.256723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a372-cc52-41b7-8d99-cbb9ead29a04 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:54.257001 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a372-cc52-41b7-8d99-cbb9ead29a04 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:54.257831 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00a372-cc52-41b7-8d99-cbb9ead29a04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:54.258149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00a372-cc52-41b7-8d99-cbb9ead29a04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:54.259773 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00a372-cc52-41b7-8d99-cbb9ead29a04 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:54.272927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 241/476] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:35:54.279485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00a372-cc52-41b7-8d99-cbb9ead29a04 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:54.324253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:54.335815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa46ae-9b79-47ac-a6f6-af0dd981b8d5 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:54.379418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88632b7-cc09-4d22-922f-5efa6f306252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:54.380060 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88632b7-cc09-4d22-922f-5efa6f306252 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:54.380339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88632b7-cc09-4d22-922f-5efa6f306252 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:54.380612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88632b7-cc09-4d22-922f-5efa6f306252 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:54.381371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88632b7-cc09-4d22-922f-5efa6f306252 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:54.382892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88632b7-cc09-4d22-922f-5efa6f306252 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:54.399890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.sql.core [None req-d88632b7-cc09-4d22-922f-5efa6f306252 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 03:35:54.399890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 30 03:35:54.399890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [parameters: {'id': '0e8d54b21ede49d1a4d04fbe8a705666', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 30 03:35:54.399890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87039) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 03:35:54.414697 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00a372-cc52-41b7-8d99-cbb9ead29a04 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-d88632b7-cc09-4d22-922f-5efa6f306252 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application conn.query(q) Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application result.read() Jun 30 03:35:54.430494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return ref.to_dict() Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 03:35:54.431477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application next(self.gen) Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application yield resource Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application next(self.gen) Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise self.value Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application session.commit() Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 03:35:54.432980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self.session.flush() Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application compat.raise_( Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 03:35:54.433871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 03:35:54.434789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application conn.query(q) Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application result.read() Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 03:35:54.435601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [parameters: {'id': '0e8d54b21ede49d1a4d04fbe8a705666', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:54.437208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 30 03:35:54.439340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:54.451117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 236/477] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 30 03:35:54 2022] POST /identity/v3/roles => generated 144 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:35:54.451117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88632b7-cc09-4d22-922f-5efa6f306252 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:54.469293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b973a5-7e14-41db-8c49-2ce54cc4156e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:54.470343 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b973a5-7e14-41db-8c49-2ce54cc4156e None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:54.470869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b973a5-7e14-41db-8c49-2ce54cc4156e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:54.471339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b973a5-7e14-41db-8c49-2ce54cc4156e None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:54.472273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b973a5-7e14-41db-8c49-2ce54cc4156e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:54.473991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b973a5-7e14-41db-8c49-2ce54cc4156e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:54.502606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 242/478] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:35:54 2022] POST /identity/v3/users => generated 249 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:35:54.579116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88632b7-cc09-4d22-922f-5efa6f306252 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:54.616722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20986ee-0e25-45e4-9524-4f7facdb44d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:54.617607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20986ee-0e25-45e4-9524-4f7facdb44d5 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:54.617891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20986ee-0e25-45e4-9524-4f7facdb44d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:54.618171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20986ee-0e25-45e4-9524-4f7facdb44d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:54.629954 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20986ee-0e25-45e4-9524-4f7facdb44d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-f20986ee-0e25-45e4-9524-4f7facdb44d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:54.638976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:54.639861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:54.640808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:54.640808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:54.640808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:54.640808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:54.640808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:54.640808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:54.640808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:54.640808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:54.640808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:54.640808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:54.640808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 03:35:54.640808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:54.640808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 237/479] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:35:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:35:54.651965 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b973a5-7e14-41db-8c49-2ce54cc4156e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:54.715999 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:54.804342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b973a5-7e14-41db-8c49-2ce54cc4156e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:54.848310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e1d66-21e1-415d-8de1-2f6e833426ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:54.849740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e1d66-21e1-415d-8de1-2f6e833426ad None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:54.850220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e1d66-21e1-415d-8de1-2f6e833426ad None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:54.850685 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e1d66-21e1-415d-8de1-2f6e833426ad None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:54.851783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e1d66-21e1-415d-8de1-2f6e833426ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:54.852310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e1d66-21e1-415d-8de1-2f6e833426ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:54.853909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e1d66-21e1-415d-8de1-2f6e833426ad None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:54.863355 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 243/480] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:35:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:55.921735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ecc85-c1a1-46da-a8ef-2af66b83be62 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:55.922693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ecc85-c1a1-46da-a8ef-2af66b83be62 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:55.923212 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ecc85-c1a1-46da-a8ef-2af66b83be62 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:55.925060 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 238/481] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:55.930213 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f679635-13fe-446d-918e-89b6a13ec7f4 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:55.931106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f679635-13fe-446d-918e-89b6a13ec7f4 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:55.931606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f679635-13fe-446d-918e-89b6a13ec7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:55.958685 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-8f679635-13fe-446d-918e-89b6a13ec7f4 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:55.960227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8f679635-13fe-446d-918e-89b6a13ec7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:56.052301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 244/482] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:56.075281 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ecc85-c1a1-46da-a8ef-2af66b83be62 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:56.103661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:56.204495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ecc85-c1a1-46da-a8ef-2af66b83be62 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:56.253346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3d80d-0391-42a5-92ef-638fd2b39df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:56.254529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3d80d-0391-42a5-92ef-638fd2b39df5 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:56.255038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3d80d-0391-42a5-92ef-638fd2b39df5 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:56.255530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3d80d-0391-42a5-92ef-638fd2b39df5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:56.271249 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3d80d-0391-42a5-92ef-638fd2b39df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-e5f3d80d-0391-42a5-92ef-638fd2b39df5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:56.279579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:56.280483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:56.281372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:56.281372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:56.281372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:56.281372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:56.281372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:56.281372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:56.281372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:56.281372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:56.281372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:56.281372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:56.281372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:35:56.281372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:56.283809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 239/483] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:35:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:56.289839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f679635-13fe-446d-918e-89b6a13ec7f4 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:56.327716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:56.453601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f679635-13fe-446d-918e-89b6a13ec7f4 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:56.489798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363089cd-e2c8-4f4e-93a3-7bf05ec2f01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:56.490400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363089cd-e2c8-4f4e-93a3-7bf05ec2f01a None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:56.490684 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363089cd-e2c8-4f4e-93a3-7bf05ec2f01a None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:56.490988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363089cd-e2c8-4f4e-93a3-7bf05ec2f01a None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:56.491790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363089cd-e2c8-4f4e-93a3-7bf05ec2f01a None admin] RBAC: Adding query filter params (name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:56.492141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363089cd-e2c8-4f4e-93a3-7bf05ec2f01a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:56.493658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363089cd-e2c8-4f4e-93a3-7bf05ec2f01a None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:56.502540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 245/484] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:35:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:56.507798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3d80d-0391-42a5-92ef-638fd2b39df5 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:56.510847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602afbf-1743-434d-815d-254e4aba780b None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:56.511156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602afbf-1743-434d-815d-254e4aba780b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:56.511431 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602afbf-1743-434d-815d-254e4aba780b None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:56.512996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 246/485] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:35:56.517820 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8d56b-1425-45cc-bed0-2ab66d680c6a None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:56.518113 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8d56b-1425-45cc-bed0-2ab66d680c6a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:56.518397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8d56b-1425-45cc-bed0-2ab66d680c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:56.537502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6bc8d56b-1425-45cc-bed0-2ab66d680c6a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:56.538781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6bc8d56b-1425-45cc-bed0-2ab66d680c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:56.638375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:56.663031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3d80d-0391-42a5-92ef-638fd2b39df5 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:56.671749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 247/486] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:56.673157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d73a-ca14-4017-a637-735237776739 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:56.673452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d73a-ca14-4017-a637-735237776739 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:56.673731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d73a-ca14-4017-a637-735237776739 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:56.675160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 248/487] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:56.680513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e00c-f4f9-45b3-9e0a-2241d2c5ebec None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:56.680800 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e00c-f4f9-45b3-9e0a-2241d2c5ebec None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:56.681081 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e00c-f4f9-45b3-9e0a-2241d2c5ebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:56.704933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-9ac6e00c-f4f9-45b3-9e0a-2241d2c5ebec None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:56.706365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9ac6e00c-f4f9-45b3-9e0a-2241d2c5ebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:56.716326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e7f51-8486-44ad-8f41-7a49bfce9a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:56.717147 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e7f51-8486-44ad-8f41-7a49bfce9a3d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:56.717433 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e7f51-8486-44ad-8f41-7a49bfce9a3d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:56.718066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e7f51-8486-44ad-8f41-7a49bfce9a3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:56.723105 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:56.732462 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e7f51-8486-44ad-8f41-7a49bfce9a3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:56.734233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e7f51-8486-44ad-8f41-7a49bfce9a3d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-7b5e7f51-8486-44ad-8f41-7a49bfce9a3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:35:56.756041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:56.757109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:56.758472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:35:56.758472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:35:56.758472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:56.758472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:56.758472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 240/488] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:56.759038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e7f51-8486-44ad-8f41-7a49bfce9a3d None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:56.798891 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 249/489] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:35:56.800236 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6e00c-f4f9-45b3-9e0a-2241d2c5ebec None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:56.890411 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e7f51-8486-44ad-8f41-7a49bfce9a3d None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:56.921140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6e00c-f4f9-45b3-9e0a-2241d2c5ebec None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:56.922072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:56.927814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe9316-7065-497f-a083-b96c0440dd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:56.929035 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9316-7065-497f-a083-b96c0440dd5a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:56.929681 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9316-7065-497f-a083-b96c0440dd5a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:56.930161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9316-7065-497f-a083-b96c0440dd5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:56.941369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe9316-7065-497f-a083-b96c0440dd5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-babe9316-7065-497f-a083-b96c0440dd5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:56.949426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:56.950541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:56.951437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:56.951437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:56.951437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:56.951437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:56.951437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:56.951437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:56.951437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:56.951437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:56.951437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:56.951437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:56.951437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:35:56.951437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:56.952272 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 241/490] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:35:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:56.952988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe9316-7065-497f-a083-b96c0440dd5a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:56.966882 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d97ee-f6d9-4f7c-8924-3652d81aaeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:56.968338 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d97ee-f6d9-4f7c-8924-3652d81aaeb6 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:56.968862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d97ee-f6d9-4f7c-8924-3652d81aaeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:56.969311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d97ee-f6d9-4f7c-8924-3652d81aaeb6 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:56.970313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d97ee-f6d9-4f7c-8924-3652d81aaeb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:56.970943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d97ee-f6d9-4f7c-8924-3652d81aaeb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:56.972635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d97ee-f6d9-4f7c-8924-3652d81aaeb6 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:56.986792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 250/491] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:56.987996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d97ee-f6d9-4f7c-8924-3652d81aaeb6 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:57.001865 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:57.056528 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe9316-7065-497f-a083-b96c0440dd5a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:57.091537 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24084f5e-2486-4ee5-a456-b8a3469327c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:57.092231 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24084f5e-2486-4ee5-a456-b8a3469327c7 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:57.092579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24084f5e-2486-4ee5-a456-b8a3469327c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:57.092920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24084f5e-2486-4ee5-a456-b8a3469327c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:57.104258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24084f5e-2486-4ee5-a456-b8a3469327c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:57.105977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d97ee-f6d9-4f7c-8924-3652d81aaeb6 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-24084f5e-2486-4ee5-a456-b8a3469327c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:57.112314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:57.113227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:57.114246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:57.114246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:57.114246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:57.114246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:57.114246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:57.114246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:57.114246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:57.114246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:57.114246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:57.114246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:57.114246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:35:57.114246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:57.114246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 242/492] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:35:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:57.115131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24084f5e-2486-4ee5-a456-b8a3469327c7 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:57.146169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997f53b-acf2-4fe0-8a75-49c1870b08dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:57.147290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997f53b-acf2-4fe0-8a75-49c1870b08dd None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:57.147777 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997f53b-acf2-4fe0-8a75-49c1870b08dd None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:57.148324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997f53b-acf2-4fe0-8a75-49c1870b08dd None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:57.149256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997f53b-acf2-4fe0-8a75-49c1870b08dd None admin] RBAC: Adding query filter params (name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:57.149739 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997f53b-acf2-4fe0-8a75-49c1870b08dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:57.151544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997f53b-acf2-4fe0-8a75-49c1870b08dd None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:57.161684 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 251/493] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:35:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:57.162967 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997f53b-acf2-4fe0-8a75-49c1870b08dd None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:57.170875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:57.221320 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24084f5e-2486-4ee5-a456-b8a3469327c7 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:57.242867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:57.256665 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e4656-1f6d-43b1-9f98-f3d67f4354a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:57.257634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e4656-1f6d-43b1-9f98-f3d67f4354a9 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:57.258004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e4656-1f6d-43b1-9f98-f3d67f4354a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:57.258394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e4656-1f6d-43b1-9f98-f3d67f4354a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:57.266610 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e4656-1f6d-43b1-9f98-f3d67f4354a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:57.268176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e4656-1f6d-43b1-9f98-f3d67f4354a9 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:57.280089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997f53b-acf2-4fe0-8a75-49c1870b08dd None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-c51e4656-1f6d-43b1-9f98-f3d67f4354a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:35:57.284495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:57.285382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:57.286516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:57.286516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:57.286516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:35:57.286516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:35:57.286516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:35:57.286516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:35:57.286516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:35:57.286516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:35:57.286516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:35:57.286516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:57.286516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 243/494] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 03:35:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:57.287456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e4656-1f6d-43b1-9f98-f3d67f4354a9 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:57.320833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590d8c-508e-414e-b22d-d980e3209acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:57.321812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590d8c-508e-414e-b22d-d980e3209acd None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:57.322269 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590d8c-508e-414e-b22d-d980e3209acd None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:57.322716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590d8c-508e-414e-b22d-d980e3209acd None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:57.323810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2590d8c-508e-414e-b22d-d980e3209acd None admin] RBAC: Adding query filter params (name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:57.324342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2590d8c-508e-414e-b22d-d980e3209acd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:57.325889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2590d8c-508e-414e-b22d-d980e3209acd None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:57.335675 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 252/495] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:35:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:57.336859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590d8c-508e-414e-b22d-d980e3209acd None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:57.392255 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e4656-1f6d-43b1-9f98-f3d67f4354a9 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:57.405590 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:57.427299 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bc77d-9efc-4c30-96b7-3b065bd3ba0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:57.428110 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bc77d-9efc-4c30-96b7-3b065bd3ba0f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:57.428390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bc77d-9efc-4c30-96b7-3b065bd3ba0f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:57.428660 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bc77d-9efc-4c30-96b7-3b065bd3ba0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:57.439212 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bc77d-9efc-4c30-96b7-3b065bd3ba0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:57.440690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bc77d-9efc-4c30-96b7-3b065bd3ba0f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:57.445434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590d8c-508e-414e-b22d-d980e3209acd None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-722bc77d-9efc-4c30-96b7-3b065bd3ba0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:35:57.458287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:57.459174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:57.460058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:35:57.460058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:35:57.460058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:57.460058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:57.460058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 244/496] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:57.460317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bc77d-9efc-4c30-96b7-3b065bd3ba0f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:57.483596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff4e59-4936-463a-878e-536fc614f0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:57.484274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff4e59-4936-463a-878e-536fc614f0a4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:57.484563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff4e59-4936-463a-878e-536fc614f0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:57.484826 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff4e59-4936-463a-878e-536fc614f0a4 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:57.485675 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff4e59-4936-463a-878e-536fc614f0a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:57.485985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff4e59-4936-463a-878e-536fc614f0a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:57.487482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff4e59-4936-463a-878e-536fc614f0a4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:57.489502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:57.524781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 253/497] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 03:35:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:57.526160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf08b-caa9-43cb-822e-dde8808cd6b4 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:57.526453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf08b-caa9-43cb-822e-dde8808cd6b4 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:57.526734 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf08b-caa9-43cb-822e-dde8808cd6b4 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:57.530824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 254/498] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:57.530824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b16f1-0062-4943-bad4-4525b883f5f5 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:57.530824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b16f1-0062-4943-bad4-4525b883f5f5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:57.530824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b16f1-0062-4943-bad4-4525b883f5f5 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:57.531421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 255/499] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:35:57.532112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b16f1-0062-4943-bad4-4525b883f5f5 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:57.567995 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bc77d-9efc-4c30-96b7-3b065bd3ba0f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:57.602539 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06db0c-bb37-4ffc-93ed-26274650dcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:57.603370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06db0c-bb37-4ffc-93ed-26274650dcdd None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:57.603648 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06db0c-bb37-4ffc-93ed-26274650dcdd None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:57.603919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06db0c-bb37-4ffc-93ed-26274650dcdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:57.614277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06db0c-bb37-4ffc-93ed-26274650dcdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:57.615767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06db0c-bb37-4ffc-93ed-26274650dcdd None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-bf06db0c-bb37-4ffc-93ed-26274650dcdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:35:57.632194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:57.638280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:57.639393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:35:57.639393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:35:57.639393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:57.639393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:57.639651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b16f1-0062-4943-bad4-4525b883f5f5 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:57.639735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 245/500] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:57.639735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06db0c-bb37-4ffc-93ed-26274650dcdd None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:57.653268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:57.676364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbaa679-3ae0-40dd-b834-e3d71bd62bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:57.677024 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaa679-3ae0-40dd-b834-e3d71bd62bba None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:57.677307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaa679-3ae0-40dd-b834-e3d71bd62bba None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:57.677581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaa679-3ae0-40dd-b834-e3d71bd62bba None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:57.678290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbaa679-3ae0-40dd-b834-e3d71bd62bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:57.678609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbaa679-3ae0-40dd-b834-e3d71bd62bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:57.680698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbaa679-3ae0-40dd-b834-e3d71bd62bba None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:57.692154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 256/501] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:57.693333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745febc6-7e5f-4f90-8073-3e182f9f79dc None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:57.693624 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745febc6-7e5f-4f90-8073-3e182f9f79dc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:57.693901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745febc6-7e5f-4f90-8073-3e182f9f79dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:57.710264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-745febc6-7e5f-4f90-8073-3e182f9f79dc None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:57.712174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-745febc6-7e5f-4f90-8073-3e182f9f79dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:57.737386 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06db0c-bb37-4ffc-93ed-26274650dcdd None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:57.760554 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:57.772203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a551aa-2d6c-4848-a197-a680dd885755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:57.773063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a551aa-2d6c-4848-a197-a680dd885755 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:57.773361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a551aa-2d6c-4848-a197-a680dd885755 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:57.773642 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a551aa-2d6c-4848-a197-a680dd885755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:57.784121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 257/502] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:57.797358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6436df-8d29-4528-9bed-de7b8de6adb5 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:57.797358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6436df-8d29-4528-9bed-de7b8de6adb5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:57.797358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6436df-8d29-4528-9bed-de7b8de6adb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:57.802917 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-ed6436df-8d29-4528-9bed-de7b8de6adb5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:35:57.804131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ed6436df-8d29-4528-9bed-de7b8de6adb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:35:57.857764 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a551aa-2d6c-4848-a197-a680dd885755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:57.859209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a551aa-2d6c-4848-a197-a680dd885755 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:57.874314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 258/503] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:35:57.875199 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6436df-8d29-4528-9bed-de7b8de6adb5 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:57.889176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:57.971063 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6436df-8d29-4528-9bed-de7b8de6adb5 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:57.971601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 246/504] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:57.972115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a551aa-2d6c-4848-a197-a680dd885755 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:57.986466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:58.010400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105eb4d-5d8f-43f9-98ce-80564ce5195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:58.011110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105eb4d-5d8f-43f9-98ce-80564ce5195b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:58.011394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105eb4d-5d8f-43f9-98ce-80564ce5195b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:58.011667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105eb4d-5d8f-43f9-98ce-80564ce5195b None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:58.012394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105eb4d-5d8f-43f9-98ce-80564ce5195b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:58.012699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105eb4d-5d8f-43f9-98ce-80564ce5195b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:58.014090 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105eb4d-5d8f-43f9-98ce-80564ce5195b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:58.025407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 259/505] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:58.026184 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105eb4d-5d8f-43f9-98ce-80564ce5195b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:58.070375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a551aa-2d6c-4848-a197-a680dd885755 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:58.087442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:58.105381 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754cc6f-c0e9-4579-8ae7-b4b7d1bac274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:58.106178 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754cc6f-c0e9-4579-8ae7-b4b7d1bac274 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:58.106452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754cc6f-c0e9-4579-8ae7-b4b7d1bac274 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:58.106724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754cc6f-c0e9-4579-8ae7-b4b7d1bac274 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:58.113803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754cc6f-c0e9-4579-8ae7-b4b7d1bac274 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:58.115230 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754cc6f-c0e9-4579-8ae7-b4b7d1bac274 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:58.123778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105eb4d-5d8f-43f9-98ce-80564ce5195b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-e754cc6f-c0e9-4579-8ae7-b4b7d1bac274 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:35:58.129465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:58.130500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:58.131425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:58.131425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:58.131425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:35:58.131425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:35:58.131425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:35:58.131425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:35:58.131425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:35:58.131425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:35:58.131425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 03:35:58.131425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:58.131425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 247/506] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:58.131425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754cc6f-c0e9-4579-8ae7-b4b7d1bac274 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:58.158966 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3698e1-c85c-4001-9193-4cf80c6991ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:58.159771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3698e1-c85c-4001-9193-4cf80c6991ae None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:58.160050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3698e1-c85c-4001-9193-4cf80c6991ae None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:58.160324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3698e1-c85c-4001-9193-4cf80c6991ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:58.170937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3698e1-c85c-4001-9193-4cf80c6991ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-1b3698e1-c85c-4001-9193-4cf80c6991ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:35:58.178678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:58.179699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:58.180495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:58.180495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:58.180495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:58.180495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:58.180495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:35:58.180495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:35:58.180495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:35:58.180495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:35:58.180495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:35:58.180495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:35:58.180495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:35:58.180495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:58.180495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 260/507] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:35:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:58.181133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3698e1-c85c-4001-9193-4cf80c6991ae None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:58.215525 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:58.236965 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754cc6f-c0e9-4579-8ae7-b4b7d1bac274 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:58.272298 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089223e-5a3e-4cdf-8ba2-56a286c73b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:58.273231 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089223e-5a3e-4cdf-8ba2-56a286c73b33 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:58.273645 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089223e-5a3e-4cdf-8ba2-56a286c73b33 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:58.273919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089223e-5a3e-4cdf-8ba2-56a286c73b33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:58.283401 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3698e1-c85c-4001-9193-4cf80c6991ae None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:58.284127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089223e-5a3e-4cdf-8ba2-56a286c73b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:58.285622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089223e-5a3e-4cdf-8ba2-56a286c73b33 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-4089223e-5a3e-4cdf-8ba2-56a286c73b33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:35:58.303435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:58.304392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:58.305287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:35:58.305287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:35:58.305287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:58.305287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:58.305287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 248/508] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:58.305857 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089223e-5a3e-4cdf-8ba2-56a286c73b33 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:58.321689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce194ef2-b7a7-4e56-a1d0-8fe3652f9d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:58.322489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194ef2-b7a7-4e56-a1d0-8fe3652f9d2f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:58.322811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194ef2-b7a7-4e56-a1d0-8fe3652f9d2f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:58.323134 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194ef2-b7a7-4e56-a1d0-8fe3652f9d2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:58.333789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce194ef2-b7a7-4e56-a1d0-8fe3652f9d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:58.334409 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:58.335350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce194ef2-b7a7-4e56-a1d0-8fe3652f9d2f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-ce194ef2-b7a7-4e56-a1d0-8fe3652f9d2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:35:58.353345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:58.354206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:58.355292 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:35:58.355292 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:35:58.355292 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:58.355292 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:58.355292 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 261/509] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:58.355654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce194ef2-b7a7-4e56-a1d0-8fe3652f9d2f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:58.408544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089223e-5a3e-4cdf-8ba2-56a286c73b33 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:58.438019 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:58.443401 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7b977-0dbd-471a-9c69-9a08d4f211a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:58.444198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7b977-0dbd-471a-9c69-9a08d4f211a5 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:58.444472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7b977-0dbd-471a-9c69-9a08d4f211a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:58.444818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7b977-0dbd-471a-9c69-9a08d4f211a5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:58.453217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7b977-0dbd-471a-9c69-9a08d4f211a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:58.454693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7b977-0dbd-471a-9c69-9a08d4f211a5 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:58.456301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce194ef2-b7a7-4e56-a1d0-8fe3652f9d2f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-35b7b977-0dbd-471a-9c69-9a08d4f211a5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:35:58.468937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:58.470015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:58.471083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:58.471083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:58.471083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:35:58.471083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:35:58.471083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:35:58.471083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:35:58.471083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:35:58.471083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:35:58.471083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 03:35:58.471083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:58.471083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 249/510] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:35:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:58.471083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7b977-0dbd-471a-9c69-9a08d4f211a5 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:58.494888 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342829b8-d69e-4bb7-b793-eb17992ace24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:58.495573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342829b8-d69e-4bb7-b793-eb17992ace24 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:58.495859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342829b8-d69e-4bb7-b793-eb17992ace24 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:58.496140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342829b8-d69e-4bb7-b793-eb17992ace24 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:58.497030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342829b8-d69e-4bb7-b793-eb17992ace24 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:58.497343 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342829b8-d69e-4bb7-b793-eb17992ace24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:58.498820 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342829b8-d69e-4bb7-b793-eb17992ace24 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:58.516613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 262/511] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 30 03:35:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:58.517414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342829b8-d69e-4bb7-b793-eb17992ace24 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:58.558952 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:58.571080 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7b977-0dbd-471a-9c69-9a08d4f211a5 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:58.606136 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae02d5-a328-490d-bd33-86f83de67490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:58.606822 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae02d5-a328-490d-bd33-86f83de67490 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:58.607135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae02d5-a328-490d-bd33-86f83de67490 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:58.607385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae02d5-a328-490d-bd33-86f83de67490 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:58.608152 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae02d5-a328-490d-bd33-86f83de67490 None admin] RBAC: Adding query filter params (name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:58.608449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae02d5-a328-490d-bd33-86f83de67490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:58.609818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae02d5-a328-490d-bd33-86f83de67490 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:58.618036 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 250/512] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:35:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:58.618277 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342829b8-d69e-4bb7-b793-eb17992ace24 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:58.618863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae02d5-a328-490d-bd33-86f83de67490 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:58.656989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00338358-4d59-4137-ae6a-51a021ba79e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:58.657656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338358-4d59-4137-ae6a-51a021ba79e4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:58.657943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338358-4d59-4137-ae6a-51a021ba79e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:58.658222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338358-4d59-4137-ae6a-51a021ba79e4 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:58.659033 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00338358-4d59-4137-ae6a-51a021ba79e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:58.659291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00338358-4d59-4137-ae6a-51a021ba79e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:58.660709 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00338358-4d59-4137-ae6a-51a021ba79e4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:58.672149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 263/513] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:58.672932 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00338358-4d59-4137-ae6a-51a021ba79e4 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:58.675542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:58.718748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae02d5-a328-490d-bd33-86f83de67490 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:58.753040 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6e920-d158-49b3-a54a-70b0bf720a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:58.753701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6e920-d158-49b3-a54a-70b0bf720a00 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:58.753977 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6e920-d158-49b3-a54a-70b0bf720a00 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:58.754245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6e920-d158-49b3-a54a-70b0bf720a00 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:58.755009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6e920-d158-49b3-a54a-70b0bf720a00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:58.755315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6e920-d158-49b3-a54a-70b0bf720a00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:58.756691 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6e920-d158-49b3-a54a-70b0bf720a00 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:58.768498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 251/514] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:58.769297 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6e920-d158-49b3-a54a-70b0bf720a00 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:58.774138 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00338358-4d59-4137-ae6a-51a021ba79e4 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:58.789808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:58.809247 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca520178-66c0-40bf-a257-6129d2f9a2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:58.809921 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca520178-66c0-40bf-a257-6129d2f9a2f3 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:58.810204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca520178-66c0-40bf-a257-6129d2f9a2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:58.810474 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca520178-66c0-40bf-a257-6129d2f9a2f3 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:58.811328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca520178-66c0-40bf-a257-6129d2f9a2f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:58.811638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca520178-66c0-40bf-a257-6129d2f9a2f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:58.813078 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca520178-66c0-40bf-a257-6129d2f9a2f3 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:58.830459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 264/515] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 30 03:35:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:58.831510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca520178-66c0-40bf-a257-6129d2f9a2f3 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:58.891414 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6e920-d158-49b3-a54a-70b0bf720a00 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:58.895377 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:58.925240 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef797d20-b157-421b-b244-f50f6ad56dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:58.925819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef797d20-b157-421b-b244-f50f6ad56dc1 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:58.926100 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef797d20-b157-421b-b244-f50f6ad56dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:58.926381 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef797d20-b157-421b-b244-f50f6ad56dc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:58.937511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca520178-66c0-40bf-a257-6129d2f9a2f3 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:58.972314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f9c60-b612-415a-ad69-6d74be6128e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:58.973164 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f9c60-b612-415a-ad69-6d74be6128e2 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:58.973452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f9c60-b612-415a-ad69-6d74be6128e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:58.973721 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f9c60-b612-415a-ad69-6d74be6128e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:58.984634 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f9c60-b612-415a-ad69-6d74be6128e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:58.986090 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f9c60-b612-415a-ad69-6d74be6128e2 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:58.993218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef797d20-b157-421b-b244-f50f6ad56dc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:58.994676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef797d20-b157-421b-b244-f50f6ad56dc1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-6e0f9c60-b612-415a-ad69-6d74be6128e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:35:59.004434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:59.005451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:59.006274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:35:59.006274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:35:59.006274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:59.006274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:59.006274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 265/516] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:59.006685 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f9c60-b612-415a-ad69-6d74be6128e2 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:59.007385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:59.097454 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 252/517] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:59.098424 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef797d20-b157-421b-b244-f50f6ad56dc1 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:59.106555 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f9c60-b612-415a-ad69-6d74be6128e2 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:59.120263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:59.141499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220dafd-98c8-4629-987a-d6b8f667b43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:59.142175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220dafd-98c8-4629-987a-d6b8f667b43b None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:59.142456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220dafd-98c8-4629-987a-d6b8f667b43b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:59.142731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220dafd-98c8-4629-987a-d6b8f667b43b None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:59.143475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220dafd-98c8-4629-987a-d6b8f667b43b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:59.144931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220dafd-98c8-4629-987a-d6b8f667b43b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:59.165699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 266/518] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:35:59 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:35:59.166705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220dafd-98c8-4629-987a-d6b8f667b43b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:59.224162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef797d20-b157-421b-b244-f50f6ad56dc1 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:59.236143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:59.265358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178db9af-455c-4a7e-9f08-43529f553820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:59.266192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db9af-455c-4a7e-9f08-43529f553820 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:59.266473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db9af-455c-4a7e-9f08-43529f553820 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:59.266748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db9af-455c-4a7e-9f08-43529f553820 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:59.274783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178db9af-455c-4a7e-9f08-43529f553820 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:59.276316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178db9af-455c-4a7e-9f08-43529f553820 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:59.280339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220dafd-98c8-4629-987a-d6b8f667b43b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-178db9af-455c-4a7e-9f08-43529f553820 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:35:59.292108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:59.293055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:59.293887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:35:59.293887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:35:59.293887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:35:59.293887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:35:59.293887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:35:59.293887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:35:59.293887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:35:59.293887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:59.293887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 253/519] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:59.294343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178db9af-455c-4a7e-9f08-43529f553820 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:59.331612 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ebf9b-8ac0-47d2-a944-caf5be327c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:59.332710 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ebf9b-8ac0-47d2-a944-caf5be327c64 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:59.332710 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ebf9b-8ac0-47d2-a944-caf5be327c64 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:59.332888 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ebf9b-8ac0-47d2-a944-caf5be327c64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:59.375370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:59.406668 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178db9af-455c-4a7e-9f08-43529f553820 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:59.410833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ebf9b-8ac0-47d2-a944-caf5be327c64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:59.412326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ebf9b-8ac0-47d2-a944-caf5be327c64 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:59.443403 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6409b-64c8-411e-9a8f-5ebc572610fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:59.444080 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6409b-64c8-411e-9a8f-5ebc572610fd None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:59.444363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6409b-64c8-411e-9a8f-5ebc572610fd None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:59.444679 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6409b-64c8-411e-9a8f-5ebc572610fd None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:59.445440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6409b-64c8-411e-9a8f-5ebc572610fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:59.445744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6409b-64c8-411e-9a8f-5ebc572610fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:59.447165 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6409b-64c8-411e-9a8f-5ebc572610fd None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:59.459868 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 254/520] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:59.460883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6409b-64c8-411e-9a8f-5ebc572610fd None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:59.494728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:59.521728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 267/521] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:35:59.522664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ebf9b-8ac0-47d2-a944-caf5be327c64 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:59.576201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6409b-64c8-411e-9a8f-5ebc572610fd None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:59.595531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:59.613988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2a683-6a1b-4d35-9134-610a474e00eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:59.614798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a683-6a1b-4d35-9134-610a474e00eb None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:59.615088 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a683-6a1b-4d35-9134-610a474e00eb None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:59.615366 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a683-6a1b-4d35-9134-610a474e00eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:59.626614 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2a683-6a1b-4d35-9134-610a474e00eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:59.628118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2a683-6a1b-4d35-9134-610a474e00eb None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:59.630636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ebf9b-8ac0-47d2-a944-caf5be327c64 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-1fb2a683-6a1b-4d35-9134-610a474e00eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:35:59.646027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:59.647101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:59.648202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:35:59.648202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:35:59.648202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:59.648202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:59.651905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 255/522] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:59.652761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2a683-6a1b-4d35-9134-610a474e00eb None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:59.669582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c621df0-6144-4061-8f66-00609c185257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:59.670472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c621df0-6144-4061-8f66-00609c185257 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:59.670939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c621df0-6144-4061-8f66-00609c185257 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:59.671353 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c621df0-6144-4061-8f66-00609c185257 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:59.672309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c621df0-6144-4061-8f66-00609c185257 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:59.672756 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c621df0-6144-4061-8f66-00609c185257 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:59.674339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c621df0-6144-4061-8f66-00609c185257 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:59.692476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 268/523] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:35:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:35:59.693111 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c621df0-6144-4061-8f66-00609c185257 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:59.744349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:59.765784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2a683-6a1b-4d35-9134-610a474e00eb None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:59.802744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ce458-08b9-43dc-98c0-6a4534ac205c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:59.803805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ce458-08b9-43dc-98c0-6a4534ac205c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:59.804151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ce458-08b9-43dc-98c0-6a4534ac205c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:59.804385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ce458-08b9-43dc-98c0-6a4534ac205c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:59.806095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c621df0-6144-4061-8f66-00609c185257 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:59.812053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ce458-08b9-43dc-98c0-6a4534ac205c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:59.813523 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ce458-08b9-43dc-98c0-6a4534ac205c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-1c8ce458-08b9-43dc-98c0-6a4534ac205c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:35:59.828708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:59.829808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:59.830895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:59.830895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:59.830895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:35:59.830895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:35:59.830895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:35:59.830895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:35:59.830895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:35:59.830895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:35:59.830895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 03:35:59.830895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:35:59.830895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 256/524] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:35:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:59.830895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ce458-08b9-43dc-98c0-6a4534ac205c None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:59.841373 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:35:59.853596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c94df-dbd3-4ad5-967e-611579462913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:59.854413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c94df-dbd3-4ad5-967e-611579462913 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:59.854694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c94df-dbd3-4ad5-967e-611579462913 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:59.855054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c94df-dbd3-4ad5-967e-611579462913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:59.866476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c94df-dbd3-4ad5-967e-611579462913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:59.868474 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c94df-dbd3-4ad5-967e-611579462913 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-186c94df-dbd3-4ad5-967e-611579462913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:35:59.893682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:35:59.894588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:35:59.895481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:35:59.895481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:35:59.895481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:35:59.895481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:35:59.899121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 269/525] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:35:59.900234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c94df-dbd3-4ad5-967e-611579462913 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:35:59.946519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ce458-08b9-43dc-98c0-6a4534ac205c None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:35:59.985945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58a2b5-8346-4c45-8081-f1ab920f0dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:35:59.986615 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58a2b5-8346-4c45-8081-f1ab920f0dff None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:35:59.986935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58a2b5-8346-4c45-8081-f1ab920f0dff None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:35:59.987210 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58a2b5-8346-4c45-8081-f1ab920f0dff None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:35:59.987950 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58a2b5-8346-4c45-8081-f1ab920f0dff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:35:59.988262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58a2b5-8346-4c45-8081-f1ab920f0dff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:35:59.989665 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58a2b5-8346-4c45-8081-f1ab920f0dff None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:00.001352 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 257/526] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:00.002256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58a2b5-8346-4c45-8081-f1ab920f0dff None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:00.004886 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:00.011618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c94df-dbd3-4ad5-967e-611579462913 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:00.046955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e0f6a-50e5-48ca-9690-9594116c0894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:00.047543 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e0f6a-50e5-48ca-9690-9594116c0894 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:00.047850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e0f6a-50e5-48ca-9690-9594116c0894 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:00.048126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e0f6a-50e5-48ca-9690-9594116c0894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:00.048969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e0f6a-50e5-48ca-9690-9594116c0894 None admin] RBAC: Adding query filter params (role.id=b9998a2301454764ae06a0f743463c5d, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=758b152c320e4a94921bb96541cbea98) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:00.049284 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e0f6a-50e5-48ca-9690-9594116c0894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:00.050737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e0f6a-50e5-48ca-9690-9594116c0894 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:00.057033 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 270/527] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:35:59 2022] GET /identity/v3/role_assignments?user.id=758b152c320e4a94921bb96541cbea98&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b9998a2301454764ae06a0f743463c5d => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:00.059582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e0f6a-50e5-48ca-9690-9594116c0894 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:00.123097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:00.131661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58a2b5-8346-4c45-8081-f1ab920f0dff None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:00.185605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd97889-cb20-4e34-b159-4876235cf271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:00.187225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97889-cb20-4e34-b159-4876235cf271 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:00.187696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97889-cb20-4e34-b159-4876235cf271 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:00.188143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97889-cb20-4e34-b159-4876235cf271 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:00.189045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e0f6a-50e5-48ca-9690-9594116c0894 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:00.189528 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd97889-cb20-4e34-b159-4876235cf271 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:00.190015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd97889-cb20-4e34-b159-4876235cf271 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:00.192838 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd97889-cb20-4e34-b159-4876235cf271 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:00.227550 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467da14e-2877-4f3d-b3d6-e44cf10d98c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:00.228040 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467da14e-2877-4f3d-b3d6-e44cf10d98c0 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:00.228383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467da14e-2877-4f3d-b3d6-e44cf10d98c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:00.228725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467da14e-2877-4f3d-b3d6-e44cf10d98c0 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:00.229525 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467da14e-2877-4f3d-b3d6-e44cf10d98c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:00.229861 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467da14e-2877-4f3d-b3d6-e44cf10d98c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:00.232145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467da14e-2877-4f3d-b3d6-e44cf10d98c0 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:00.242483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 258/528] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Jun 30 03:36:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:00.243693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd97889-cb20-4e34-b159-4876235cf271 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:00.252378 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 271/529] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:00.253349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467da14e-2877-4f3d-b3d6-e44cf10d98c0 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:00.315317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:00.350147 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd97889-cb20-4e34-b159-4876235cf271 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:00.384681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467da14e-2877-4f3d-b3d6-e44cf10d98c0 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:00.386036 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f71a3-65b2-494f-b3a1-e9f7a03d591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:00.387203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:00.387534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f71a3-65b2-494f-b3a1-e9f7a03d591b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:00.388858 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f71a3-65b2-494f-b3a1-e9f7a03d591b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:00.389372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f71a3-65b2-494f-b3a1-e9f7a03d591b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:00.398071 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f71a3-65b2-494f-b3a1-e9f7a03d591b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:00.400510 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f71a3-65b2-494f-b3a1-e9f7a03d591b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-b89f71a3-65b2-494f-b3a1-e9f7a03d591b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:00.418927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:00.419813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:00.420646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:00.420646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:00.420646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:00.420646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:00.420646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:00.420646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:00.420646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:00.420646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:00.427352 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93bfa3-fe76-4617-a078-1d21f3b05dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:00.427352 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93bfa3-fe76-4617-a078-1d21f3b05dc4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:00.427352 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93bfa3-fe76-4617-a078-1d21f3b05dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:00.427352 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93bfa3-fe76-4617-a078-1d21f3b05dc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:00.427805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 259/530] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:00.428760 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f71a3-65b2-494f-b3a1-e9f7a03d591b None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:00.511222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93bfa3-fe76-4617-a078-1d21f3b05dc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:00.512948 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93bfa3-fe76-4617-a078-1d21f3b05dc4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:00.563251 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f71a3-65b2-494f-b3a1-e9f7a03d591b None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:00.594690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:00.619133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f33b7-d4c7-45bd-aaed-5363b47772f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:00.620296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f33b7-d4c7-45bd-aaed-5363b47772f8 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:00.620697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f33b7-d4c7-45bd-aaed-5363b47772f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:00.621065 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f33b7-d4c7-45bd-aaed-5363b47772f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:00.623612 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 272/531] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:36:00.624700 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93bfa3-fe76-4617-a078-1d21f3b05dc4 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:00.629304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:00.630964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f33b7-d4c7-45bd-aaed-5363b47772f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:00.632671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f33b7-d4c7-45bd-aaed-5363b47772f8 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-d10f33b7-d4c7-45bd-aaed-5363b47772f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:00.652339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:00.653252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:00.654275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:00.654275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:00.654275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:00.654275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:00.654275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:00.654275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:00.654275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:00.654275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:00.654275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 260/532] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:00.655972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f33b7-d4c7-45bd-aaed-5363b47772f8 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:00.735023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93bfa3-fe76-4617-a078-1d21f3b05dc4 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:00.770658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0a580-cf86-481a-9603-6d143729c647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:00.771593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0a580-cf86-481a-9603-6d143729c647 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:00.772015 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0a580-cf86-481a-9603-6d143729c647 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:00.772425 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0a580-cf86-481a-9603-6d143729c647 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:00.773433 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0a580-cf86-481a-9603-6d143729c647 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:00.773897 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0a580-cf86-481a-9603-6d143729c647 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:00.775574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0a580-cf86-481a-9603-6d143729c647 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:00.780944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f33b7-d4c7-45bd-aaed-5363b47772f8 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:00.793193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 273/533] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:00.794391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0a580-cf86-481a-9603-6d143729c647 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:00.819201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d34a6-647a-48e8-9d45-ec94d26d7903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:00.820709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d34a6-647a-48e8-9d45-ec94d26d7903 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:00.820985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d34a6-647a-48e8-9d45-ec94d26d7903 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:00.821364 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d34a6-647a-48e8-9d45-ec94d26d7903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:00.833169 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d34a6-647a-48e8-9d45-ec94d26d7903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:00.834809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d34a6-647a-48e8-9d45-ec94d26d7903 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-426d34a6-647a-48e8-9d45-ec94d26d7903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:00.856981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:00.858038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:00.859138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:00.859138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:00.859138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:00.859138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:00.860654 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 261/534] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:00.861704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d34a6-647a-48e8-9d45-ec94d26d7903 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:00.862781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:00.898220 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:00.904027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0a580-cf86-481a-9603-6d143729c647 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:00.939098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bb668-8a77-4299-bc22-e8593e4e4dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:00.939771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bb668-8a77-4299-bc22-e8593e4e4dc5 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:00.940055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bb668-8a77-4299-bc22-e8593e4e4dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:00.940337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bb668-8a77-4299-bc22-e8593e4e4dc5 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:00.941128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bb668-8a77-4299-bc22-e8593e4e4dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:00.941439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bb668-8a77-4299-bc22-e8593e4e4dc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:00.942913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bb668-8a77-4299-bc22-e8593e4e4dc5 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:00.956147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 274/535] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:00.957122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bb668-8a77-4299-bc22-e8593e4e4dc5 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:00.980852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d34a6-647a-48e8-9d45-ec94d26d7903 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:01.018909 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8122cd-ec93-4791-a05f-09015a2ae650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:01.020936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8122cd-ec93-4791-a05f-09015a2ae650 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:01.021674 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8122cd-ec93-4791-a05f-09015a2ae650 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:01.022150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8122cd-ec93-4791-a05f-09015a2ae650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:01.023325 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8122cd-ec93-4791-a05f-09015a2ae650 None admin] RBAC: Adding query filter params (role.id=b9998a2301454764ae06a0f743463c5d, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=aef547cb73e04f62afb9e6c20793ad8d) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:01.024089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8122cd-ec93-4791-a05f-09015a2ae650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:01.026696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8122cd-ec93-4791-a05f-09015a2ae650 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:01.034863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 262/536] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:00 2022] GET /identity/v3/role_assignments?user.id=aef547cb73e04f62afb9e6c20793ad8d&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b9998a2301454764ae06a0f743463c5d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:01.035969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8122cd-ec93-4791-a05f-09015a2ae650 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:01.112908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bb668-8a77-4299-bc22-e8593e4e4dc5 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:01.155987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:01.163893 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8122cd-ec93-4791-a05f-09015a2ae650 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:01.176109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:01.207151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf715c2-f164-4e17-be50-e8a98ae34c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:01.208253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf715c2-f164-4e17-be50-e8a98ae34c48 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:01.208739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf715c2-f164-4e17-be50-e8a98ae34c48 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:01.209214 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf715c2-f164-4e17-be50-e8a98ae34c48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:01.210421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf715c2-f164-4e17-be50-e8a98ae34c48 None admin] RBAC: Adding query filter params (role.id=b9998a2301454764ae06a0f743463c5d, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=450fda3236cc4d1ba3189b6b66f65686) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:01.211025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf715c2-f164-4e17-be50-e8a98ae34c48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:01.212742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf715c2-f164-4e17-be50-e8a98ae34c48 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:01.213213 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47145f9a-1424-468c-88e7-9a56fbc2ce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:01.213917 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47145f9a-1424-468c-88e7-9a56fbc2ce45 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:01.214200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47145f9a-1424-468c-88e7-9a56fbc2ce45 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:01.214476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47145f9a-1424-468c-88e7-9a56fbc2ce45 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:01.215258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47145f9a-1424-468c-88e7-9a56fbc2ce45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:01.215567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47145f9a-1424-468c-88e7-9a56fbc2ce45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:01.217016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47145f9a-1424-468c-88e7-9a56fbc2ce45 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:01.221720 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 263/537] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:01 2022] GET /identity/v3/role_assignments?user.id=450fda3236cc4d1ba3189b6b66f65686&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b9998a2301454764ae06a0f743463c5d => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:01.238886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 275/538] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:01.244278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf715c2-f164-4e17-be50-e8a98ae34c48 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:01.263825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c60e2-8618-42bf-a182-3845a2e11057 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:01.264169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c60e2-8618-42bf-a182-3845a2e11057 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:01.264407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c60e2-8618-42bf-a182-3845a2e11057 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:01.267482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 276/539] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:01.272147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d8c98-ceff-48c6-97b9-315363de17e5 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:01.272435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d8c98-ceff-48c6-97b9-315363de17e5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:01.272910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d8c98-ceff-48c6-97b9-315363de17e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:01.303897 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-140d8c98-ceff-48c6-97b9-315363de17e5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:01.305856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-140d8c98-ceff-48c6-97b9-315363de17e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:01.373814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf715c2-f164-4e17-be50-e8a98ae34c48 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:01.393975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 277/540] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:36:01.419056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d8c98-ceff-48c6-97b9-315363de17e5 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:01.423565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6e24e-d37f-4310-a9ff-d2937eb72283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:01.424420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e24e-d37f-4310-a9ff-d2937eb72283 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:01.424695 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e24e-d37f-4310-a9ff-d2937eb72283 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:01.424964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e24e-d37f-4310-a9ff-d2937eb72283 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:01.432599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6e24e-d37f-4310-a9ff-d2937eb72283 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:01.434090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6e24e-d37f-4310-a9ff-d2937eb72283 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-2ff6e24e-d37f-4310-a9ff-d2937eb72283 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:01.453224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:01.454138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:01.455029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:01.455029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:01.455029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:01.455029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:01.455029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:01.455029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:01.455029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:01.455029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:01.455029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 264/541] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:01.462519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6e24e-d37f-4310-a9ff-d2937eb72283 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:01.505886 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:01.577176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d8c98-ceff-48c6-97b9-315363de17e5 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:01.609779 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:01.641408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6e24e-d37f-4310-a9ff-d2937eb72283 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:01.673586 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f33840-87a3-4a36-a99b-65de3c9140c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:01.674807 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f33840-87a3-4a36-a99b-65de3c9140c6 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:01.675302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f33840-87a3-4a36-a99b-65de3c9140c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:01.675789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f33840-87a3-4a36-a99b-65de3c9140c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:01.682073 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896dcacd-e38f-48aa-913f-8be992c3494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:01.683964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896dcacd-e38f-48aa-913f-8be992c3494a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:01.686557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896dcacd-e38f-48aa-913f-8be992c3494a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:01.687326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896dcacd-e38f-48aa-913f-8be992c3494a None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:01.689021 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896dcacd-e38f-48aa-913f-8be992c3494a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:01.689687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896dcacd-e38f-48aa-913f-8be992c3494a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:01.693372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896dcacd-e38f-48aa-913f-8be992c3494a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:01.703423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f33840-87a3-4a36-a99b-65de3c9140c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-27f33840-87a3-4a36-a99b-65de3c9140c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:01.711608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:01.712511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:01.713299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:01.713299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:01.713299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:01.713299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:01.713299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:01.713299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:01.713299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:01.713299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:01.713299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:01.713299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:01.713299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:01.713299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:01.717885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 265/542] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:01.722932 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 278/543] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:01.724392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896dcacd-e38f-48aa-913f-8be992c3494a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:01.730673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f33840-87a3-4a36-a99b-65de3c9140c6 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:01.889880 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:01.926189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896dcacd-e38f-48aa-913f-8be992c3494a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:01.954651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f33840-87a3-4a36-a99b-65de3c9140c6 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:01.961909 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae38ce-327d-47ef-b452-d1851fcee51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:01.962575 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae38ce-327d-47ef-b452-d1851fcee51b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:01.962902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae38ce-327d-47ef-b452-d1851fcee51b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:01.963183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae38ce-327d-47ef-b452-d1851fcee51b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:01.964016 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae38ce-327d-47ef-b452-d1851fcee51b None admin] RBAC: Adding query filter params (role.id=b9998a2301454764ae06a0f743463c5d, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=b3aa7416101948aba0b45129174cd988) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:01.964329 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae38ce-327d-47ef-b452-d1851fcee51b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:01.965785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae38ce-327d-47ef-b452-d1851fcee51b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:01.971983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 266/544] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:01 2022] GET /identity/v3/role_assignments?user.id=b3aa7416101948aba0b45129174cd988&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b9998a2301454764ae06a0f743463c5d => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:02.013470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041247a-ced4-4c93-8734-53f3c3f045ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:02.014571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041247a-ced4-4c93-8734-53f3c3f045ec None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:02.015112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041247a-ced4-4c93-8734-53f3c3f045ec None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:02.015575 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041247a-ced4-4c93-8734-53f3c3f045ec None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:02.016535 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041247a-ced4-4c93-8734-53f3c3f045ec None admin] RBAC: Adding query filter params (name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:02.017034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041247a-ced4-4c93-8734-53f3c3f045ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:02.018625 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041247a-ced4-4c93-8734-53f3c3f045ec None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:02.028822 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 279/545] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:36:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:02.034069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae38ce-327d-47ef-b452-d1851fcee51b None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:02.178701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae38ce-327d-47ef-b452-d1851fcee51b None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:02.201107 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9891465-1426-4564-80a6-9d1eb789850f None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:02.201615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9891465-1426-4564-80a6-9d1eb789850f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:02.201698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9891465-1426-4564-80a6-9d1eb789850f None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:02.204390 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 280/546] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:02.208441 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65e1d-0b07-4ac8-8ea5-7485d73a8fdc None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:02.208730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65e1d-0b07-4ac8-8ea5-7485d73a8fdc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:02.209010 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65e1d-0b07-4ac8-8ea5-7485d73a8fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:02.227627 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-f1b65e1d-0b07-4ac8-8ea5-7485d73a8fdc None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:02.228828 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f1b65e1d-0b07-4ac8-8ea5-7485d73a8fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:02.231468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08484550-fe21-462f-9f52-2acf995071bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:02.232285 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08484550-fe21-462f-9f52-2acf995071bb None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:02.232575 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08484550-fe21-462f-9f52-2acf995071bb None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:02.232845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08484550-fe21-462f-9f52-2acf995071bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:02.246919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08484550-fe21-462f-9f52-2acf995071bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:02.248415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08484550-fe21-462f-9f52-2acf995071bb None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:02.263117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:02.272480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-08484550-fe21-462f-9f52-2acf995071bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:02.280533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:02.281380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:02.282209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:02.282209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:02.282209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:02.282209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:02.282209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 267/547] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:02.298735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08484550-fe21-462f-9f52-2acf995071bb None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:02.347591 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 281/548] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:36:02.403515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b65e1d-0b07-4ac8-8ea5-7485d73a8fdc None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:02.482438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08484550-fe21-462f-9f52-2acf995071bb None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:02.570801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b65e1d-0b07-4ac8-8ea5-7485d73a8fdc None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:02.580436 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c57c1b-ae16-433d-894e-b44824b1034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:02.581410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c57c1b-ae16-433d-894e-b44824b1034b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:02.581889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c57c1b-ae16-433d-894e-b44824b1034b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:02.582370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c57c1b-ae16-433d-894e-b44824b1034b None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:02.583336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c57c1b-ae16-433d-894e-b44824b1034b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:02.583856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c57c1b-ae16-433d-894e-b44824b1034b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:02.585726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c57c1b-ae16-433d-894e-b44824b1034b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:02.610812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 268/549] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:02.619786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c57c1b-ae16-433d-894e-b44824b1034b None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:02.620380 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547310d-3bc5-4f5d-a96a-d4e0a5538320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:02.621212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547310d-3bc5-4f5d-a96a-d4e0a5538320 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:02.621494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547310d-3bc5-4f5d-a96a-d4e0a5538320 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:02.621770 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547310d-3bc5-4f5d-a96a-d4e0a5538320 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:02.641835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547310d-3bc5-4f5d-a96a-d4e0a5538320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-9547310d-3bc5-4f5d-a96a-d4e0a5538320 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:02.657939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:02.659422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:02.660413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:02.660413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:02.660413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:02.660413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:02.660413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:02.660413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:02.660413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:02.660413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:02.660413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:02.660413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:02.660413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:02.660413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:02.661348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 282/550] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:02.668585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547310d-3bc5-4f5d-a96a-d4e0a5538320 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:02.702183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:02.739589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:02.794984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c57c1b-ae16-433d-894e-b44824b1034b None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:02.833014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983066a-4cdb-485d-ba46-3bd418e47a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:02.834211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983066a-4cdb-485d-ba46-3bd418e47a59 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:02.834678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547310d-3bc5-4f5d-a96a-d4e0a5538320 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:02.834977 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983066a-4cdb-485d-ba46-3bd418e47a59 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:02.836098 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983066a-4cdb-485d-ba46-3bd418e47a59 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:02.854526 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983066a-4cdb-485d-ba46-3bd418e47a59 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:02.856622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983066a-4cdb-485d-ba46-3bd418e47a59 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-c983066a-4cdb-485d-ba46-3bd418e47a59 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:02.880171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:02.881024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:02.882141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:02.882141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:02.882141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:02.882141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:02.882141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:02.882141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:02.882141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:02.882141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:02.882141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 03:36:02.882141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:02.886006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 269/551] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:36:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:02.893188 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983066a-4cdb-485d-ba46-3bd418e47a59 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:02.909921 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f9fbc-7924-42f5-8327-c3d09dfdafe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:02.910605 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f9fbc-7924-42f5-8327-c3d09dfdafe0 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:02.910931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f9fbc-7924-42f5-8327-c3d09dfdafe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:02.911210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f9fbc-7924-42f5-8327-c3d09dfdafe0 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:02.911973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f9fbc-7924-42f5-8327-c3d09dfdafe0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:02.912281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f9fbc-7924-42f5-8327-c3d09dfdafe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:02.915093 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f9fbc-7924-42f5-8327-c3d09dfdafe0 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:02.930150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 283/552] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:36:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:02.931453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f9fbc-7924-42f5-8327-c3d09dfdafe0 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:03.089413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:03.101757 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983066a-4cdb-485d-ba46-3bd418e47a59 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:03.115951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f9fbc-7924-42f5-8327-c3d09dfdafe0 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:03.137881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:03.159750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4797d4-a5b2-4375-a576-e4477e882042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:03.160435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4797d4-a5b2-4375-a576-e4477e882042 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:03.160719 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4797d4-a5b2-4375-a576-e4477e882042 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:03.160995 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4797d4-a5b2-4375-a576-e4477e882042 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:03.161844 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4797d4-a5b2-4375-a576-e4477e882042 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:03.162153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4797d4-a5b2-4375-a576-e4477e882042 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:03.164385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4797d4-a5b2-4375-a576-e4477e882042 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:03.184038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 270/553] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 30 03:36:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:03.184588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50873e-8150-4082-846a-b95c9fb2fac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:03.185400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50873e-8150-4082-846a-b95c9fb2fac1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:03.185681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50873e-8150-4082-846a-b95c9fb2fac1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:03.185955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50873e-8150-4082-846a-b95c9fb2fac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:03.193703 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4797d4-a5b2-4375-a576-e4477e882042 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:03.212636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50873e-8150-4082-846a-b95c9fb2fac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:03.214108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50873e-8150-4082-846a-b95c9fb2fac1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-5c50873e-8150-4082-846a-b95c9fb2fac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:03.242391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:03.243452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:03.244302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:03.244302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:03.244302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:03.244302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:03.245014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 284/554] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:03.252571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50873e-8150-4082-846a-b95c9fb2fac1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:03.386333 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4797d4-a5b2-4375-a576-e4477e882042 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:03.441496 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50873e-8150-4082-846a-b95c9fb2fac1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:03.443750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9afb98-80ee-45b1-85a7-41e49d0693df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:03.445303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9afb98-80ee-45b1-85a7-41e49d0693df None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:03.445589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9afb98-80ee-45b1-85a7-41e49d0693df None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:03.445864 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9afb98-80ee-45b1-85a7-41e49d0693df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:03.478509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f8e2a-1017-4db6-b76b-ea65edb94242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:03.479221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f8e2a-1017-4db6-b76b-ea65edb94242 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:03.479501 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f8e2a-1017-4db6-b76b-ea65edb94242 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:03.479775 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f8e2a-1017-4db6-b76b-ea65edb94242 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:03.480642 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f8e2a-1017-4db6-b76b-ea65edb94242 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:03.481028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f8e2a-1017-4db6-b76b-ea65edb94242 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:03.482465 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f8e2a-1017-4db6-b76b-ea65edb94242 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:03.492734 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:03.497443 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 285/555] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:03.499003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c6195-3b5a-48d3-8933-18c0f8737a92 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:03.499480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c6195-3b5a-48d3-8933-18c0f8737a92 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:03.500349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:03.501471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c6195-3b5a-48d3-8933-18c0f8737a92 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:03.503678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 286/556] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:03.504517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c6195-3b5a-48d3-8933-18c0f8737a92 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:03.535982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9afb98-80ee-45b1-85a7-41e49d0693df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:03.538214 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9afb98-80ee-45b1-85a7-41e49d0693df None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:03.620974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c6195-3b5a-48d3-8933-18c0f8737a92 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:03.644648 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 271/557] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:36:03.646313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62984ed6-fdc2-406e-ac4a-f145a1d3b3a5 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:03.646787 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62984ed6-fdc2-406e-ac4a-f145a1d3b3a5 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:03.647232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62984ed6-fdc2-406e-ac4a-f145a1d3b3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:03.659238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf3b1c-3c93-4c5f-a7a2-126787245b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:03.660106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf3b1c-3c93-4c5f-a7a2-126787245b8b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:03.660388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf3b1c-3c93-4c5f-a7a2-126787245b8b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:03.660661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf3b1c-3c93-4c5f-a7a2-126787245b8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:03.665865 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-62984ed6-fdc2-406e-ac4a-f145a1d3b3a5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:03.667369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-62984ed6-fdc2-406e-ac4a-f145a1d3b3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:03.668635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf3b1c-3c93-4c5f-a7a2-126787245b8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:03.670236 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf3b1c-3c93-4c5f-a7a2-126787245b8b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-ddbf3b1c-3c93-4c5f-a7a2-126787245b8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:03.687562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:03.689050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:03.690003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:03.690003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:03.690003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:03.690003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:03.690003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:03.690003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:03.690003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:03.690003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:03.690003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:36:03.690003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:03.690003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 287/558] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 03:36:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:03.690003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf3b1c-3c93-4c5f-a7a2-126787245b8b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:03.740517 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 272/559] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:36:03.741919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62984ed6-fdc2-406e-ac4a-f145a1d3b3a5 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:03.747142 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:03.770539 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:03.826958 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf3b1c-3c93-4c5f-a7a2-126787245b8b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:03.853570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62984ed6-fdc2-406e-ac4a-f145a1d3b3a5 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:03.864378 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c30d6-243e-484c-9b7e-7e6145a23778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:03.865325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c30d6-243e-484c-9b7e-7e6145a23778 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:03.865612 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c30d6-243e-484c-9b7e-7e6145a23778 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:03.865886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c30d6-243e-484c-9b7e-7e6145a23778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:03.877909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c30d6-243e-484c-9b7e-7e6145a23778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:03.879279 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c30d6-243e-484c-9b7e-7e6145a23778 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:03.890555 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85207fa9-d929-441e-8fac-6a33476a3825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:03.891330 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85207fa9-d929-441e-8fac-6a33476a3825 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:03.891617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85207fa9-d929-441e-8fac-6a33476a3825 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:03.891889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85207fa9-d929-441e-8fac-6a33476a3825 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:03.892753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85207fa9-d929-441e-8fac-6a33476a3825 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:03.893042 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85207fa9-d929-441e-8fac-6a33476a3825 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:03.894519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85207fa9-d929-441e-8fac-6a33476a3825 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-389c30d6-243e-484c-9b7e-7e6145a23778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:03.900176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:03.901052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:03.901904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:03.901904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:03.901904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:03.901904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:03.901904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 288/560] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:03.902182 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c30d6-243e-484c-9b7e-7e6145a23778 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:03.921876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 273/561] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 03:36:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:03.923561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd96e4-4835-4594-874c-0830bc84be57 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:03.923854 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd96e4-4835-4594-874c-0830bc84be57 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:03.924134 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd96e4-4835-4594-874c-0830bc84be57 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:03.925507 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 274/562] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:03.926121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd96e4-4835-4594-874c-0830bc84be57 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:03.998979 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:04.018926 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c30d6-243e-484c-9b7e-7e6145a23778 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:04.032717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:04.043144 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd96e4-4835-4594-874c-0830bc84be57 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:04.055752 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56b4e5-cc21-470b-a52d-d43653f56220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:04.056560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56b4e5-cc21-470b-a52d-d43653f56220 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:04.056839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56b4e5-cc21-470b-a52d-d43653f56220 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:04.057114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56b4e5-cc21-470b-a52d-d43653f56220 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:04.067764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56b4e5-cc21-470b-a52d-d43653f56220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-ec56b4e5-cc21-470b-a52d-d43653f56220 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:04.075742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:04.076771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:04.077579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:04.077579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:04.077579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:04.077579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:04.077579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:04.077579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:04.077579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:04.077579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:04.077579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:04.077579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:04.077579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:04.077579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:04.077579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 289/563] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:04.078255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56b4e5-cc21-470b-a52d-d43653f56220 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:04.090511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b20608-6273-405d-a118-ad02b0e7723f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:04.091221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b20608-6273-405d-a118-ad02b0e7723f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:04.091546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b20608-6273-405d-a118-ad02b0e7723f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:04.091790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b20608-6273-405d-a118-ad02b0e7723f None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:04.092530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b20608-6273-405d-a118-ad02b0e7723f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:04.092843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b20608-6273-405d-a118-ad02b0e7723f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:04.094253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b20608-6273-405d-a118-ad02b0e7723f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:04.107324 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 275/564] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:04.108633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd0a70-3a69-4edb-8daf-3f3373734964 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:04.108923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd0a70-3a69-4edb-8daf-3f3373734964 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:04.109201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd0a70-3a69-4edb-8daf-3f3373734964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:04.127548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-8fcd0a70-3a69-4edb-8daf-3f3373734964 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:04.128747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8fcd0a70-3a69-4edb-8daf-3f3373734964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:04.195228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56b4e5-cc21-470b-a52d-d43653f56220 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:04.211907 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 276/565] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:36:04.212889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd0a70-3a69-4edb-8daf-3f3373734964 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:04.241163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c53f3e-9648-4a16-b973-c1d3bff6297f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:04.241965 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c53f3e-9648-4a16-b973-c1d3bff6297f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:04.242245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c53f3e-9648-4a16-b973-c1d3bff6297f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:04.242512 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c53f3e-9648-4a16-b973-c1d3bff6297f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:04.253513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c53f3e-9648-4a16-b973-c1d3bff6297f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:04.255097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c53f3e-9648-4a16-b973-c1d3bff6297f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:04.273190 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-42c53f3e-9648-4a16-b973-c1d3bff6297f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:04.273862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:04.274751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:04.275712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:04.275712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:04.275712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:04.275712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:04.275712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 290/566] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:04.275995 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c53f3e-9648-4a16-b973-c1d3bff6297f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:04.301429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:04.325006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd0a70-3a69-4edb-8daf-3f3373734964 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:04.359000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71853ba-2b4e-4aca-b0a4-a8e434a8655c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:04.359677 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71853ba-2b4e-4aca-b0a4-a8e434a8655c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:04.359959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71853ba-2b4e-4aca-b0a4-a8e434a8655c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:04.360233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71853ba-2b4e-4aca-b0a4-a8e434a8655c None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:04.360996 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71853ba-2b4e-4aca-b0a4-a8e434a8655c None admin] RBAC: Adding query filter params (name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:04.361325 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71853ba-2b4e-4aca-b0a4-a8e434a8655c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:04.362719 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71853ba-2b4e-4aca-b0a4-a8e434a8655c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:04.370776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 277/567] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:36:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:04.372000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6fbce-c5e6-4387-b491-4fa379921944 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:04.372286 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6fbce-c5e6-4387-b491-4fa379921944 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:04.372563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6fbce-c5e6-4387-b491-4fa379921944 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:04.374874 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 278/568] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:04.376211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c53f3e-9648-4a16-b973-c1d3bff6297f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:04.376510 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6fbce-c5e6-4387-b491-4fa379921944 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:04.410294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b5cb9-6bc9-4087-b620-4524c9664221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:04.411124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b5cb9-6bc9-4087-b620-4524c9664221 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:04.411404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b5cb9-6bc9-4087-b620-4524c9664221 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:04.411680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b5cb9-6bc9-4087-b620-4524c9664221 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:04.418399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b5cb9-6bc9-4087-b620-4524c9664221 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:04.419886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b5cb9-6bc9-4087-b620-4524c9664221 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-724b5cb9-6bc9-4087-b620-4524c9664221 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:04.434824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:04.435713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:04.436589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:04.436589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:04.436589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:04.436589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:04.436589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:04.436589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:04.436589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:04.436589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:04.436589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 291/569] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:04.437083 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b5cb9-6bc9-4087-b620-4524c9664221 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:04.486916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6fbce-c5e6-4387-b491-4fa379921944 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:04.500267 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:04.520258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:04.521157 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27aa779-2765-4882-a647-f7f003e17634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:04.521927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27aa779-2765-4882-a647-f7f003e17634 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:04.522203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27aa779-2765-4882-a647-f7f003e17634 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:04.522603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27aa779-2765-4882-a647-f7f003e17634 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:04.534167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27aa779-2765-4882-a647-f7f003e17634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:04.536249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b5cb9-6bc9-4087-b620-4524c9664221 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-b27aa779-2765-4882-a647-f7f003e17634 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:04.541969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:04.542976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:04.543842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:04.543842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:04.543842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:04.543842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:04.543842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:04.543842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:04.543842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:04.543842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:04.543842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:04.543842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:04.543842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:04.543842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:04.543842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 279/570] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:04.544698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27aa779-2765-4882-a647-f7f003e17634 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:04.578975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a68f-8687-4269-9cf5-3fdbe0a468f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:04.579664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a68f-8687-4269-9cf5-3fdbe0a468f5 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:04.579945 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a68f-8687-4269-9cf5-3fdbe0a468f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:04.580221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a68f-8687-4269-9cf5-3fdbe0a468f5 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:04.580956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177a68f-8687-4269-9cf5-3fdbe0a468f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:04.581263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177a68f-8687-4269-9cf5-3fdbe0a468f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:04.582658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177a68f-8687-4269-9cf5-3fdbe0a468f5 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:04.594283 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 292/571] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:04.595503 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd08e58-fc97-41a5-b8d5-a051a651e45a None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:04.595795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd08e58-fc97-41a5-b8d5-a051a651e45a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:04.596066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd08e58-fc97-41a5-b8d5-a051a651e45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:04.615739 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-1bd08e58-fc97-41a5-b8d5-a051a651e45a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:04.617561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1bd08e58-fc97-41a5-b8d5-a051a651e45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:04.646882 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27aa779-2765-4882-a647-f7f003e17634 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:04.680576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20a8ad-53b2-4b54-aef5-987b555596e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:04.681381 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20a8ad-53b2-4b54-aef5-987b555596e1 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:04.681659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20a8ad-53b2-4b54-aef5-987b555596e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:04.681930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20a8ad-53b2-4b54-aef5-987b555596e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:04.688352 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 293/572] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:36:04.689032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd08e58-fc97-41a5-b8d5-a051a651e45a None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:04.693721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20a8ad-53b2-4b54-aef5-987b555596e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:04.695837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20a8ad-53b2-4b54-aef5-987b555596e1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-8f20a8ad-53b2-4b54-aef5-987b555596e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:04.715382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:04.716303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:04.717232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:04.717232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:04.717232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:04.717232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:04.717232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 280/573] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:04.717525 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20a8ad-53b2-4b54-aef5-987b555596e1 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:04.746936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:04.762817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:04.789901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd08e58-fc97-41a5-b8d5-a051a651e45a None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:04.821019 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20a8ad-53b2-4b54-aef5-987b555596e1 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:04.825903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db48e84-3571-4b58-b045-7c69400169d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:04.826566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db48e84-3571-4b58-b045-7c69400169d6 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:04.826870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db48e84-3571-4b58-b045-7c69400169d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:04.827141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db48e84-3571-4b58-b045-7c69400169d6 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:04.827932 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db48e84-3571-4b58-b045-7c69400169d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:04.828235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db48e84-3571-4b58-b045-7c69400169d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:04.829716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db48e84-3571-4b58-b045-7c69400169d6 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:04.841222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 294/574] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:04.841987 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db48e84-3571-4b58-b045-7c69400169d6 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:04.858499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618d233-87c0-4d6d-98b9-b79c62075cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:04.859208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618d233-87c0-4d6d-98b9-b79c62075cb9 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:04.859491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618d233-87c0-4d6d-98b9-b79c62075cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:04.859767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618d233-87c0-4d6d-98b9-b79c62075cb9 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:04.860535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618d233-87c0-4d6d-98b9-b79c62075cb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:04.860842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618d233-87c0-4d6d-98b9-b79c62075cb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:04.862234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618d233-87c0-4d6d-98b9-b79c62075cb9 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:04.870388 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 281/575] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:36:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:04.871279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618d233-87c0-4d6d-98b9-b79c62075cb9 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:04.951385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db48e84-3571-4b58-b045-7c69400169d6 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:04.959674 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:04.973153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618d233-87c0-4d6d-98b9-b79c62075cb9 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:04.987797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619b27a-98f3-412c-9cd1-a505554a1ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:04.988598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619b27a-98f3-412c-9cd1-a505554a1ae0 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:04.988881 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619b27a-98f3-412c-9cd1-a505554a1ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:04.989156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619b27a-98f3-412c-9cd1-a505554a1ae0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:04.991183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:05.000469 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619b27a-98f3-412c-9cd1-a505554a1ae0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:05.002889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619b27a-98f3-412c-9cd1-a505554a1ae0 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:05.014971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1135f56-4967-4206-8e27-320cdde4ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:05.015764 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1135f56-4967-4206-8e27-320cdde4ef40 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:05.016041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1135f56-4967-4206-8e27-320cdde4ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:05.016305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1135f56-4967-4206-8e27-320cdde4ef40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-7619b27a-98f3-412c-9cd1-a505554a1ae0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:05.019008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:05.019981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:05.026132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:05.026132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:05.026132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:05.026132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:05.026132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:05.026132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:05.026132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:05.026132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:05.026132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 295/576] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:05.026132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619b27a-98f3-412c-9cd1-a505554a1ae0 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:05.032227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1135f56-4967-4206-8e27-320cdde4ef40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-b1135f56-4967-4206-8e27-320cdde4ef40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:05.040012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:05.041092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:05.041939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:05.041939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:05.041939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:05.041939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:05.041939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:05.041939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:05.041939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:05.041939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:05.041939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:05.041939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:05.041939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:05.041939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:05.041939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 282/577] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:05.042632 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1135f56-4967-4206-8e27-320cdde4ef40 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:05.122360 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619b27a-98f3-412c-9cd1-a505554a1ae0 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:05.143949 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1135f56-4967-4206-8e27-320cdde4ef40 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:05.156695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db545c7-ca4e-4b8a-bcd8-a318c24260df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:05.157355 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db545c7-ca4e-4b8a-bcd8-a318c24260df None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:05.157633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db545c7-ca4e-4b8a-bcd8-a318c24260df None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:05.157903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db545c7-ca4e-4b8a-bcd8-a318c24260df None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:05.158626 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db545c7-ca4e-4b8a-bcd8-a318c24260df None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:05.158979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db545c7-ca4e-4b8a-bcd8-a318c24260df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:05.160349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db545c7-ca4e-4b8a-bcd8-a318c24260df None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:05.172483 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 296/578] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:05.173044 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db545c7-ca4e-4b8a-bcd8-a318c24260df None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:05.177626 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15e103-dc16-4d47-915c-43076fcb3933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:05.178279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e103-dc16-4d47-915c-43076fcb3933 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:05.178557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e103-dc16-4d47-915c-43076fcb3933 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:05.179038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e103-dc16-4d47-915c-43076fcb3933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:05.179875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15e103-dc16-4d47-915c-43076fcb3933 None admin] RBAC: Adding query filter params (role.id=b9998a2301454764ae06a0f743463c5d, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=9de5d5c703b84e508e3112f90070e002) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:05.180186 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15e103-dc16-4d47-915c-43076fcb3933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:05.181636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15e103-dc16-4d47-915c-43076fcb3933 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:05.187268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 283/579] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:05 2022] GET /identity/v3/role_assignments?user.id=9de5d5c703b84e508e3112f90070e002&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b9998a2301454764ae06a0f743463c5d => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:05.188027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15e103-dc16-4d47-915c-43076fcb3933 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:05.210450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:05.241751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:05.296191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db545c7-ca4e-4b8a-bcd8-a318c24260df None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:05.309749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15e103-dc16-4d47-915c-43076fcb3933 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:05.334059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f6835-cd09-47c3-bccf-2d797d98bd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:05.335003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f6835-cd09-47c3-bccf-2d797d98bd9c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:05.335432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f6835-cd09-47c3-bccf-2d797d98bd9c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:05.335681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f6835-cd09-47c3-bccf-2d797d98bd9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:05.347857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f6835-cd09-47c3-bccf-2d797d98bd9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:05.348044 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbb0c2-738f-4fc7-922f-b897801453f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:05.349118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb0c2-738f-4fc7-922f-b897801453f8 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:05.349118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb0c2-738f-4fc7-922f-b897801453f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:05.349360 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb0c2-738f-4fc7-922f-b897801453f8 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:05.349678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f6835-cd09-47c3-bccf-2d797d98bd9c None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:05.350527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbb0c2-738f-4fc7-922f-b897801453f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:05.350527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbb0c2-738f-4fc7-922f-b897801453f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:05.352005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbb0c2-738f-4fc7-922f-b897801453f8 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:05.364268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 284/580] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:05.365092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbb0c2-738f-4fc7-922f-b897801453f8 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-233f6835-cd09-47c3-bccf-2d797d98bd9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:05.372470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:05.373371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:05.374275 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:05.374275 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:05.374275 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:05.374275 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:05.374275 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 297/581] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:05.374639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f6835-cd09-47c3-bccf-2d797d98bd9c None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:05.451992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:05.484361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbb0c2-738f-4fc7-922f-b897801453f8 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:05.484563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f6835-cd09-47c3-bccf-2d797d98bd9c None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:05.492282 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:05.521479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dddaa-619c-48bf-b60b-6b25d324ad5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:05.521857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f61cf-3375-4b52-a702-bb118b2af59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:05.522223 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dddaa-619c-48bf-b60b-6b25d324ad5c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:05.522752 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f61cf-3375-4b52-a702-bb118b2af59c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:05.523073 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dddaa-619c-48bf-b60b-6b25d324ad5c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:05.523157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f61cf-3375-4b52-a702-bb118b2af59c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:05.523229 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dddaa-619c-48bf-b60b-6b25d324ad5c None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:05.523404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f61cf-3375-4b52-a702-bb118b2af59c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:05.523948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64dddaa-619c-48bf-b60b-6b25d324ad5c None admin] RBAC: Adding query filter params (name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:05.524263 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64dddaa-619c-48bf-b60b-6b25d324ad5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:05.525656 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64dddaa-619c-48bf-b60b-6b25d324ad5c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:05.531475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f61cf-3375-4b52-a702-bb118b2af59c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:05.532930 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f61cf-3375-4b52-a702-bb118b2af59c None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:05.534371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 285/582] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:36:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:05.539418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dddaa-619c-48bf-b60b-6b25d324ad5c None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-285f61cf-3375-4b52-a702-bb118b2af59c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:05.548260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:05.549415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:05.550367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:05.550367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:05.550367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:05.550367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:05.550367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:05.550367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:05.550367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:05.550367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:05.550367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 03:36:05.550367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:05.550367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 298/583] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:36:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:05.550367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f61cf-3375-4b52-a702-bb118b2af59c None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:05.652514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dddaa-619c-48bf-b60b-6b25d324ad5c None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:05.661528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f61cf-3375-4b52-a702-bb118b2af59c None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:05.688727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30385f32-50be-4cfe-aa50-029bca69b4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:05.690155 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30385f32-50be-4cfe-aa50-029bca69b4ed None admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:05.690437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30385f32-50be-4cfe-aa50-029bca69b4ed None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:05.690716 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30385f32-50be-4cfe-aa50-029bca69b4ed None admin] PATH_INFO: `/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/758b152c320e4a94921bb96541cbea98/roles/b9998a2301454764ae06a0f743463c5d` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:05.693350 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:05.697075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d56c2-9226-4c8c-9766-0552479e0569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:05.697747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d56c2-9226-4c8c-9766-0552479e0569 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:05.698031 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d56c2-9226-4c8c-9766-0552479e0569 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:05.698365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d56c2-9226-4c8c-9766-0552479e0569 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:05.699128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d56c2-9226-4c8c-9766-0552479e0569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:05.699440 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d56c2-9226-4c8c-9766-0552479e0569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:05.700834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d56c2-9226-4c8c-9766-0552479e0569 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:05.707751 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30385f32-50be-4cfe-aa50-029bca69b4ed None admin] RBAC: Authorizing `identity:create_grant(project_id=96e59c2ab83c477385e5a81b32a7c897, user_id=758b152c320e4a94921bb96541cbea98, role_id=b9998a2301454764ae06a0f743463c5d)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:05.709996 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30385f32-50be-4cfe-aa50-029bca69b4ed None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:05.717798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 299/584] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:05.717798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d56c2-9226-4c8c-9766-0552479e0569 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:05.731794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 286/585] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:36:05 2022] PUT /identity/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/758b152c320e4a94921bb96541cbea98/roles/b9998a2301454764ae06a0f743463c5d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:36:05.732816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30385f32-50be-4cfe-aa50-029bca69b4ed None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:05.759188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:05.870610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d56c2-9226-4c8c-9766-0552479e0569 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:05.891227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30385f32-50be-4cfe-aa50-029bca69b4ed None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:05.923134 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919e20b-8e2a-4d99-a5ab-45be496aded9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:05.923987 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919e20b-8e2a-4d99-a5ab-45be496aded9 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:05.924278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919e20b-8e2a-4d99-a5ab-45be496aded9 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:05.924558 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919e20b-8e2a-4d99-a5ab-45be496aded9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:05.936076 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919e20b-8e2a-4d99-a5ab-45be496aded9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:05.937374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919e20b-8e2a-4d99-a5ab-45be496aded9 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:05.937506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ca130-7d94-411f-a6b5-9e16ca09ebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:05.938201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca130-7d94-411f-a6b5-9e16ca09ebe1 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:05.938479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca130-7d94-411f-a6b5-9e16ca09ebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:05.938751 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca130-7d94-411f-a6b5-9e16ca09ebe1 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:05.939676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ca130-7d94-411f-a6b5-9e16ca09ebe1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:05.939986 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ca130-7d94-411f-a6b5-9e16ca09ebe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:05.941437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ca130-7d94-411f-a6b5-9e16ca09ebe1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-0919e20b-8e2a-4d99-a5ab-45be496aded9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:05.960216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:05.962016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:05.963160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:05.963160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:05.963160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:05.963160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:05.963160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 300/586] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:05.963160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919e20b-8e2a-4d99-a5ab-45be496aded9 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:05.970156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 287/587] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 30 03:36:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:05.975102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ca130-7d94-411f-a6b5-9e16ca09ebe1 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:06.022797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:06.079245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:06.084215 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ca130-7d94-411f-a6b5-9e16ca09ebe1 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:06.094248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919e20b-8e2a-4d99-a5ab-45be496aded9 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:06.122919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282078c-a367-437e-a28d-6807e1ce6c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:06.123818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282078c-a367-437e-a28d-6807e1ce6c54 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:06.124228 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282078c-a367-437e-a28d-6807e1ce6c54 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:06.124647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282078c-a367-437e-a28d-6807e1ce6c54 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:06.125607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282078c-a367-437e-a28d-6807e1ce6c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:06.126087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282078c-a367-437e-a28d-6807e1ce6c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:06.127637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282078c-a367-437e-a28d-6807e1ce6c54 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:06.138672 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df1d80-c1e2-4b96-8e30-b73a2e087de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:06.139788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df1d80-c1e2-4b96-8e30-b73a2e087de6 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:06.140083 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df1d80-c1e2-4b96-8e30-b73a2e087de6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:06.140358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df1d80-c1e2-4b96-8e30-b73a2e087de6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:06.142387 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 288/588] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:06.143671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282078c-a367-437e-a28d-6807e1ce6c54 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:06.149720 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df1d80-c1e2-4b96-8e30-b73a2e087de6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:06.151227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df1d80-c1e2-4b96-8e30-b73a2e087de6 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-92df1d80-c1e2-4b96-8e30-b73a2e087de6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:06.172246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:06.173248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:06.174850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:06.174850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:06.174850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:06.174850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:06.174850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:06.174850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:06.174850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:06.174850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:06.174850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 03:36:06.174850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:06.174850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 301/589] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:36:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:06.174850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df1d80-c1e2-4b96-8e30-b73a2e087de6 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:06.257480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282078c-a367-437e-a28d-6807e1ce6c54 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:06.259835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:06.289012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df1d80-c1e2-4b96-8e30-b73a2e087de6 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:06.298072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4d3b5-6d1b-4118-bf13-a993d6722359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:06.299219 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4d3b5-6d1b-4118-bf13-a993d6722359 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:06.299794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4d3b5-6d1b-4118-bf13-a993d6722359 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:06.300265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4d3b5-6d1b-4118-bf13-a993d6722359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:06.312296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4d3b5-6d1b-4118-bf13-a993d6722359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:06.314195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4d3b5-6d1b-4118-bf13-a993d6722359 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:06.325232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e7aa3-b1df-4e04-ad3e-639cb22422bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:06.326045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e7aa3-b1df-4e04-ad3e-639cb22422bd None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:06.326328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e7aa3-b1df-4e04-ad3e-639cb22422bd None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:06.326604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e7aa3-b1df-4e04-ad3e-639cb22422bd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:06.334133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e7aa3-b1df-4e04-ad3e-639cb22422bd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-f3e4d3b5-6d1b-4118-bf13-a993d6722359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:06.334836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:06.335709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:06.336627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:06.336627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:06.336627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:06.336627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:06.336845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e7aa3-b1df-4e04-ad3e-639cb22422bd None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:06.338858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:06.339993 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 289/590] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:06.341100 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4d3b5-6d1b-4118-bf13-a993d6722359 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-527e7aa3-b1df-4e04-ad3e-639cb22422bd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:06.353843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:06.354907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:06.356075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:06.356075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:06.356075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:06.356075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:06.356075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:06.356075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:06.356075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:06.356075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:06.356075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 03:36:06.356075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:06.357549 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 302/591] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:06.358400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e7aa3-b1df-4e04-ad3e-639cb22422bd None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:06.448058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4d3b5-6d1b-4118-bf13-a993d6722359 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:06.461208 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e7aa3-b1df-4e04-ad3e-639cb22422bd None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:06.483760 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd863858-c1cf-42a1-b711-55dba69b6b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:06.484766 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd863858-c1cf-42a1-b711-55dba69b6b91 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:06.485194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd863858-c1cf-42a1-b711-55dba69b6b91 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:06.485788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd863858-c1cf-42a1-b711-55dba69b6b91 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:06.486897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd863858-c1cf-42a1-b711-55dba69b6b91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:06.487349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd863858-c1cf-42a1-b711-55dba69b6b91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:06.489030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd863858-c1cf-42a1-b711-55dba69b6b91 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:06.497807 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74ba14-f0f3-4315-9844-73787aab06d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:06.498563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ba14-f0f3-4315-9844-73787aab06d4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:06.498958 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ba14-f0f3-4315-9844-73787aab06d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:06.499223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ba14-f0f3-4315-9844-73787aab06d4 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:06.500076 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74ba14-f0f3-4315-9844-73787aab06d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:06.501080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74ba14-f0f3-4315-9844-73787aab06d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:06.501919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74ba14-f0f3-4315-9844-73787aab06d4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:06.510093 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 290/592] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 30 03:36:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:06.511431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd863858-c1cf-42a1-b711-55dba69b6b91 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:06.514986 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 303/593] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:06.516115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74ba14-f0f3-4315-9844-73787aab06d4 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:06.539170 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:06.576938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:06.621509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74ba14-f0f3-4315-9844-73787aab06d4 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:06.629026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd863858-c1cf-42a1-b711-55dba69b6b91 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:06.656512 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e62a6-ddec-4c6a-8104-91021318e827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:06.657412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e62a6-ddec-4c6a-8104-91021318e827 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:06.657785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e62a6-ddec-4c6a-8104-91021318e827 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:06.658137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e62a6-ddec-4c6a-8104-91021318e827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:06.667491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010857b0-905a-449e-ae4f-7f07ae361792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:06.668398 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010857b0-905a-449e-ae4f-7f07ae361792 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:06.668879 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010857b0-905a-449e-ae4f-7f07ae361792 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:06.669325 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010857b0-905a-449e-ae4f-7f07ae361792 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:06.669630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e62a6-ddec-4c6a-8104-91021318e827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:06.670527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010857b0-905a-449e-ae4f-7f07ae361792 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:06.671053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010857b0-905a-449e-ae4f-7f07ae361792 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:06.671347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e62a6-ddec-4c6a-8104-91021318e827 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:06.673158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010857b0-905a-449e-ae4f-7f07ae361792 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-304e62a6-ddec-4c6a-8104-91021318e827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:06.689210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:06.690131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:06.691195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:06.691195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:06.691195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:06.691195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:06.691195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 304/594] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:06.691966 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e62a6-ddec-4c6a-8104-91021318e827 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:06.696206 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 291/595] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Jun 30 03:36:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:06.697325 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010857b0-905a-449e-ae4f-7f07ae361792 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:06.769624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:06.810177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010857b0-905a-449e-ae4f-7f07ae361792 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:06.811729 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e62a6-ddec-4c6a-8104-91021318e827 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:06.824030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:06.856916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289e355-7d1d-4fcf-9461-fcfde9791bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:06.857365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7826ac4-f549-4c66-a48d-2dd6fb6fe618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:06.857656 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289e355-7d1d-4fcf-9461-fcfde9791bae None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:06.857936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289e355-7d1d-4fcf-9461-fcfde9791bae None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:06.858210 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289e355-7d1d-4fcf-9461-fcfde9791bae None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:06.858938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7826ac4-f549-4c66-a48d-2dd6fb6fe618 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:06.859043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289e355-7d1d-4fcf-9461-fcfde9791bae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:06.859325 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289e355-7d1d-4fcf-9461-fcfde9791bae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:06.859689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7826ac4-f549-4c66-a48d-2dd6fb6fe618 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:06.860128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7826ac4-f549-4c66-a48d-2dd6fb6fe618 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:06.860766 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289e355-7d1d-4fcf-9461-fcfde9791bae None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:06.869937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7826ac4-f549-4c66-a48d-2dd6fb6fe618 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:06.871942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7826ac4-f549-4c66-a48d-2dd6fb6fe618 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:06.877635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 292/596] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:06.881290 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289e355-7d1d-4fcf-9461-fcfde9791bae None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-a7826ac4-f549-4c66-a48d-2dd6fb6fe618 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:06.890121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:06.891055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:06.891970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:06.891970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:06.891970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:06.891970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:06.891970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:06.891970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:06.891970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:06.891970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:06.894331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 305/597] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:06.895435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7826ac4-f549-4c66-a48d-2dd6fb6fe618 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:07.005678 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289e355-7d1d-4fcf-9461-fcfde9791bae None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:07.035240 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:07.042705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7826ac4-f549-4c66-a48d-2dd6fb6fe618 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:07.042980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54179544-587b-497e-b895-39aabcefc039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:07.043974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54179544-587b-497e-b895-39aabcefc039 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:07.044396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54179544-587b-497e-b895-39aabcefc039 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:07.044860 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54179544-587b-497e-b895-39aabcefc039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:07.056362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54179544-587b-497e-b895-39aabcefc039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:07.058175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54179544-587b-497e-b895-39aabcefc039 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-54179544-587b-497e-b895-39aabcefc039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:07.075774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:07.076781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:07.077664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:07.077664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:07.077664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:07.077664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:07.079992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 293/598] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:07.080980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54179544-587b-497e-b895-39aabcefc039 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:07.087845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbea3bd-b638-4816-97c0-a311fc203b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:07.088775 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea3bd-b638-4816-97c0-a311fc203b24 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:07.089146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea3bd-b638-4816-97c0-a311fc203b24 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:07.089510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea3bd-b638-4816-97c0-a311fc203b24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:07.097381 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbea3bd-b638-4816-97c0-a311fc203b24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:07.099582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbea3bd-b638-4816-97c0-a311fc203b24 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-7cbea3bd-b638-4816-97c0-a311fc203b24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:07.115676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:07.116812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:07.117909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:07.117909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:07.117909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:07.117909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:07.117909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:07.117909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:07.117909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:07.117909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:07.119598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 306/599] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:07.124928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbea3bd-b638-4816-97c0-a311fc203b24 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:07.159043 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:07.190431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54179544-587b-497e-b895-39aabcefc039 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:07.226609 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc71581-d6a9-4328-b0d8-7328e9ae08ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:07.227546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc71581-d6a9-4328-b0d8-7328e9ae08ba None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:07.228005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc71581-d6a9-4328-b0d8-7328e9ae08ba None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:07.228429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc71581-d6a9-4328-b0d8-7328e9ae08ba None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:07.229366 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc71581-d6a9-4328-b0d8-7328e9ae08ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:07.229818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc71581-d6a9-4328-b0d8-7328e9ae08ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:07.231465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc71581-d6a9-4328-b0d8-7328e9ae08ba None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:07.241090 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbea3bd-b638-4816-97c0-a311fc203b24 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:07.245364 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 294/600] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:07.246835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc71581-d6a9-4328-b0d8-7328e9ae08ba None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:07.277970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25b60d-063f-40c7-b85c-060060568641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:07.278741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25b60d-063f-40c7-b85c-060060568641 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:07.279054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25b60d-063f-40c7-b85c-060060568641 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:07.279324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25b60d-063f-40c7-b85c-060060568641 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:07.280045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25b60d-063f-40c7-b85c-060060568641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:07.280346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25b60d-063f-40c7-b85c-060060568641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:07.282061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25b60d-063f-40c7-b85c-060060568641 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:07.294758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 307/601] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:07.299177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:07.300407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28fc82-2c4c-42d8-9042-917f2732e144 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:07.300694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28fc82-2c4c-42d8-9042-917f2732e144 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:07.300937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28fc82-2c4c-42d8-9042-917f2732e144 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:07.302811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 308/602] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:07.303165 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28fc82-2c4c-42d8-9042-917f2732e144 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:07.360875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc71581-d6a9-4328-b0d8-7328e9ae08ba None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:07.396072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fab2e9-e510-4181-8765-0b241616c306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:07.396746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fab2e9-e510-4181-8765-0b241616c306 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:07.397029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fab2e9-e510-4181-8765-0b241616c306 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:07.397340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fab2e9-e510-4181-8765-0b241616c306 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:07.398391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fab2e9-e510-4181-8765-0b241616c306 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:07.398616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fab2e9-e510-4181-8765-0b241616c306 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:07.400128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fab2e9-e510-4181-8765-0b241616c306 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:07.405798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:07.417997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 295/603] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:07.417997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fab2e9-e510-4181-8765-0b241616c306 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:07.424150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28fc82-2c4c-42d8-9042-917f2732e144 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:07.458929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8285311-cc7f-44bd-909c-240470716203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:07.459955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8285311-cc7f-44bd-909c-240470716203 None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:07.460239 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8285311-cc7f-44bd-909c-240470716203 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:07.460513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8285311-cc7f-44bd-909c-240470716203 None admin] PATH_INFO: `/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/aef547cb73e04f62afb9e6c20793ad8d/roles/b9998a2301454764ae06a0f743463c5d` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:07.477635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8285311-cc7f-44bd-909c-240470716203 None admin] RBAC: Authorizing `identity:create_grant(project_id=96e59c2ab83c477385e5a81b32a7c897, user_id=aef547cb73e04f62afb9e6c20793ad8d, role_id=b9998a2301454764ae06a0f743463c5d)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:07.479127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8285311-cc7f-44bd-909c-240470716203 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:07.502808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 309/604] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:36:07 2022] PUT /identity/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/aef547cb73e04f62afb9e6c20793ad8d/roles/b9998a2301454764ae06a0f743463c5d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:36:07.502808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75902dcb-f1a5-4653-84e8-d4dd5941576b None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:07.502808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75902dcb-f1a5-4653-84e8-d4dd5941576b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:07.502808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75902dcb-f1a5-4653-84e8-d4dd5941576b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:07.520251 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-75902dcb-f1a5-4653-84e8-d4dd5941576b None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:07.521597 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-75902dcb-f1a5-4653-84e8-d4dd5941576b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:07.542321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fab2e9-e510-4181-8765-0b241616c306 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:07.544564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:07.602101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cb324-1ab1-4e35-9dfc-0ddd26642571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:07.603006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb324-1ab1-4e35-9dfc-0ddd26642571 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:07.603290 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb324-1ab1-4e35-9dfc-0ddd26642571 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:07.603566 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb324-1ab1-4e35-9dfc-0ddd26642571 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:07.611315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 310/605] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:36:07.611887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cb324-1ab1-4e35-9dfc-0ddd26642571 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:07.612507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75902dcb-f1a5-4653-84e8-d4dd5941576b None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:07.613394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cb324-1ab1-4e35-9dfc-0ddd26642571 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-504cb324-1ab1-4e35-9dfc-0ddd26642571 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:07.631259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:07.632271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:07.633143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:07.633143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:07.633143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:07.633143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:07.633143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:07.633143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:07.633143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:07.633143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:07.638426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 296/606] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:07.639701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cb324-1ab1-4e35-9dfc-0ddd26642571 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:07.719974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:07.758363 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75902dcb-f1a5-4653-84e8-d4dd5941576b None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:07.779374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cb324-1ab1-4e35-9dfc-0ddd26642571 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:07.805148 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae178d-bcb6-4312-ba1f-5b087be7e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:07.806608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae178d-bcb6-4312-ba1f-5b087be7e753 None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:07.807274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae178d-bcb6-4312-ba1f-5b087be7e753 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:07.808149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae178d-bcb6-4312-ba1f-5b087be7e753 None admin] PATH_INFO: `/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/450fda3236cc4d1ba3189b6b66f65686/roles/b9998a2301454764ae06a0f743463c5d` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:07.816440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d7707-72d7-45fc-bea9-87ba87674865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:07.817228 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d7707-72d7-45fc-bea9-87ba87674865 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:07.817576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d7707-72d7-45fc-bea9-87ba87674865 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:07.817924 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d7707-72d7-45fc-bea9-87ba87674865 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:07.818803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d7707-72d7-45fc-bea9-87ba87674865 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:07.819258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d7707-72d7-45fc-bea9-87ba87674865 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:07.820910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d7707-72d7-45fc-bea9-87ba87674865 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:07.827823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae178d-bcb6-4312-ba1f-5b087be7e753 None admin] RBAC: Authorizing `identity:create_grant(project_id=96e59c2ab83c477385e5a81b32a7c897, user_id=450fda3236cc4d1ba3189b6b66f65686, role_id=b9998a2301454764ae06a0f743463c5d)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:07.830064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae178d-bcb6-4312-ba1f-5b087be7e753 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:07.837821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 297/607] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:07.837821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d7707-72d7-45fc-bea9-87ba87674865 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:07.856589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 311/608] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:36:07 2022] PUT /identity/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/450fda3236cc4d1ba3189b6b66f65686/roles/b9998a2301454764ae06a0f743463c5d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:36:07.863061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae178d-bcb6-4312-ba1f-5b087be7e753 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:07.886018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:07.965043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d7707-72d7-45fc-bea9-87ba87674865 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:08.001562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda08e0-464f-4f01-ba99-458de49dd23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:08.002538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda08e0-464f-4f01-ba99-458de49dd23d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:08.002952 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda08e0-464f-4f01-ba99-458de49dd23d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:08.003325 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda08e0-464f-4f01-ba99-458de49dd23d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:08.006205 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae178d-bcb6-4312-ba1f-5b087be7e753 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:08.015653 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda08e0-464f-4f01-ba99-458de49dd23d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-2bda08e0-464f-4f01-ba99-458de49dd23d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:08.024268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:08.025469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:08.026452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:08.026452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:08.026452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:08.026452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:08.026452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:08.026452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:08.026452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:08.026452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:08.026452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:08.026452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:08.026452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:08.026452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:08.031245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 298/609] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:08.031463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:08.033316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e781-5607-43bc-88fd-f877fa8e4b2e None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:08.033684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e781-5607-43bc-88fd-f877fa8e4b2e None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:08.034018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e781-5607-43bc-88fd-f877fa8e4b2e None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:08.035738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 299/610] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:08.037869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409e781-5607-43bc-88fd-f877fa8e4b2e None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:08.061900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9aee3-faec-474f-a3f4-8fb04786ff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:08.063507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9aee3-faec-474f-a3f4-8fb04786ff8d None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:08.063801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9aee3-faec-474f-a3f4-8fb04786ff8d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:08.064082 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9aee3-faec-474f-a3f4-8fb04786ff8d None admin] PATH_INFO: `/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/b3aa7416101948aba0b45129174cd988/roles/b9998a2301454764ae06a0f743463c5d` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:08.084437 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9aee3-faec-474f-a3f4-8fb04786ff8d None admin] RBAC: Authorizing `identity:create_grant(project_id=96e59c2ab83c477385e5a81b32a7c897, user_id=b3aa7416101948aba0b45129174cd988, role_id=b9998a2301454764ae06a0f743463c5d)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:08.086429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9aee3-faec-474f-a3f4-8fb04786ff8d None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:08.107253 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 312/611] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:36:07 2022] PUT /identity/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/b3aa7416101948aba0b45129174cd988/roles/b9998a2301454764ae06a0f743463c5d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:36:08.109751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3945431-f995-403e-bcc1-a764b87e6559 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:08.110237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3945431-f995-403e-bcc1-a764b87e6559 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:08.110919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3945431-f995-403e-bcc1-a764b87e6559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:08.134176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-a3945431-f995-403e-bcc1-a764b87e6559 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:08.136480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a3945431-f995-403e-bcc1-a764b87e6559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:08.139190 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:08.161303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409e781-5607-43bc-88fd-f877fa8e4b2e None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:08.199768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4018b32-734a-4862-86ea-22146f049c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:08.200853 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4018b32-734a-4862-86ea-22146f049c15 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:08.201355 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4018b32-734a-4862-86ea-22146f049c15 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:08.201876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4018b32-734a-4862-86ea-22146f049c15 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:08.202977 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4018b32-734a-4862-86ea-22146f049c15 None admin] RBAC: Adding query filter params (name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:08.203517 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4018b32-734a-4862-86ea-22146f049c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:08.205215 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4018b32-734a-4862-86ea-22146f049c15 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:08.215859 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 300/612] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:36:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:08.222880 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4018b32-734a-4862-86ea-22146f049c15 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:08.225968 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 313/613] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:36:08.284123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3945431-f995-403e-bcc1-a764b87e6559 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:08.390332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4018b32-734a-4862-86ea-22146f049c15 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:08.424759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:08.429577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3945431-f995-403e-bcc1-a764b87e6559 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:08.432246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f60730-94bb-463a-a65c-bd2b0abc4921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:08.433071 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f60730-94bb-463a-a65c-bd2b0abc4921 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:08.433358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f60730-94bb-463a-a65c-bd2b0abc4921 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:08.433633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f60730-94bb-463a-a65c-bd2b0abc4921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:08.445513 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f60730-94bb-463a-a65c-bd2b0abc4921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:08.447026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f60730-94bb-463a-a65c-bd2b0abc4921 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:08.464218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:08.480412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f20fe4-a023-4aec-a5ec-88ea49d6fbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:08.481555 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f20fe4-a023-4aec-a5ec-88ea49d6fbfb None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:08.482036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f20fe4-a023-4aec-a5ec-88ea49d6fbfb None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:08.482587 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f20fe4-a023-4aec-a5ec-88ea49d6fbfb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-b5f60730-94bb-463a-a65c-bd2b0abc4921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:08.488258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:08.489122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:08.490025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:08.490025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:08.490025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:08.490025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:08.492536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 301/614] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:08.501508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f20fe4-a023-4aec-a5ec-88ea49d6fbfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:08.502679 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f60730-94bb-463a-a65c-bd2b0abc4921 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-93f20fe4-a023-4aec-a5ec-88ea49d6fbfb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:08.509708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:08.510664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:08.513030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:08.513030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:08.513030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:08.513030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:08.513030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:08.513030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:08.513030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:08.513030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:08.513030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:08.513030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:08.513030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:08.513030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:08.513030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 314/615] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:08.518817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f20fe4-a023-4aec-a5ec-88ea49d6fbfb None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:08.706833 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f60730-94bb-463a-a65c-bd2b0abc4921 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:08.710341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f20fe4-a023-4aec-a5ec-88ea49d6fbfb None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:08.745126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7a430-ab8a-4fcf-af62-92f3e74d690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:08.745807 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7a430-ab8a-4fcf-af62-92f3e74d690e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:08.746093 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7a430-ab8a-4fcf-af62-92f3e74d690e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:08.746369 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7a430-ab8a-4fcf-af62-92f3e74d690e None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:08.747163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7a430-ab8a-4fcf-af62-92f3e74d690e None admin] RBAC: Adding query filter params (name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:08.747469 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7a430-ab8a-4fcf-af62-92f3e74d690e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:08.748866 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7a430-ab8a-4fcf-af62-92f3e74d690e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:08.758004 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 315/616] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:36:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:08.763418 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7a430-ab8a-4fcf-af62-92f3e74d690e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:08.801537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:08.804212 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abcfeb-643e-440e-b765-77af6a8f0a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:08.804918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abcfeb-643e-440e-b765-77af6a8f0a15 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:08.805200 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abcfeb-643e-440e-b765-77af6a8f0a15 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:08.805487 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abcfeb-643e-440e-b765-77af6a8f0a15 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:08.806219 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abcfeb-643e-440e-b765-77af6a8f0a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:08.806526 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abcfeb-643e-440e-b765-77af6a8f0a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:08.808064 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abcfeb-643e-440e-b765-77af6a8f0a15 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:08.841089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 302/617] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:08.846513 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abcfeb-643e-440e-b765-77af6a8f0a15 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:08.876954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7a430-ab8a-4fcf-af62-92f3e74d690e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:08.914060 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcf5f7-f4de-4109-9cfb-0eb30cefbe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:08.914900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcf5f7-f4de-4109-9cfb-0eb30cefbe21 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:08.915316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcf5f7-f4de-4109-9cfb-0eb30cefbe21 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:08.915600 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcf5f7-f4de-4109-9cfb-0eb30cefbe21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:08.926709 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcf5f7-f4de-4109-9cfb-0eb30cefbe21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:08.928578 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcf5f7-f4de-4109-9cfb-0eb30cefbe21 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-dfdcf5f7-f4de-4109-9cfb-0eb30cefbe21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:08.949521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:08.950398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:08.951310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:08.951310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:08.951310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:08.951310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:08.951310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 316/618] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:08.956718 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcf5f7-f4de-4109-9cfb-0eb30cefbe21 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:09.001043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:09.047168 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abcfeb-643e-440e-b765-77af6a8f0a15 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:09.087664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c183708-d9ba-45df-95cb-c8b37b01bbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:09.088480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c183708-d9ba-45df-95cb-c8b37b01bbb3 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:09.088758 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c183708-d9ba-45df-95cb-c8b37b01bbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:09.089032 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c183708-d9ba-45df-95cb-c8b37b01bbb3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:09.103989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c183708-d9ba-45df-95cb-c8b37b01bbb3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:09.105725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c183708-d9ba-45df-95cb-c8b37b01bbb3 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:09.111750 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-0c183708-d9ba-45df-95cb-c8b37b01bbb3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:09.135265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:09.136530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:09.137845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:09.137845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:09.137845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:09.137845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:09.137845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:09.137845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:09.137845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:09.137845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:09.137845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 03:36:09.137845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:09.140013 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 303/619] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:36:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:09.145624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c183708-d9ba-45df-95cb-c8b37b01bbb3 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:09.169599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcf5f7-f4de-4109-9cfb-0eb30cefbe21 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:09.235947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ed0cc-b054-490b-a87f-33e04d2d375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:09.236622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed0cc-b054-490b-a87f-33e04d2d375b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:09.236906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed0cc-b054-490b-a87f-33e04d2d375b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:09.237188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed0cc-b054-490b-a87f-33e04d2d375b None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:09.237928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ed0cc-b054-490b-a87f-33e04d2d375b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:09.238232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ed0cc-b054-490b-a87f-33e04d2d375b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:09.239674 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ed0cc-b054-490b-a87f-33e04d2d375b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:09.256545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c183708-d9ba-45df-95cb-c8b37b01bbb3 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:09.256731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 317/620] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:09.258709 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ed0cc-b054-490b-a87f-33e04d2d375b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:09.286949 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:09.323614 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5ab0a-91ef-46ea-b90e-3d1afc703553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:09.324306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5ab0a-91ef-46ea-b90e-3d1afc703553 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:09.324586 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5ab0a-91ef-46ea-b90e-3d1afc703553 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:09.324861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5ab0a-91ef-46ea-b90e-3d1afc703553 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:09.325779 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5ab0a-91ef-46ea-b90e-3d1afc703553 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:09.326129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5ab0a-91ef-46ea-b90e-3d1afc703553 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:09.327614 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5ab0a-91ef-46ea-b90e-3d1afc703553 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:09.360881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 304/621] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 30 03:36:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:09.364658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5ab0a-91ef-46ea-b90e-3d1afc703553 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:09.446303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ed0cc-b054-490b-a87f-33e04d2d375b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:09.521704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5ab0a-91ef-46ea-b90e-3d1afc703553 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:09.558623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2206eb0-e967-4f09-83b3-f3d40df5c9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:09.559998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2206eb0-e967-4f09-83b3-f3d40df5c9d0 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:09.560273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2206eb0-e967-4f09-83b3-f3d40df5c9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:09.560541 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2206eb0-e967-4f09-83b3-f3d40df5c9d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:09.565086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d081b9-7bd7-408d-9682-4cd06e459548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:09.565888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d081b9-7bd7-408d-9682-4cd06e459548 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:09.566164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d081b9-7bd7-408d-9682-4cd06e459548 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:09.566434 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d081b9-7bd7-408d-9682-4cd06e459548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:09.575094 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:09.579258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2206eb0-e967-4f09-83b3-f3d40df5c9d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:09.580723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2206eb0-e967-4f09-83b3-f3d40df5c9d0 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:09.589643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d081b9-7bd7-408d-9682-4cd06e459548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:09.591141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d081b9-7bd7-408d-9682-4cd06e459548 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-a2206eb0-e967-4f09-83b3-f3d40df5c9d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:09.604099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:09.605068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:09.606012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:09.606012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:09.606012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:09.606012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:09.606012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:09.606012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:09.606012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:09.606012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:09.606012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:36:09.606012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:09.612473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 318/622] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 03:36:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:09.618174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2206eb0-e967-4f09-83b3-f3d40df5c9d0 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-d0d081b9-7bd7-408d-9682-4cd06e459548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:09.621376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:09.623322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:09.625409 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:09.625409 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:09.625409 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:09.625409 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:09.625409 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 305/623] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:09.631915 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d081b9-7bd7-408d-9682-4cd06e459548 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:09.691826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:09.816616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d081b9-7bd7-408d-9682-4cd06e459548 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:09.822486 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2206eb0-e967-4f09-83b3-f3d40df5c9d0 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:09.870035 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe00352-0759-4a8f-85a9-761917478bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:09.870832 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe00352-0759-4a8f-85a9-761917478bc0 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:09.871261 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe00352-0759-4a8f-85a9-761917478bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:09.871606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe00352-0759-4a8f-85a9-761917478bc0 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:09.872408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe00352-0759-4a8f-85a9-761917478bc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:09.872786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe00352-0759-4a8f-85a9-761917478bc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:09.874445 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da625626-1fc4-4a57-a8df-fdf16e58724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:09.874585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe00352-0759-4a8f-85a9-761917478bc0 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:09.875291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625626-1fc4-4a57-a8df-fdf16e58724e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:09.875649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625626-1fc4-4a57-a8df-fdf16e58724e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:09.878695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625626-1fc4-4a57-a8df-fdf16e58724e None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:09.878695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da625626-1fc4-4a57-a8df-fdf16e58724e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:09.878695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da625626-1fc4-4a57-a8df-fdf16e58724e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:09.878695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da625626-1fc4-4a57-a8df-fdf16e58724e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:09.887248 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 306/624] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:09.888678 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a37d9-9cc9-47c0-bca8-e3ef50c48187 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:09.893377 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a37d9-9cc9-47c0-bca8-e3ef50c48187 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:09.893741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a37d9-9cc9-47c0-bca8-e3ef50c48187 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:09.895243 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 307/625] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:09.896058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a37d9-9cc9-47c0-bca8-e3ef50c48187 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:09.902732 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 319/626] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 03:36:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:09.904374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd7821-4680-492e-8d7a-a150b272e497 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:09.904665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd7821-4680-492e-8d7a-a150b272e497 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:09.904944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd7821-4680-492e-8d7a-a150b272e497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:09.921945 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-bddd7821-4680-492e-8d7a-a150b272e497 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:09.923234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-bddd7821-4680-492e-8d7a-a150b272e497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:09.971188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:09.985343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:10.010785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 320/627] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:36:10.010785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd7821-4680-492e-8d7a-a150b272e497 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:10.024928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a37d9-9cc9-47c0-bca8-e3ef50c48187 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:10.063032 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d342d2-5b36-4633-9479-19da88d574f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:10.063893 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d342d2-5b36-4633-9479-19da88d574f4 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:10.064175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d342d2-5b36-4633-9479-19da88d574f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:10.064449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d342d2-5b36-4633-9479-19da88d574f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:10.072511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d342d2-5b36-4633-9479-19da88d574f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:10.074033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d342d2-5b36-4633-9479-19da88d574f4 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-b0d342d2-5b36-4633-9479-19da88d574f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:10.089823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:10.090806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:10.092120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:10.092120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:10.092120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:10.092120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:10.092120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:10.092120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:10.092120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:10.092120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:10.092120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 308/628] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:10.092703 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d342d2-5b36-4633-9479-19da88d574f4 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:10.135970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd7821-4680-492e-8d7a-a150b272e497 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:10.174145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457d3c7-2fe8-48cb-8aea-9c4241df0bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:10.175270 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457d3c7-2fe8-48cb-8aea-9c4241df0bcb None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:10.175817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457d3c7-2fe8-48cb-8aea-9c4241df0bcb None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:10.176286 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457d3c7-2fe8-48cb-8aea-9c4241df0bcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:10.203604 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d342d2-5b36-4633-9479-19da88d574f4 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:10.232312 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:10.240858 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e43a49-3c16-4051-9fb5-6b17f85d6390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:10.241797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e43a49-3c16-4051-9fb5-6b17f85d6390 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:10.242080 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e43a49-3c16-4051-9fb5-6b17f85d6390 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:10.242357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e43a49-3c16-4051-9fb5-6b17f85d6390 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:10.252743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457d3c7-2fe8-48cb-8aea-9c4241df0bcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:10.253316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e43a49-3c16-4051-9fb5-6b17f85d6390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:10.254621 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457d3c7-2fe8-48cb-8aea-9c4241df0bcb None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-34e43a49-3c16-4051-9fb5-6b17f85d6390 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:10.261689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:10.262824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:10.263697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:10.263697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:10.263697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:10.263697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:10.263697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:10.263697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:10.263697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:10.263697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:10.263697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:10.263697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:10.263697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:10.263697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:10.263697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 309/629] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:10.263697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e43a49-3c16-4051-9fb5-6b17f85d6390 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:10.273861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:10.371527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 321/630] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:36:10.371527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8ee2b-0d37-4c7b-bac7-58dcf3c95317 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:10.371527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8ee2b-0d37-4c7b-bac7-58dcf3c95317 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:10.371527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8ee2b-0d37-4c7b-bac7-58dcf3c95317 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:10.371527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 322/631] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:10.371527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8ee2b-0d37-4c7b-bac7-58dcf3c95317 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:10.378985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e43a49-3c16-4051-9fb5-6b17f85d6390 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:10.415684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd148884-529f-46b0-9ec9-c421bc765367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:10.416879 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd148884-529f-46b0-9ec9-c421bc765367 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:10.417404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd148884-529f-46b0-9ec9-c421bc765367 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:10.417898 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd148884-529f-46b0-9ec9-c421bc765367 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:10.419125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd148884-529f-46b0-9ec9-c421bc765367 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:10.419663 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd148884-529f-46b0-9ec9-c421bc765367 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:10.421372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd148884-529f-46b0-9ec9-c421bc765367 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:10.435302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 310/632] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:10.436677 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd148884-529f-46b0-9ec9-c421bc765367 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:10.464059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:10.487845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8ee2b-0d37-4c7b-bac7-58dcf3c95317 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:10.513214 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:10.524310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84433a4b-f431-4adc-8c5f-13acb2ba2ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:10.525399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84433a4b-f431-4adc-8c5f-13acb2ba2ff8 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:10.525689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84433a4b-f431-4adc-8c5f-13acb2ba2ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:10.525966 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84433a4b-f431-4adc-8c5f-13acb2ba2ff8 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:10.527138 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84433a4b-f431-4adc-8c5f-13acb2ba2ff8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:10.527442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84433a4b-f431-4adc-8c5f-13acb2ba2ff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:10.529099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84433a4b-f431-4adc-8c5f-13acb2ba2ff8 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:10.537607 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 323/633] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:36:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:10.538850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578b3b2-eba7-4a69-8903-b5d51259fea4 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:10.539155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578b3b2-eba7-4a69-8903-b5d51259fea4 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:10.539423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578b3b2-eba7-4a69-8903-b5d51259fea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:10.555011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd148884-529f-46b0-9ec9-c421bc765367 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:10.556016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-2578b3b2-eba7-4a69-8903-b5d51259fea4 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:10.557832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2578b3b2-eba7-4a69-8903-b5d51259fea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:10.590987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09568d21-d30c-4405-9c3c-f56cbdaebc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:10.591807 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09568d21-d30c-4405-9c3c-f56cbdaebc8a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:10.592081 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09568d21-d30c-4405-9c3c-f56cbdaebc8a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:10.592345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09568d21-d30c-4405-9c3c-f56cbdaebc8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:10.603070 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09568d21-d30c-4405-9c3c-f56cbdaebc8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:10.604569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09568d21-d30c-4405-9c3c-f56cbdaebc8a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-09568d21-d30c-4405-9c3c-f56cbdaebc8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:10.624106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:10.625033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:10.625933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:10.625933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:10.625933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:10.625933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:10.626375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 311/634] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:10.627351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09568d21-d30c-4405-9c3c-f56cbdaebc8a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:10.630800 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 324/635] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:36:10.632330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e83b8-e40d-418a-b5d0-c6f997ffe1c7 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:10.632597 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e83b8-e40d-418a-b5d0-c6f997ffe1c7 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:10.632892 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e83b8-e40d-418a-b5d0-c6f997ffe1c7 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:10.638109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 325/636] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:10.638109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e83b8-e40d-418a-b5d0-c6f997ffe1c7 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:10.715513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:10.730647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09568d21-d30c-4405-9c3c-f56cbdaebc8a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:10.742445 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e83b8-e40d-418a-b5d0-c6f997ffe1c7 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:10.748630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:10.767660 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44001ca2-4a7b-4f35-95e5-df5e675c51b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:10.768557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44001ca2-4a7b-4f35-95e5-df5e675c51b3 None admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:10.768839 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44001ca2-4a7b-4f35-95e5-df5e675c51b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:10.769113 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44001ca2-4a7b-4f35-95e5-df5e675c51b3 None admin] PATH_INFO: `/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/9de5d5c703b84e508e3112f90070e002/roles/b9998a2301454764ae06a0f743463c5d` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:10.777716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb4122-78f8-49c0-a961-652b5fb52bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:10.778508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4122-78f8-49c0-a961-652b5fb52bfe None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:10.778808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4122-78f8-49c0-a961-652b5fb52bfe None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:10.779103 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4122-78f8-49c0-a961-652b5fb52bfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:10.783616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44001ca2-4a7b-4f35-95e5-df5e675c51b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=96e59c2ab83c477385e5a81b32a7c897, user_id=9de5d5c703b84e508e3112f90070e002, role_id=b9998a2301454764ae06a0f743463c5d)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:10.785105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44001ca2-4a7b-4f35-95e5-df5e675c51b3 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:10.789180 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb4122-78f8-49c0-a961-652b5fb52bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:10.790629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb4122-78f8-49c0-a961-652b5fb52bfe None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:10.799521 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 312/637] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:36:10 2022] PUT /identity/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/9de5d5c703b84e508e3112f90070e002/roles/b9998a2301454764ae06a0f743463c5d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:36:10.800327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44001ca2-4a7b-4f35-95e5-df5e675c51b3 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-54fb4122-78f8-49c0-a961-652b5fb52bfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:10.808837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:10.809923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:10.810846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:10.810846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:10.810846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:10.810846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:10.810846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 326/638] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:10.811833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a2afc-11b3-4bf0-83a7-ee7052784937 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:10.812059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a2afc-11b3-4bf0-83a7-ee7052784937 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:10.812337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a2afc-11b3-4bf0-83a7-ee7052784937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:10.831343 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-774a2afc-11b3-4bf0-83a7-ee7052784937 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:10.832574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-774a2afc-11b3-4bf0-83a7-ee7052784937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:10.927383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 327/639] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:36:10.927383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a2afc-11b3-4bf0-83a7-ee7052784937 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:10.943286 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44001ca2-4a7b-4f35-95e5-df5e675c51b3 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:10.985348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc1c66-8ba5-4045-8b7d-0a42d30b9ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:10.986031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1c66-8ba5-4045-8b7d-0a42d30b9ee0 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:10.986313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1c66-8ba5-4045-8b7d-0a42d30b9ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:10.986597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1c66-8ba5-4045-8b7d-0a42d30b9ee0 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:10.987364 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc1c66-8ba5-4045-8b7d-0a42d30b9ee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:10.987672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc1c66-8ba5-4045-8b7d-0a42d30b9ee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:10.989067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc1c66-8ba5-4045-8b7d-0a42d30b9ee0 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:10.994629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:11.002921 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 313/640] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:11.002921 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc1c66-8ba5-4045-8b7d-0a42d30b9ee0 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:11.032462 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:11.046345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a2afc-11b3-4bf0-83a7-ee7052784937 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:11.084258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47ecf7-415a-4a2d-80cf-e12fb015b3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:11.085325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47ecf7-415a-4a2d-80cf-e12fb015b3b6 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:11.085584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47ecf7-415a-4a2d-80cf-e12fb015b3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:11.085858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47ecf7-415a-4a2d-80cf-e12fb015b3b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:11.099519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47ecf7-415a-4a2d-80cf-e12fb015b3b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:11.106963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc1c66-8ba5-4045-8b7d-0a42d30b9ee0 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-9c47ecf7-415a-4a2d-80cf-e12fb015b3b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:11.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:11.108281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:11.109144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:11.109144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:11.109144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:11.109144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:11.109144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:11.109144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:11.109144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:11.109144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:11.109144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:11.109144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:11.109144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:11.109144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:11.109144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 328/641] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:11.109836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47ecf7-415a-4a2d-80cf-e12fb015b3b6 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:11.150122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c6bd-d00e-4e44-a04b-2c6e7bf83d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:11.151224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c6bd-d00e-4e44-a04b-2c6e7bf83d9f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:11.151740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c6bd-d00e-4e44-a04b-2c6e7bf83d9f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:11.152657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c6bd-d00e-4e44-a04b-2c6e7bf83d9f None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:11.153608 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96c6bd-d00e-4e44-a04b-2c6e7bf83d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:11.154492 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96c6bd-d00e-4e44-a04b-2c6e7bf83d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:11.156726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96c6bd-d00e-4e44-a04b-2c6e7bf83d9f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:11.171515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 314/642] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:11.173150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c6bd-d00e-4e44-a04b-2c6e7bf83d9f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:11.215010 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47ecf7-415a-4a2d-80cf-e12fb015b3b6 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:11.233080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:11.251923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd3edc-015e-4210-bc69-04babdc51aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:11.252811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd3edc-015e-4210-bc69-04babdc51aea None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:11.253000 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd3edc-015e-4210-bc69-04babdc51aea None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:11.253272 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd3edc-015e-4210-bc69-04babdc51aea None admin] PATH_INFO: `/v3/roles/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:11.263851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd3edc-015e-4210-bc69-04babdc51aea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-6cdd3edc-015e-4210-bc69-04babdc51aea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:11.271540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:11.272668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:11.273517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:11.273517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:11.273517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:11.273517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:11.273517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:11.273517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:11.273517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:11.273517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:11.273517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:11.273517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:11.273517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:11.273517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:11.273517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 329/643] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:11.275101 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd3edc-015e-4210-bc69-04babdc51aea None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:11.283184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:11.297064 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c6bd-d00e-4e44-a04b-2c6e7bf83d9f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:11.339090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3202b9-b85f-44b2-a424-7a7f2c6cd446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:11.339903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3202b9-b85f-44b2-a424-7a7f2c6cd446 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:11.340187 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3202b9-b85f-44b2-a424-7a7f2c6cd446 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:11.340464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3202b9-b85f-44b2-a424-7a7f2c6cd446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:11.347495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3202b9-b85f-44b2-a424-7a7f2c6cd446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:11.349302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3202b9-b85f-44b2-a424-7a7f2c6cd446 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-7b3202b9-b85f-44b2-a424-7a7f2c6cd446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:11.363672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:11.364630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:11.365700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:11.365700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:11.365700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:11.365700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:11.365700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:11.365700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:11.365700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:11.365700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:11.365700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 315/644] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:11.365700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3202b9-b85f-44b2-a424-7a7f2c6cd446 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:11.388181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd3edc-015e-4210-bc69-04babdc51aea None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:11.423885 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd7680-8687-4f90-9e60-193bc16e8f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:11.425119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd7680-8687-4f90-9e60-193bc16e8f99 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:11.425612 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd7680-8687-4f90-9e60-193bc16e8f99 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:11.426092 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd7680-8687-4f90-9e60-193bc16e8f99 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:11.427190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd7680-8687-4f90-9e60-193bc16e8f99 None admin] RBAC: Adding query filter params (name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:11.427784 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd7680-8687-4f90-9e60-193bc16e8f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:11.429430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd7680-8687-4f90-9e60-193bc16e8f99 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:11.443826 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 330/645] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:36:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:11.443826 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd7680-8687-4f90-9e60-193bc16e8f99 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:11.470856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3202b9-b85f-44b2-a424-7a7f2c6cd446 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:11.484956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:11.514480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8262a8-b866-46d5-9ec8-ef88eed4fa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:11.515783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8262a8-b866-46d5-9ec8-ef88eed4fa56 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:11.517003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8262a8-b866-46d5-9ec8-ef88eed4fa56 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:11.517480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8262a8-b866-46d5-9ec8-ef88eed4fa56 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:11.526999 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8262a8-b866-46d5-9ec8-ef88eed4fa56 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:11.528481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8262a8-b866-46d5-9ec8-ef88eed4fa56 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-7a8262a8-b866-46d5-9ec8-ef88eed4fa56 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:11.542724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:11.543747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:11.544686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:11.544686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:11.544686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:11.544686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:11.544686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:11.544686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:11.544686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:11.544686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:11.544686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 03:36:11.544686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:11.544686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 316/646] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:36:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:11.546178 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8262a8-b866-46d5-9ec8-ef88eed4fa56 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:11.552656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd7680-8687-4f90-9e60-193bc16e8f99 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:11.561431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:11.589105 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1cd43-58df-4ea4-b6c1-910e81e1b94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:11.589786 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1cd43-58df-4ea4-b6c1-910e81e1b94c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:11.590068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1cd43-58df-4ea4-b6c1-910e81e1b94c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:11.590343 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1cd43-58df-4ea4-b6c1-910e81e1b94c None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:11.591128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1cd43-58df-4ea4-b6c1-910e81e1b94c None admin] RBAC: Adding query filter params (name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:11.591441 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1cd43-58df-4ea4-b6c1-910e81e1b94c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:11.592823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1cd43-58df-4ea4-b6c1-910e81e1b94c None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:11.606780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 331/647] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:36:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:11.606780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1cd43-58df-4ea4-b6c1-910e81e1b94c None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:11.655799 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8262a8-b866-46d5-9ec8-ef88eed4fa56 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:11.690542 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36fa81-3579-40d2-a8b6-3a6af3ee0405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:11.691163 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36fa81-3579-40d2-a8b6-3a6af3ee0405 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:11.691445 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36fa81-3579-40d2-a8b6-3a6af3ee0405 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:11.691720 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36fa81-3579-40d2-a8b6-3a6af3ee0405 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:11.692510 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36fa81-3579-40d2-a8b6-3a6af3ee0405 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:11.692817 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36fa81-3579-40d2-a8b6-3a6af3ee0405 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:11.694571 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36fa81-3579-40d2-a8b6-3a6af3ee0405 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:11.711497 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 317/648] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:11.711497 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36fa81-3579-40d2-a8b6-3a6af3ee0405 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:11.712544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:11.715673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1cd43-58df-4ea4-b6c1-910e81e1b94c None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:11.751860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67626724-237c-428a-9761-a065856febb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:11.752660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67626724-237c-428a-9761-a065856febb0 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:11.752943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67626724-237c-428a-9761-a065856febb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:11.753217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67626724-237c-428a-9761-a065856febb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:11.763926 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67626724-237c-428a-9761-a065856febb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:11.765391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67626724-237c-428a-9761-a065856febb0 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:11.781591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-67626724-237c-428a-9761-a065856febb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:11.782639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:11.783928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:11.784823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:11.784823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:11.784823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:11.784823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:11.784823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 332/649] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:11.784823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67626724-237c-428a-9761-a065856febb0 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:11.820367 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36fa81-3579-40d2-a8b6-3a6af3ee0405 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:11.859842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66f255-a1a1-4cba-b822-cda4b002d26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:11.860528 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66f255-a1a1-4cba-b822-cda4b002d26b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:11.860806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66f255-a1a1-4cba-b822-cda4b002d26b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:11.861085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66f255-a1a1-4cba-b822-cda4b002d26b None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:11.861942 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66f255-a1a1-4cba-b822-cda4b002d26b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:11.862257 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66f255-a1a1-4cba-b822-cda4b002d26b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:11.863744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66f255-a1a1-4cba-b822-cda4b002d26b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:11.883917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 318/650] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 30 03:36:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:11.889268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66f255-a1a1-4cba-b822-cda4b002d26b None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:11.901902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67626724-237c-428a-9761-a065856febb0 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:11.953886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66efa0a-4a5a-434f-9785-51d6c8e61155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:11.955029 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66efa0a-4a5a-434f-9785-51d6c8e61155 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:11.955325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66efa0a-4a5a-434f-9785-51d6c8e61155 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:11.955853 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66efa0a-4a5a-434f-9785-51d6c8e61155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:11.967925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66efa0a-4a5a-434f-9785-51d6c8e61155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:11.969393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66efa0a-4a5a-434f-9785-51d6c8e61155 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-c66efa0a-4a5a-434f-9785-51d6c8e61155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:11.987818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:11.988759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:11.989649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:11.989649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:11.989649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:11.989649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:11.989649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 333/651] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:11.989940 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66efa0a-4a5a-434f-9785-51d6c8e61155 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:11.999059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:12.001447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66f255-a1a1-4cba-b822-cda4b002d26b None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:12.029133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:12.040397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed35f9-f4d5-418d-857c-bee40bf49d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:12.041061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed35f9-f4d5-418d-857c-bee40bf49d85 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:12.041340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed35f9-f4d5-418d-857c-bee40bf49d85 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:12.041611 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed35f9-f4d5-418d-857c-bee40bf49d85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:12.042885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed35f9-f4d5-418d-857c-bee40bf49d85 None admin] RBAC: Adding query filter params (role.id=b9998a2301454764ae06a0f743463c5d, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=758b152c320e4a94921bb96541cbea98) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:12.043199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed35f9-f4d5-418d-857c-bee40bf49d85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:12.045011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed35f9-f4d5-418d-857c-bee40bf49d85 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:12.051758 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 319/652] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:11 2022] GET /identity/v3/role_assignments?user.id=758b152c320e4a94921bb96541cbea98&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b9998a2301454764ae06a0f743463c5d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:12.052446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed35f9-f4d5-418d-857c-bee40bf49d85 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:12.138688 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66efa0a-4a5a-434f-9785-51d6c8e61155 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:12.181691 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d1b74-de7f-432a-9e88-080603cf907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:12.182641 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d1b74-de7f-432a-9e88-080603cf907b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:12.182961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d1b74-de7f-432a-9e88-080603cf907b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:12.183237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d1b74-de7f-432a-9e88-080603cf907b None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:12.184143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d1b74-de7f-432a-9e88-080603cf907b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:12.184452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d1b74-de7f-432a-9e88-080603cf907b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:12.186218 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d1b74-de7f-432a-9e88-080603cf907b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:12.203185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed35f9-f4d5-418d-857c-bee40bf49d85 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:12.207104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 334/653] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:12.208012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d1b74-de7f-432a-9e88-080603cf907b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:12.252052 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645953dc-73d9-47b9-8bb1-e0da84272e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:12.252708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645953dc-73d9-47b9-8bb1-e0da84272e57 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:12.252988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645953dc-73d9-47b9-8bb1-e0da84272e57 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:12.253257 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645953dc-73d9-47b9-8bb1-e0da84272e57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:12.290133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:12.327984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:12.340238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645953dc-73d9-47b9-8bb1-e0da84272e57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:12.342017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645953dc-73d9-47b9-8bb1-e0da84272e57 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:12.347653 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d1b74-de7f-432a-9e88-080603cf907b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:12.388613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad75e24-f4be-4c39-b3e1-fca37065fe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:12.389655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad75e24-f4be-4c39-b3e1-fca37065fe3c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:12.390194 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad75e24-f4be-4c39-b3e1-fca37065fe3c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:12.390686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad75e24-f4be-4c39-b3e1-fca37065fe3c None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:12.391677 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad75e24-f4be-4c39-b3e1-fca37065fe3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:12.392173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad75e24-f4be-4c39-b3e1-fca37065fe3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:12.393846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad75e24-f4be-4c39-b3e1-fca37065fe3c None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:12.413967 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 335/654] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:12.413967 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad75e24-f4be-4c39-b3e1-fca37065fe3c None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:12.460325 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 320/655] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:36:12.461125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645953dc-73d9-47b9-8bb1-e0da84272e57 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:12.545801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad75e24-f4be-4c39-b3e1-fca37065fe3c None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:12.555408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:12.565569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645953dc-73d9-47b9-8bb1-e0da84272e57 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:12.576750 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:12.590647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7edcc-d448-4a69-b6e7-9e4de81a8b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:12.591834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7edcc-d448-4a69-b6e7-9e4de81a8b8b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:12.592314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7edcc-d448-4a69-b6e7-9e4de81a8b8b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:12.592756 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7edcc-d448-4a69-b6e7-9e4de81a8b8b None admin] PATH_INFO: `/v3/users/glance` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:12.603033 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7edcc-d448-4a69-b6e7-9e4de81a8b8b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:12.603673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b111b-18f6-49e0-a2e4-0c8298fb84e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:12.604667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b111b-18f6-49e0-a2e4-0c8298fb84e3 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:12.605040 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b111b-18f6-49e0-a2e4-0c8298fb84e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:12.605191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7edcc-d448-4a69-b6e7-9e4de81a8b8b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:12.605519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b111b-18f6-49e0-a2e4-0c8298fb84e3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:12.613498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b111b-18f6-49e0-a2e4-0c8298fb84e3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:12.615124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b111b-18f6-49e0-a2e4-0c8298fb84e3 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-bfd7edcc-d448-4a69-b6e7-9e4de81a8b8b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:12.623658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:12.624698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:12.625657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:12.625657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:12.625657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:12.625657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:12.625657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:12.625657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:12.625657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:12.625657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:12.625657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 03:36:12.625657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-5c8b111b-18f6-49e0-a2e4-0c8298fb84e3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:12.633384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:12.634650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:12.635625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:12.635625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:12.635625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:12.635625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:12.635625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:12.635625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:12.635625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:12.635625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:12.635625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 03:36:12.635625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:12.636437 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 336/657] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:36:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:12.637463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7edcc-d448-4a69-b6e7-9e4de81a8b8b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:12.638169 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 321/657] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:12.639173 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b111b-18f6-49e0-a2e4-0c8298fb84e3 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:12.747302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b111b-18f6-49e0-a2e4-0c8298fb84e3 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:12.758079 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7edcc-d448-4a69-b6e7-9e4de81a8b8b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:12.784314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1fc93-714f-4515-9877-4f1af3154d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:12.785293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1fc93-714f-4515-9877-4f1af3154d9d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:12.785785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1fc93-714f-4515-9877-4f1af3154d9d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:12.786234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1fc93-714f-4515-9877-4f1af3154d9d None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:12.787332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1fc93-714f-4515-9877-4f1af3154d9d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:12.788501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1fc93-714f-4515-9877-4f1af3154d9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:12.790171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1fc93-714f-4515-9877-4f1af3154d9d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:12.795456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369f8e9-4a5d-4dba-837f-b97f094fa25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:12.796349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369f8e9-4a5d-4dba-837f-b97f094fa25c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:12.796700 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369f8e9-4a5d-4dba-837f-b97f094fa25c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:12.797042 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369f8e9-4a5d-4dba-837f-b97f094fa25c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:12.809654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369f8e9-4a5d-4dba-837f-b97f094fa25c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:12.810820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 322/658] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Jun 30 03:36:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:12.811966 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1fc93-714f-4515-9877-4f1af3154d9d None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:12.815514 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369f8e9-4a5d-4dba-837f-b97f094fa25c None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:12.828423 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-7369f8e9-4a5d-4dba-837f-b97f094fa25c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:12.838212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:12.839372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:12.840276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:12.840276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:12.840276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:12.840276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:12.840276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 337/659] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:12.840566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369f8e9-4a5d-4dba-837f-b97f094fa25c None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:12.885717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:12.938480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1fc93-714f-4515-9877-4f1af3154d9d None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:12.955980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369f8e9-4a5d-4dba-837f-b97f094fa25c None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:12.975358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6af89f-21ec-4556-ad49-3269461c7102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:12.976272 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6af89f-21ec-4556-ad49-3269461c7102 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:12.976713 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6af89f-21ec-4556-ad49-3269461c7102 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:12.977151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6af89f-21ec-4556-ad49-3269461c7102 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:12.978569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6af89f-21ec-4556-ad49-3269461c7102 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:12.979167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6af89f-21ec-4556-ad49-3269461c7102 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:12.981043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6af89f-21ec-4556-ad49-3269461c7102 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:12.991558 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986e127-ff20-4e71-8f95-33fb873206d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:12.992220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e127-ff20-4e71-8f95-33fb873206d7 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:12.992505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e127-ff20-4e71-8f95-33fb873206d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:12.992783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e127-ff20-4e71-8f95-33fb873206d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:13.002700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 323/660] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 30 03:36:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:13.004810 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1b1ca-0aa9-48bc-930e-27abb0169176 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:13.005398 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1b1ca-0aa9-48bc-930e-27abb0169176 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:13.005907 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1b1ca-0aa9-48bc-930e-27abb0169176 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:13.008531 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 324/661] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:13.009425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1b1ca-0aa9-48bc-930e-27abb0169176 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:13.069871 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986e127-ff20-4e71-8f95-33fb873206d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:13.071618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986e127-ff20-4e71-8f95-33fb873206d7 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:13.080255 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:13.106557 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:13.118672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1b1ca-0aa9-48bc-930e-27abb0169176 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:13.158435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f336c2-fe81-4cd2-92a9-ddc320739e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:13.159141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f336c2-fe81-4cd2-92a9-ddc320739e6d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:13.159424 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f336c2-fe81-4cd2-92a9-ddc320739e6d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:13.159719 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f336c2-fe81-4cd2-92a9-ddc320739e6d None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:13.160433 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f336c2-fe81-4cd2-92a9-ddc320739e6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:13.160750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f336c2-fe81-4cd2-92a9-ddc320739e6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:13.162176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f336c2-fe81-4cd2-92a9-ddc320739e6d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:13.174676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 325/662] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:13.175517 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f336c2-fe81-4cd2-92a9-ddc320739e6d None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:13.186112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 338/663] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:36:13.187641 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce8dac-558c-47c7-80f8-6056d5812968 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:13.188072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce8dac-558c-47c7-80f8-6056d5812968 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:13.188490 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce8dac-558c-47c7-80f8-6056d5812968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:13.207093 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-24ce8dac-558c-47c7-80f8-6056d5812968 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:13.208487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-24ce8dac-558c-47c7-80f8-6056d5812968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:13.294887 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 339/664] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:36:13.295074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f336c2-fe81-4cd2-92a9-ddc320739e6d None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:13.295174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce8dac-558c-47c7-80f8-6056d5812968 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:13.325853 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:13.335379 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bfc07-90fc-4e0d-84fb-69c8608e6c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:13.336041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bfc07-90fc-4e0d-84fb-69c8608e6c87 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:13.336321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bfc07-90fc-4e0d-84fb-69c8608e6c87 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:13.336591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bfc07-90fc-4e0d-84fb-69c8608e6c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:13.359192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:13.398546 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce8dac-558c-47c7-80f8-6056d5812968 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:13.403474 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bfc07-90fc-4e0d-84fb-69c8608e6c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:13.404933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bfc07-90fc-4e0d-84fb-69c8608e6c87 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:13.438038 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc1053-bf3b-4dfb-aecb-d8c6f157e00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:13.438864 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc1053-bf3b-4dfb-aecb-d8c6f157e00a None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:13.439151 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc1053-bf3b-4dfb-aecb-d8c6f157e00a None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:13.439424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc1053-bf3b-4dfb-aecb-d8c6f157e00a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:13.446345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc1053-bf3b-4dfb-aecb-d8c6f157e00a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:13.447838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc1053-bf3b-4dfb-aecb-d8c6f157e00a None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-79cc1053-bf3b-4dfb-aecb-d8c6f157e00a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:13.462146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:13.463074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:13.464008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:13.464008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:13.464008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:13.464008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:13.464008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:13.464008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:13.464008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:13.464008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:13.464008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 340/665] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:13.464956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc1053-bf3b-4dfb-aecb-d8c6f157e00a None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:13.521100 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 326/666] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:36:13.521100 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bfc07-90fc-4e0d-84fb-69c8608e6c87 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:13.548374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:13.576329 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc1053-bf3b-4dfb-aecb-d8c6f157e00a None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:13.604363 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:13.614653 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08fb41-aae3-423d-a3f0-07910df27af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:13.615533 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08fb41-aae3-423d-a3f0-07910df27af1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:13.615816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08fb41-aae3-423d-a3f0-07910df27af1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:13.616089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08fb41-aae3-423d-a3f0-07910df27af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:13.624949 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bfc07-90fc-4e0d-84fb-69c8608e6c87 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:13.627782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08fb41-aae3-423d-a3f0-07910df27af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:13.629146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08fb41-aae3-423d-a3f0-07910df27af1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-ef08fb41-aae3-423d-a3f0-07910df27af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:13.646681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:13.647877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:13.648749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:13.648749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:13.648749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:13.648749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:13.648749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 341/667] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:13.649064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08fb41-aae3-423d-a3f0-07910df27af1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:13.664753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d829f-67f8-4b23-bc73-75a64509faab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:13.665574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d829f-67f8-4b23-bc73-75a64509faab None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:13.665853 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d829f-67f8-4b23-bc73-75a64509faab None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:13.666122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d829f-67f8-4b23-bc73-75a64509faab None admin] PATH_INFO: `/v3/roles/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:13.677225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d829f-67f8-4b23-bc73-75a64509faab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-770d829f-67f8-4b23-bc73-75a64509faab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:13.685087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:13.686028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:13.687254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:13.687254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:13.687254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:13.687254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:13.687254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:13.687254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:13.687254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:13.687254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:13.687254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:13.687254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:13.687254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:13.687254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:13.687254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 327/668] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:13.687254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d829f-67f8-4b23-bc73-75a64509faab None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:13.762804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08fb41-aae3-423d-a3f0-07910df27af1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:13.779923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:13.797266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d829f-67f8-4b23-bc73-75a64509faab None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:13.798742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945cb64-ee08-4404-9696-1990fec90f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:13.799417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945cb64-ee08-4404-9696-1990fec90f7d None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:13.800413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945cb64-ee08-4404-9696-1990fec90f7d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:13.800413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945cb64-ee08-4404-9696-1990fec90f7d None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:13.800748 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945cb64-ee08-4404-9696-1990fec90f7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:13.801058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945cb64-ee08-4404-9696-1990fec90f7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:13.802490 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945cb64-ee08-4404-9696-1990fec90f7d None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:13.819849 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 342/669] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:13.819849 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945cb64-ee08-4404-9696-1990fec90f7d None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:13.841444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ec41-1432-4b1a-91e2-a09445ffe8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:13.842995 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ec41-1432-4b1a-91e2-a09445ffe8e1 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:13.843449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ec41-1432-4b1a-91e2-a09445ffe8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:13.843860 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ec41-1432-4b1a-91e2-a09445ffe8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:13.856718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ec41-1432-4b1a-91e2-a09445ffe8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:13.858178 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ec41-1432-4b1a-91e2-a09445ffe8e1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:13.866602 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-f579ec41-1432-4b1a-91e2-a09445ffe8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:13.876923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:13.877856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:13.883855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:13.883855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:13.883855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:13.883855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:13.883855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 328/670] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:13.883855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ec41-1432-4b1a-91e2-a09445ffe8e1 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:13.938773 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945cb64-ee08-4404-9696-1990fec90f7d None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:13.974181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab803968-6d75-4605-ba9f-c4ddb46269ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:13.974971 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab803968-6d75-4605-ba9f-c4ddb46269ce None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:13.975246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab803968-6d75-4605-ba9f-c4ddb46269ce None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:13.975520 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab803968-6d75-4605-ba9f-c4ddb46269ce None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:13.976245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab803968-6d75-4605-ba9f-c4ddb46269ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:13.976557 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab803968-6d75-4605-ba9f-c4ddb46269ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:13.977943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab803968-6d75-4605-ba9f-c4ddb46269ce None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:13.989645 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 343/671] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:13.990478 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab803968-6d75-4605-ba9f-c4ddb46269ce None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:13.991801 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ec41-1432-4b1a-91e2-a09445ffe8e1 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:14.028637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa36f7e-e0e9-48ab-91de-fe3f72ee5077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:14.029337 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa36f7e-e0e9-48ab-91de-fe3f72ee5077 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:14.029625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa36f7e-e0e9-48ab-91de-fe3f72ee5077 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:14.029890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa36f7e-e0e9-48ab-91de-fe3f72ee5077 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:14.030637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa36f7e-e0e9-48ab-91de-fe3f72ee5077 None admin] RBAC: Adding query filter params (name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:14.030967 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa36f7e-e0e9-48ab-91de-fe3f72ee5077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:14.032354 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa36f7e-e0e9-48ab-91de-fe3f72ee5077 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:14.037538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:14.045859 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 329/672] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:36:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:14.045859 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa36f7e-e0e9-48ab-91de-fe3f72ee5077 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:14.104866 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:14.108910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab803968-6d75-4605-ba9f-c4ddb46269ce None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:14.142418 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754f86-097d-44ed-8cc3-20084754a171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:14.143108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754f86-097d-44ed-8cc3-20084754a171 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:14.143388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754f86-097d-44ed-8cc3-20084754a171 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:14.143663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754f86-097d-44ed-8cc3-20084754a171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:14.144487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9754f86-097d-44ed-8cc3-20084754a171 None admin] RBAC: Adding query filter params (role.id=b9998a2301454764ae06a0f743463c5d, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=aef547cb73e04f62afb9e6c20793ad8d) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:14.144798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9754f86-097d-44ed-8cc3-20084754a171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:14.146227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9754f86-097d-44ed-8cc3-20084754a171 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:14.162811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 344/673] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:13 2022] GET /identity/v3/role_assignments?user.id=aef547cb73e04f62afb9e6c20793ad8d&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b9998a2301454764ae06a0f743463c5d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:14.163037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa36f7e-e0e9-48ab-91de-fe3f72ee5077 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:14.163153 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754f86-097d-44ed-8cc3-20084754a171 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:14.201664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7afa33-b6e2-4b62-b014-4c778fe4d2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:14.202493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7afa33-b6e2-4b62-b014-4c778fe4d2ee None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:14.202871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7afa33-b6e2-4b62-b014-4c778fe4d2ee None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:14.203214 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7afa33-b6e2-4b62-b014-4c778fe4d2ee None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:14.204027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7afa33-b6e2-4b62-b014-4c778fe4d2ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:14.204400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7afa33-b6e2-4b62-b014-4c778fe4d2ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:14.205905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7afa33-b6e2-4b62-b014-4c778fe4d2ee None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:14.219688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 330/674] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:14.221104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7afa33-b6e2-4b62-b014-4c778fe4d2ee None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:14.273628 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754f86-097d-44ed-8cc3-20084754a171 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:14.291062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:14.309838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e7bd0-6996-4226-8e63-db2d577dae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:14.310660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e7bd0-6996-4226-8e63-db2d577dae9e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:14.310969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e7bd0-6996-4226-8e63-db2d577dae9e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:14.311244 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e7bd0-6996-4226-8e63-db2d577dae9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:14.331576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e7bd0-6996-4226-8e63-db2d577dae9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:14.333805 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e7bd0-6996-4226-8e63-db2d577dae9e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:14.347358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7afa33-b6e2-4b62-b014-4c778fe4d2ee None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-ca0e7bd0-6996-4226-8e63-db2d577dae9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:14.355315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:14.356223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:14.357147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:14.357147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:14.357147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:14.357147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:14.357147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:14.357147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:14.357147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:14.357147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:14.357147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 345/675] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:14.358102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0900ca4-0673-4bca-8121-951296e3cc25 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:14.358198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0900ca4-0673-4bca-8121-951296e3cc25 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:14.358413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0900ca4-0673-4bca-8121-951296e3cc25 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:14.360178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 346/676] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:14.360453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0900ca4-0673-4bca-8121-951296e3cc25 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:14.388243 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:14.395043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ab56-6f64-4c87-bbe8-d095a6e282ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:14.395865 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ab56-6f64-4c87-bbe8-d095a6e282ef None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:14.396151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ab56-6f64-4c87-bbe8-d095a6e282ef None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:14.396431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ab56-6f64-4c87-bbe8-d095a6e282ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:14.407501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9ab56-6f64-4c87-bbe8-d095a6e282ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:14.408971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9ab56-6f64-4c87-bbe8-d095a6e282ef None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-46c9ab56-6f64-4c87-bbe8-d095a6e282ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:14.426896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:14.427926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:14.428831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:14.428831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:14.428831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:14.428831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:14.428831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 331/677] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:14.429665 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ab56-6f64-4c87-bbe8-d095a6e282ef None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:14.487962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0900ca4-0673-4bca-8121-951296e3cc25 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:14.526125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5133c55-976e-453f-8054-60fdf0c02651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:14.526965 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5133c55-976e-453f-8054-60fdf0c02651 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:14.527250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5133c55-976e-453f-8054-60fdf0c02651 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:14.527722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5133c55-976e-453f-8054-60fdf0c02651 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:14.534459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5133c55-976e-453f-8054-60fdf0c02651 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:14.535953 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5133c55-976e-453f-8054-60fdf0c02651 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:14.536933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ab56-6f64-4c87-bbe8-d095a6e282ef None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:14.550577 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-b5133c55-976e-453f-8054-60fdf0c02651 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:14.551915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:14.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:14.553824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:14.553824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:14.553824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:14.553824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:14.553824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:14.553824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:14.553824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:14.553824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:14.553824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 347/678] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:14.555374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7c49f-8df9-423d-bd82-8209fb7cc270 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:14.555374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7c49f-8df9-423d-bd82-8209fb7cc270 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:14.555374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7c49f-8df9-423d-bd82-8209fb7cc270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:14.572527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-bda7c49f-8df9-423d-bd82-8209fb7cc270 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:14.573721 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-bda7c49f-8df9-423d-bd82-8209fb7cc270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:14.578682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d268ace-a24d-499e-82a4-cdb3a55ef08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:14.579368 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d268ace-a24d-499e-82a4-cdb3a55ef08c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:14.579649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d268ace-a24d-499e-82a4-cdb3a55ef08c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:14.579916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d268ace-a24d-499e-82a4-cdb3a55ef08c None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:14.580697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d268ace-a24d-499e-82a4-cdb3a55ef08c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:14.581003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d268ace-a24d-499e-82a4-cdb3a55ef08c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:14.582433 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d268ace-a24d-499e-82a4-cdb3a55ef08c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:14.595624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 332/679] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:14.597045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d268ace-a24d-499e-82a4-cdb3a55ef08c None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:14.644992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 348/680] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:36:14.645781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7c49f-8df9-423d-bd82-8209fb7cc270 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:14.670720 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:14.711929 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d268ace-a24d-499e-82a4-cdb3a55ef08c None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:14.748636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d7da8-e047-4cb5-b26f-0b965448749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:14.749312 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d7da8-e047-4cb5-b26f-0b965448749a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:14.749599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d7da8-e047-4cb5-b26f-0b965448749a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:14.750111 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d7da8-e047-4cb5-b26f-0b965448749a None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:14.750608 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d7da8-e047-4cb5-b26f-0b965448749a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:14.750951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d7da8-e047-4cb5-b26f-0b965448749a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:14.752358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d7da8-e047-4cb5-b26f-0b965448749a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:14.770113 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 333/681] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:14.770113 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d7da8-e047-4cb5-b26f-0b965448749a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:14.782262 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7c49f-8df9-423d-bd82-8209fb7cc270 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:14.803791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:14.817429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0efa96-1f57-4a19-8350-9080025dd59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:14.818090 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0efa96-1f57-4a19-8350-9080025dd59b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:14.818368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0efa96-1f57-4a19-8350-9080025dd59b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:14.819125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0efa96-1f57-4a19-8350-9080025dd59b None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:14.819673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0efa96-1f57-4a19-8350-9080025dd59b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:14.819981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0efa96-1f57-4a19-8350-9080025dd59b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:14.821410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0efa96-1f57-4a19-8350-9080025dd59b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:14.833655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 349/682] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:14.839212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0efa96-1f57-4a19-8350-9080025dd59b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:14.887268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d7da8-e047-4cb5-b26f-0b965448749a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:14.913938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:14.931885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f256c-a710-406a-8c87-bf473a4c8897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:14.933041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f256c-a710-406a-8c87-bf473a4c8897 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:14.933301 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f256c-a710-406a-8c87-bf473a4c8897 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:14.933724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f256c-a710-406a-8c87-bf473a4c8897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:14.934688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f256c-a710-406a-8c87-bf473a4c8897 None admin] RBAC: Adding query filter params (role.id=b9998a2301454764ae06a0f743463c5d, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=b3aa7416101948aba0b45129174cd988) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:14.935265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f256c-a710-406a-8c87-bf473a4c8897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:14.937406 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f256c-a710-406a-8c87-bf473a4c8897 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:14.953748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 334/683] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:14 2022] GET /identity/v3/role_assignments?user.id=b3aa7416101948aba0b45129174cd988&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b9998a2301454764ae06a0f743463c5d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:14.953748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f256c-a710-406a-8c87-bf473a4c8897 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:14.954054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0efa96-1f57-4a19-8350-9080025dd59b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:14.993918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f359d-e596-41e2-99d9-b75bb7805ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:14.994743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f359d-e596-41e2-99d9-b75bb7805ed1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:14.995055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f359d-e596-41e2-99d9-b75bb7805ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:14.995328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f359d-e596-41e2-99d9-b75bb7805ed1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:15.013303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f359d-e596-41e2-99d9-b75bb7805ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-d64f359d-e596-41e2-99d9-b75bb7805ed1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:15.025071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:15.026119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:15.027007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:15.027007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:15.027007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:15.027007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:15.027007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:15.027007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:15.027007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:15.027007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:15.027007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:15.027007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:15.027007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:36:15.027007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:15.028517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 350/684] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:36:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:15.031043 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f359d-e596-41e2-99d9-b75bb7805ed1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:15.081957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:15.089676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f256c-a710-406a-8c87-bf473a4c8897 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:15.132085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2b754-c974-44f1-9bfe-6bf93ef65431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:15.132302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2b754-c974-44f1-9bfe-6bf93ef65431 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:15.132658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2b754-c974-44f1-9bfe-6bf93ef65431 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:15.132821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2b754-c974-44f1-9bfe-6bf93ef65431 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:15.147284 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2b754-c974-44f1-9bfe-6bf93ef65431 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:15.149357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2b754-c974-44f1-9bfe-6bf93ef65431 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-d3a2b754-c974-44f1-9bfe-6bf93ef65431 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:15.168103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:15.169062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:15.169992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:15.169992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:15.169992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:15.169992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:15.169992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:15.169992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:15.169992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:15.169992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:15.169992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 03:36:15.169992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:15.169992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 335/685] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:36:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:15.169992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2b754-c974-44f1-9bfe-6bf93ef65431 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:15.182608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f359d-e596-41e2-99d9-b75bb7805ed1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:15.213528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:15.220745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c009d0a-bc30-474c-ae7f-4f9c2750bcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:15.221417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c009d0a-bc30-474c-ae7f-4f9c2750bcd9 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:15.221706 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c009d0a-bc30-474c-ae7f-4f9c2750bcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:15.221982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c009d0a-bc30-474c-ae7f-4f9c2750bcd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:15.223277 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c009d0a-bc30-474c-ae7f-4f9c2750bcd9 None admin] RBAC: Adding query filter params (role.id=b9998a2301454764ae06a0f743463c5d, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=450fda3236cc4d1ba3189b6b66f65686) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:15.223746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c009d0a-bc30-474c-ae7f-4f9c2750bcd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:15.225226 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c009d0a-bc30-474c-ae7f-4f9c2750bcd9 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:15.232107 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 351/686] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:15 2022] GET /identity/v3/role_assignments?user.id=450fda3236cc4d1ba3189b6b66f65686&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b9998a2301454764ae06a0f743463c5d => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:15.232774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c009d0a-bc30-474c-ae7f-4f9c2750bcd9 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:15.320381 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2b754-c974-44f1-9bfe-6bf93ef65431 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:15.344668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c009d0a-bc30-474c-ae7f-4f9c2750bcd9 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:15.357135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e46a24-e6d5-4172-beb4-877c00b8c3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:15.357793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e46a24-e6d5-4172-beb4-877c00b8c3b5 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:15.358077 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e46a24-e6d5-4172-beb4-877c00b8c3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:15.358349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e46a24-e6d5-4172-beb4-877c00b8c3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:15.359151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e46a24-e6d5-4172-beb4-877c00b8c3b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:15.359479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e46a24-e6d5-4172-beb4-877c00b8c3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:15.360904 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e46a24-e6d5-4172-beb4-877c00b8c3b5 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:15.370812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 336/687] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:36:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:15.376360 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e46a24-e6d5-4172-beb4-877c00b8c3b5 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:15.386414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e470f6-45c5-4713-8c36-5add7574f07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:15.387435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e470f6-45c5-4713-8c36-5add7574f07f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:15.387893 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e470f6-45c5-4713-8c36-5add7574f07f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:15.388387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e470f6-45c5-4713-8c36-5add7574f07f None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:15.389483 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e470f6-45c5-4713-8c36-5add7574f07f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:15.390076 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e470f6-45c5-4713-8c36-5add7574f07f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:15.391771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e470f6-45c5-4713-8c36-5add7574f07f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:15.411232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:15.424406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 352/688] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 30 03:36:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:15.430876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e470f6-45c5-4713-8c36-5add7574f07f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:15.505604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:15.578053 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e470f6-45c5-4713-8c36-5add7574f07f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:15.578419 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e46a24-e6d5-4172-beb4-877c00b8c3b5 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:15.617724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6de94-09e2-489b-b628-9b4a99fa4a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:15.619015 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6de94-09e2-489b-b628-9b4a99fa4a67 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:15.619499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6de94-09e2-489b-b628-9b4a99fa4a67 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:15.619968 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6de94-09e2-489b-b628-9b4a99fa4a67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:15.624891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af8bc5-d6f0-45f6-98e4-26f94d3a8d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:15.627289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af8bc5-d6f0-45f6-98e4-26f94d3a8d58 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:15.627785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af8bc5-d6f0-45f6-98e4-26f94d3a8d58 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:15.628278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af8bc5-d6f0-45f6-98e4-26f94d3a8d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:15.643471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af8bc5-d6f0-45f6-98e4-26f94d3a8d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:15.645841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af8bc5-d6f0-45f6-98e4-26f94d3a8d58 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-26af8bc5-d6f0-45f6-98e4-26f94d3a8d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:15.672956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:15.673905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:15.674905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:15.674905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:15.674905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:15.674905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:15.676260 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 337/689] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:15.682108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af8bc5-d6f0-45f6-98e4-26f94d3a8d58 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:15.709247 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6de94-09e2-489b-b628-9b4a99fa4a67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:15.711204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6de94-09e2-489b-b628-9b4a99fa4a67 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:15.768964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:15.785287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:15.822878 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 353/690] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:36:15.825091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6de94-09e2-489b-b628-9b4a99fa4a67 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:15.829275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af8bc5-d6f0-45f6-98e4-26f94d3a8d58 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:15.881720 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081c0fb-949d-4c44-95d4-ec9b331b8f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:15.882992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081c0fb-949d-4c44-95d4-ec9b331b8f4b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:15.883429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081c0fb-949d-4c44-95d4-ec9b331b8f4b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:15.883892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081c0fb-949d-4c44-95d4-ec9b331b8f4b None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:15.885050 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081c0fb-949d-4c44-95d4-ec9b331b8f4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:15.885907 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081c0fb-949d-4c44-95d4-ec9b331b8f4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:15.887509 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081c0fb-949d-4c44-95d4-ec9b331b8f4b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:15.906674 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 338/691] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:15.920002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081c0fb-949d-4c44-95d4-ec9b331b8f4b None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:15.970734 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6de94-09e2-489b-b628-9b4a99fa4a67 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:16.013146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092fd3-2fcd-40e3-8853-f92f3ba6d77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:16.015020 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092fd3-2fcd-40e3-8853-f92f3ba6d77a None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:16.020899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092fd3-2fcd-40e3-8853-f92f3ba6d77a None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:16.021369 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092fd3-2fcd-40e3-8853-f92f3ba6d77a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:16.041551 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8092fd3-2fcd-40e3-8853-f92f3ba6d77a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:16.044892 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8092fd3-2fcd-40e3-8853-f92f3ba6d77a None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-a8092fd3-2fcd-40e3-8853-f92f3ba6d77a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:16.086639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:16.087813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:16.088998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:16.088998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:16.088998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:16.088998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:16.091795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 354/692] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:16.099120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092fd3-2fcd-40e3-8853-f92f3ba6d77a None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:16.109890 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:16.159955 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081c0fb-949d-4c44-95d4-ec9b331b8f4b None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:16.215914 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092fd3-2fcd-40e3-8853-f92f3ba6d77a None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:16.228787 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:16.248153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212374b-5d59-4fc9-843b-3b70389e6519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:16.249622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212374b-5d59-4fc9-843b-3b70389e6519 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:16.250157 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212374b-5d59-4fc9-843b-3b70389e6519 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:16.254191 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212374b-5d59-4fc9-843b-3b70389e6519 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:16.260181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142c64d-a649-42c0-ae49-c088fc9eb79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:16.265262 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142c64d-a649-42c0-ae49-c088fc9eb79f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:16.265750 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142c64d-a649-42c0-ae49-c088fc9eb79f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:16.266194 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142c64d-a649-42c0-ae49-c088fc9eb79f None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:16.267133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142c64d-a649-42c0-ae49-c088fc9eb79f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:16.267680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142c64d-a649-42c0-ae49-c088fc9eb79f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:16.269224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142c64d-a649-42c0-ae49-c088fc9eb79f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:16.270452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212374b-5d59-4fc9-843b-3b70389e6519 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:16.273542 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212374b-5d59-4fc9-843b-3b70389e6519 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-2212374b-5d59-4fc9-843b-3b70389e6519 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:16.298328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:16.299383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:16.300332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:16.300332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:16.300332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:16.300332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:16.300332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:16.300332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:16.300332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:16.300332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:16.300332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:36:16.300332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:16.303667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 355/693] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:16.305407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 339/694] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 03:36:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:16.310819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142c64d-a649-42c0-ae49-c088fc9eb79f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:16.318436 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212374b-5d59-4fc9-843b-3b70389e6519 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:16.414400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:16.469347 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212374b-5d59-4fc9-843b-3b70389e6519 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:16.487105 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142c64d-a649-42c0-ae49-c088fc9eb79f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:16.511712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccc3f4-8e9c-4ba0-b238-afb4ead2ff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:16.512392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccc3f4-8e9c-4ba0-b238-afb4ead2ff77 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:16.512668 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccc3f4-8e9c-4ba0-b238-afb4ead2ff77 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:16.512935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccc3f4-8e9c-4ba0-b238-afb4ead2ff77 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:16.513770 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccc3f4-8e9c-4ba0-b238-afb4ead2ff77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:16.514074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccc3f4-8e9c-4ba0-b238-afb4ead2ff77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:16.515529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccc3f4-8e9c-4ba0-b238-afb4ead2ff77 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:16.527123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50da82-c727-49f0-bfd4-74dff2d9f6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:16.528217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50da82-c727-49f0-bfd4-74dff2d9f6ab None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:16.528719 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50da82-c727-49f0-bfd4-74dff2d9f6ab None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:16.529192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50da82-c727-49f0-bfd4-74dff2d9f6ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:16.533315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 340/695] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 03:36:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:16.534626 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca3470-86b9-4ca0-81c1-5b7be7d9daa8 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:16.537220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50da82-c727-49f0-bfd4-74dff2d9f6ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:16.539130 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50da82-c727-49f0-bfd4-74dff2d9f6ab None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:16.539311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca3470-86b9-4ca0-81c1-5b7be7d9daa8 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:16.539605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca3470-86b9-4ca0-81c1-5b7be7d9daa8 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:16.541196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 341/696] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:16.541925 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca3470-86b9-4ca0-81c1-5b7be7d9daa8 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-0f50da82-c727-49f0-bfd4-74dff2d9f6ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:16.557665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:16.558638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:16.559604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:16.559604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:16.559604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:16.559604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:16.559604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:16.559604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:16.559604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:16.559604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:16.562301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 356/697] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:16.563748 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121be8f-9bff-4545-83e6-653833018980 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:16.564246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121be8f-9bff-4545-83e6-653833018980 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:16.564767 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121be8f-9bff-4545-83e6-653833018980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:16.583792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6121be8f-9bff-4545-83e6-653833018980 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:16.586175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6121be8f-9bff-4545-83e6-653833018980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:16.593297 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:16.645327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca3470-86b9-4ca0-81c1-5b7be7d9daa8 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:16.665375 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 357/698] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:36:16.666662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121be8f-9bff-4545-83e6-653833018980 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:16.682474 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016061b0-0dc9-4ea2-a69f-a211c8fe9cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:16.683186 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016061b0-0dc9-4ea2-a69f-a211c8fe9cfb None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:16.683466 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016061b0-0dc9-4ea2-a69f-a211c8fe9cfb None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:16.683739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016061b0-0dc9-4ea2-a69f-a211c8fe9cfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:16.734680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:16.757803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016061b0-0dc9-4ea2-a69f-a211c8fe9cfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:16.759109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016061b0-0dc9-4ea2-a69f-a211c8fe9cfb None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:16.785770 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121be8f-9bff-4545-83e6-653833018980 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:16.809969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:16.826679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea3ccd-6d90-4077-aef6-0ac62e1e401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:16.827770 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea3ccd-6d90-4077-aef6-0ac62e1e401f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:16.828335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea3ccd-6d90-4077-aef6-0ac62e1e401f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:16.828810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea3ccd-6d90-4077-aef6-0ac62e1e401f None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:16.829889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea3ccd-6d90-4077-aef6-0ac62e1e401f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:16.830428 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea3ccd-6d90-4077-aef6-0ac62e1e401f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:16.832359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea3ccd-6d90-4077-aef6-0ac62e1e401f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:16.846303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 358/699] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:16.847480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea3ccd-6d90-4077-aef6-0ac62e1e401f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:16.872858 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 342/700] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 03:36:16.873809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016061b0-0dc9-4ea2-a69f-a211c8fe9cfb None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:16.961007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea3ccd-6d90-4077-aef6-0ac62e1e401f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:16.979784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016061b0-0dc9-4ea2-a69f-a211c8fe9cfb None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:16.980448 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:17.000056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5d47e-088b-4b7b-9821-f2c161476420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:17.001307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5d47e-088b-4b7b-9821-f2c161476420 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:17.001788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5d47e-088b-4b7b-9821-f2c161476420 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:17.002257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5d47e-088b-4b7b-9821-f2c161476420 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:17.003242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5d47e-088b-4b7b-9821-f2c161476420 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:17.004857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5d47e-088b-4b7b-9821-f2c161476420 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:17.017329 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91a92d-69f3-4df6-8da7-fb55896bc8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:17.017916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91a92d-69f3-4df6-8da7-fb55896bc8b7 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:17.018195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91a92d-69f3-4df6-8da7-fb55896bc8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:17.018465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91a92d-69f3-4df6-8da7-fb55896bc8b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:17.019337 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91a92d-69f3-4df6-8da7-fb55896bc8b7 None admin] RBAC: Adding query filter params (role.id=b9998a2301454764ae06a0f743463c5d, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=9de5d5c703b84e508e3112f90070e002) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:17.019645 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91a92d-69f3-4df6-8da7-fb55896bc8b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:17.021083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91a92d-69f3-4df6-8da7-fb55896bc8b7 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-7ba5d47e-088b-4b7b-9821-f2c161476420 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:17.023980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:17.024957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 03:36:17.025795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:17.028112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 343/701] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:16 2022] GET /identity/v3/role_assignments?user.id=9de5d5c703b84e508e3112f90070e002&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b9998a2301454764ae06a0f743463c5d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:17.029009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91a92d-69f3-4df6-8da7-fb55896bc8b7 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:17.029219 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 359/702] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Jun 30 03:36:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:17.034875 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5d47e-088b-4b7b-9821-f2c161476420 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:17.046128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:17.142469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91a92d-69f3-4df6-8da7-fb55896bc8b7 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:17.158123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5d47e-088b-4b7b-9821-f2c161476420 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:17.181238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5f469-796d-4d59-ac85-172cc4470b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:17.182247 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5f469-796d-4d59-ac85-172cc4470b4d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:17.182617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5f469-796d-4d59-ac85-172cc4470b4d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:17.183011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5f469-796d-4d59-ac85-172cc4470b4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:17.195788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5f469-796d-4d59-ac85-172cc4470b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:17.197418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5f469-796d-4d59-ac85-172cc4470b4d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:17.200900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2b189-9e82-42b0-adea-c9770ec90071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:17.201752 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2b189-9e82-42b0-adea-c9770ec90071 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:17.202178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2b189-9e82-42b0-adea-c9770ec90071 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:17.202618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2b189-9e82-42b0-adea-c9770ec90071 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:17.203511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2b189-9e82-42b0-adea-c9770ec90071 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:17.203968 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2b189-9e82-42b0-adea-c9770ec90071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:17.205661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2b189-9e82-42b0-adea-c9770ec90071 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:17.212546 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 360/703] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 30 03:36:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-48f5f469-796d-4d59-ac85-172cc4470b4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:17.218869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:17.219794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:17.220682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:17.220682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:17.220682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:17.220682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:17.220682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 344/704] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:17.222298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2b189-9e82-42b0-adea-c9770ec90071 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:17.225277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5f469-796d-4d59-ac85-172cc4470b4d None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:17.304279 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:17.311443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:17.354487 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5f469-796d-4d59-ac85-172cc4470b4d None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:17.395749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2b189-9e82-42b0-adea-c9770ec90071 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:17.402657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc6f91-dff1-4de4-a5dd-7673808cfb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:17.403672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc6f91-dff1-4de4-a5dd-7673808cfb1c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:17.404159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc6f91-dff1-4de4-a5dd-7673808cfb1c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:17.404629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc6f91-dff1-4de4-a5dd-7673808cfb1c None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:17.406042 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc6f91-dff1-4de4-a5dd-7673808cfb1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:17.406554 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc6f91-dff1-4de4-a5dd-7673808cfb1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:17.408545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc6f91-dff1-4de4-a5dd-7673808cfb1c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:17.424675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 345/705] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:17.430513 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc6f91-dff1-4de4-a5dd-7673808cfb1c None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:17.444234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c15255-a468-4b81-b3a8-24bfa1412aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:17.444938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c15255-a468-4b81-b3a8-24bfa1412aba None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:17.445564 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c15255-a468-4b81-b3a8-24bfa1412aba None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:17.445842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c15255-a468-4b81-b3a8-24bfa1412aba None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:17.446565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c15255-a468-4b81-b3a8-24bfa1412aba None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:17.446918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c15255-a468-4b81-b3a8-24bfa1412aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:17.448898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c15255-a468-4b81-b3a8-24bfa1412aba None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:17.456448 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 361/706] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 30 03:36:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:17.468572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b9be-3731-4db2-9921-85d27ce506d8 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:17.469188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b9be-3731-4db2-9921-85d27ce506d8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:17.469471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b9be-3731-4db2-9921-85d27ce506d8 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:17.471421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 362/707] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:17.477285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1894d42-a1be-4984-9dc7-042428336c38 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:17.477593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1894d42-a1be-4984-9dc7-042428336c38 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:17.477851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1894d42-a1be-4984-9dc7-042428336c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:17.497155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e1894d42-a1be-4984-9dc7-042428336c38 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:17.498378 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e1894d42-a1be-4984-9dc7-042428336c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:17.574125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc6f91-dff1-4de4-a5dd-7673808cfb1c None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:17.587145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 363/708] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:36:17.611820 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1894d42-a1be-4984-9dc7-042428336c38 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:17.618282 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:17.632470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbcff2-cefc-4853-bdd4-7f6d80cc9247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:17.633645 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbcff2-cefc-4853-bdd4-7f6d80cc9247 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:17.634202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbcff2-cefc-4853-bdd4-7f6d80cc9247 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:17.634684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbcff2-cefc-4853-bdd4-7f6d80cc9247 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:17.643859 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbcff2-cefc-4853-bdd4-7f6d80cc9247 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:17.645308 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbcff2-cefc-4853-bdd4-7f6d80cc9247 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-80fbcff2-cefc-4853-bdd4-7f6d80cc9247 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:17.666217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:17.667195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:17.668083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:17.668083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:17.668083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:17.668083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:17.668083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:17.668083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:17.668083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:17.668083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:17.669812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:17.673815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 346/709] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:17.680232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbcff2-cefc-4853-bdd4-7f6d80cc9247 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:17.747664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1894d42-a1be-4984-9dc7-042428336c38 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:17.793882 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8e962-7e77-4888-9fc0-4a8679a2767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:17.794545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbcff2-cefc-4853-bdd4-7f6d80cc9247 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:17.794723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8e962-7e77-4888-9fc0-4a8679a2767f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:17.795003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8e962-7e77-4888-9fc0-4a8679a2767f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:17.795256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8e962-7e77-4888-9fc0-4a8679a2767f None admin] PATH_INFO: `/v3/services/network` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:17.795915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8e962-7e77-4888-9fc0-4a8679a2767f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:17.797573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8e962-7e77-4888-9fc0-4a8679a2767f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-f1e8e962-7e77-4888-9fc0-4a8679a2767f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:17.816722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:17.817766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:17.818667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 364/710] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:17 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:17.827759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b0306-0051-4cba-8708-eab67abc1e9f None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:17.827759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b0306-0051-4cba-8708-eab67abc1e9f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:17.827759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b0306-0051-4cba-8708-eab67abc1e9f None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:17.827759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 365/711] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:17.828424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b0306-0051-4cba-8708-eab67abc1e9f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:17.841955 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e56b-3678-47cb-b5d6-c1d5081e3938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:17.843869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e56b-3678-47cb-b5d6-c1d5081e3938 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:17.844346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e56b-3678-47cb-b5d6-c1d5081e3938 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:17.844860 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e56b-3678-47cb-b5d6-c1d5081e3938 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:17.848725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624e56b-3678-47cb-b5d6-c1d5081e3938 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:17.849271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624e56b-3678-47cb-b5d6-c1d5081e3938 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:17.851346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624e56b-3678-47cb-b5d6-c1d5081e3938 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:17.867868 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 347/712] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:17.873135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ee00d-2c51-4ead-a8c0-3701bd70a91c None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:17.873135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ee00d-2c51-4ead-a8c0-3701bd70a91c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:17.873135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ee00d-2c51-4ead-a8c0-3701bd70a91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:17.898473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-699ee00d-2c51-4ead-a8c0-3701bd70a91c None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:17.900148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-699ee00d-2c51-4ead-a8c0-3701bd70a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:17.946000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:17.958412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b0306-0051-4cba-8708-eab67abc1e9f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:17.960341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:17.985223 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 348/713] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:36:17.986443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ee00d-2c51-4ead-a8c0-3701bd70a91c None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:18.004131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9f888-c6ec-47a2-8b47-65dc83c037c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:18.004818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9f888-c6ec-47a2-8b47-65dc83c037c4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:18.005101 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9f888-c6ec-47a2-8b47-65dc83c037c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:18.005376 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9f888-c6ec-47a2-8b47-65dc83c037c4 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:18.006131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9f888-c6ec-47a2-8b47-65dc83c037c4 None admin] RBAC: Adding query filter params (name=network) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:18.006433 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9f888-c6ec-47a2-8b47-65dc83c037c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:18.007883 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9f888-c6ec-47a2-8b47-65dc83c037c4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:18.012853 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 366/714] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 03:36:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:18.019143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9f888-c6ec-47a2-8b47-65dc83c037c4 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:18.104379 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ee00d-2c51-4ead-a8c0-3701bd70a91c None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:18.140735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82254c83-08ba-4ef3-a12b-a5c4e74975ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:18.141507 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82254c83-08ba-4ef3-a12b-a5c4e74975ca None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:18.141855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82254c83-08ba-4ef3-a12b-a5c4e74975ca None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:18.142201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82254c83-08ba-4ef3-a12b-a5c4e74975ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:18.143128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82254c83-08ba-4ef3-a12b-a5c4e74975ca None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=758b152c320e4a94921bb96541cbea98) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:18.143654 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82254c83-08ba-4ef3-a12b-a5c4e74975ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:18.145036 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82254c83-08ba-4ef3-a12b-a5c4e74975ca None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:18.150840 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9f888-c6ec-47a2-8b47-65dc83c037c4 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:18.159635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 349/715] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:17 2022] GET /identity/v3/role_assignments?user.id=758b152c320e4a94921bb96541cbea98&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:18.160305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82254c83-08ba-4ef3-a12b-a5c4e74975ca None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:18.193306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e95844-1913-4000-aab4-bf1ca76e8aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:18.194572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e95844-1913-4000-aab4-bf1ca76e8aaa None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:18.195089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e95844-1913-4000-aab4-bf1ca76e8aaa None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:18.195502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e95844-1913-4000-aab4-bf1ca76e8aaa None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:18.196991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e95844-1913-4000-aab4-bf1ca76e8aaa None admin] RBAC: Adding query filter params (type=network) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:18.197473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e95844-1913-4000-aab4-bf1ca76e8aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:18.199235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e95844-1913-4000-aab4-bf1ca76e8aaa None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:18.205973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 367/716] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 03:36:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:18.258102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:18.351289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82254c83-08ba-4ef3-a12b-a5c4e74975ca None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:18.400451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff035e6-b330-4d0d-a529-b64dab23af70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:18.401525 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff035e6-b330-4d0d-a529-b64dab23af70 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:18.401955 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff035e6-b330-4d0d-a529-b64dab23af70 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:18.402461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff035e6-b330-4d0d-a529-b64dab23af70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:18.415057 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff035e6-b330-4d0d-a529-b64dab23af70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:18.416805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff035e6-b330-4d0d-a529-b64dab23af70 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-1ff035e6-b330-4d0d-a529-b64dab23af70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:18.437184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:18.438358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:18.439503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:18.439503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:18.439503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:18.439503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:18.441432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 350/717] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:18.447893 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e95844-1913-4000-aab4-bf1ca76e8aaa None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:18.482004 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:18.558340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e95844-1913-4000-aab4-bf1ca76e8aaa None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:18.595228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9e793-0446-4d7f-954d-876171a13ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:18.596151 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9e793-0446-4d7f-954d-876171a13ee5 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:18.596605 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9e793-0446-4d7f-954d-876171a13ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:18.597024 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9e793-0446-4d7f-954d-876171a13ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:18.598323 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9e793-0446-4d7f-954d-876171a13ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:18.598843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9e793-0446-4d7f-954d-876171a13ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:18.600523 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9e793-0446-4d7f-954d-876171a13ee5 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:18.613291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 368/718] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:18.619466 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff035e6-b330-4d0d-a529-b64dab23af70 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:18.722201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:18.734606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff035e6-b330-4d0d-a529-b64dab23af70 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:18.770885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3fd62-df94-47a5-b8e2-679c41aa1930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:18.772208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3fd62-df94-47a5-b8e2-679c41aa1930 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:18.772688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3fd62-df94-47a5-b8e2-679c41aa1930 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:18.773121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3fd62-df94-47a5-b8e2-679c41aa1930 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:18.774005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3fd62-df94-47a5-b8e2-679c41aa1930 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:18.775638 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3fd62-df94-47a5-b8e2-679c41aa1930 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:18.810557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 351/719] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:36:18 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:36:19.678842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9357a1-cf2b-4dcd-aa95-465ca31a9ad9 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:19.679899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9357a1-cf2b-4dcd-aa95-465ca31a9ad9 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:19.680401 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9357a1-cf2b-4dcd-aa95-465ca31a9ad9 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:19.682268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 369/720] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:19.687338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7145b9-480f-432a-87ab-b481145e0bb8 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:19.688132 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7145b9-480f-432a-87ab-b481145e0bb8 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:19.688649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7145b9-480f-432a-87ab-b481145e0bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:19.711837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-9c7145b9-480f-432a-87ab-b481145e0bb8 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:19.713391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9c7145b9-480f-432a-87ab-b481145e0bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:19.720919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59d6e8-04c9-4ea4-9b76-1b138c2e5714 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:19.721210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59d6e8-04c9-4ea4-9b76-1b138c2e5714 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:19.721493 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59d6e8-04c9-4ea4-9b76-1b138c2e5714 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:19.723519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 370/721] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:19.728072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e8dd4-e422-4067-bf4e-93db3596cd6a None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:19.728368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e8dd4-e422-4067-bf4e-93db3596cd6a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:19.728637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e8dd4-e422-4067-bf4e-93db3596cd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:19.749786 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-ff2e8dd4-e422-4067-bf4e-93db3596cd6a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:19.750815 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ff2e8dd4-e422-4067-bf4e-93db3596cd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:19.838192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 352/722] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:36:19.850540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 371/723] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:36:19.865054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7145b9-480f-432a-87ab-b481145e0bb8 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:19.880013 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e8dd4-e422-4067-bf4e-93db3596cd6a None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:19.903706 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:19.986169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e8dd4-e422-4067-bf4e-93db3596cd6a None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:20.022203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f37723-bc60-4546-86fc-5194ca4c3b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:20.022955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f37723-bc60-4546-86fc-5194ca4c3b2f None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:20.023236 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f37723-bc60-4546-86fc-5194ca4c3b2f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:20.023530 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f37723-bc60-4546-86fc-5194ca4c3b2f None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:20.024358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f37723-bc60-4546-86fc-5194ca4c3b2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:20.025750 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f37723-bc60-4546-86fc-5194ca4c3b2f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:20.037097 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:20.048251 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 372/724] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 03:36:19 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:36:20.080882 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7145b9-480f-432a-87ab-b481145e0bb8 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:20.157288 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843257e-f808-46ea-8969-999047a1ffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:20.158133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843257e-f808-46ea-8969-999047a1ffe9 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:20.158408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843257e-f808-46ea-8969-999047a1ffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:20.158681 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843257e-f808-46ea-8969-999047a1ffe9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:20.182350 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843257e-f808-46ea-8969-999047a1ffe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-e843257e-f808-46ea-8969-999047a1ffe9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:20.190241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:20.191400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:20.192293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:20.192293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:20.192293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:20.192293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:20.192293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:20.192293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:20.192293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:20.192293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:20.192293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:20.192293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:20.192293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:36:20.192293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:20.192293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 353/725] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:36:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:20.198100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f37723-bc60-4546-86fc-5194ca4c3b2f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:20.295726 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:20.315577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f37723-bc60-4546-86fc-5194ca4c3b2f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:20.350144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62f0d-7462-4f15-b796-5b966dbe2cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:20.350842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62f0d-7462-4f15-b796-5b966dbe2cbe None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:20.351128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62f0d-7462-4f15-b796-5b966dbe2cbe None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:20.351399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62f0d-7462-4f15-b796-5b966dbe2cbe None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:20.352206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62f0d-7462-4f15-b796-5b966dbe2cbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:20.352518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62f0d-7462-4f15-b796-5b966dbe2cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:20.353943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62f0d-7462-4f15-b796-5b966dbe2cbe None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:20.362644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 373/726] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:36:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:20.368578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843257e-f808-46ea-8969-999047a1ffe9 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:20.500730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843257e-f808-46ea-8969-999047a1ffe9 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:20.534140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:20.543483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b651b47-da25-4676-ab12-305bd8c20278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:20.544307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b651b47-da25-4676-ab12-305bd8c20278 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:20.544589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b651b47-da25-4676-ab12-305bd8c20278 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:20.544862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b651b47-da25-4676-ab12-305bd8c20278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:20.561014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b651b47-da25-4676-ab12-305bd8c20278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:20.562430 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b651b47-da25-4676-ab12-305bd8c20278 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-8b651b47-da25-4676-ab12-305bd8c20278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:20.590054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:20.591120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:20.592027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:20.592027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:20.592027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:20.592027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:20.592027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 354/727] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:20.597143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62f0d-7462-4f15-b796-5b966dbe2cbe None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:20.601256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b0931-d7f4-4327-8d96-1b0540bee2e4 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:20.601576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b0931-d7f4-4327-8d96-1b0540bee2e4 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:20.601797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b0931-d7f4-4327-8d96-1b0540bee2e4 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:20.603488 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 355/728] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:20.608996 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7ec6f-efd5-47e2-8095-6f279bd20364 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:20.609306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7ec6f-efd5-47e2-8095-6f279bd20364 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:20.609553 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7ec6f-efd5-47e2-8095-6f279bd20364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:20.627973 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-48a7ec6f-efd5-47e2-8095-6f279bd20364 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:20.629259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-48a7ec6f-efd5-47e2-8095-6f279bd20364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:20.755633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 356/729] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 03:36:20.758050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62f0d-7462-4f15-b796-5b966dbe2cbe None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:20.791869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7ec6f-efd5-47e2-8095-6f279bd20364 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:20.793618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3edbf5-707f-4eb5-872a-cb816b87ae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:20.794614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3edbf5-707f-4eb5-872a-cb816b87ae4b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:20.795111 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3edbf5-707f-4eb5-872a-cb816b87ae4b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:20.795573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3edbf5-707f-4eb5-872a-cb816b87ae4b None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:20.796489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3edbf5-707f-4eb5-872a-cb816b87ae4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:20.796999 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3edbf5-707f-4eb5-872a-cb816b87ae4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:20.798670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3edbf5-707f-4eb5-872a-cb816b87ae4b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:20.812265 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 374/730] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:20.819704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3edbf5-707f-4eb5-872a-cb816b87ae4b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:20.831122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:20.915000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7ec6f-efd5-47e2-8095-6f279bd20364 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:20.929889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:20.956765 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92f996-db6c-4806-a7c2-f8aaa2ea00fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:20.957586 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92f996-db6c-4806-a7c2-f8aaa2ea00fa None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:20.957867 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92f996-db6c-4806-a7c2-f8aaa2ea00fa None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:20.958139 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92f996-db6c-4806-a7c2-f8aaa2ea00fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:20.979011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92f996-db6c-4806-a7c2-f8aaa2ea00fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-3c92f996-db6c-4806-a7c2-f8aaa2ea00fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:20.987008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:20.987936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:20.989317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:20.989317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:20.989317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:20.989317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:20.989317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:20.989317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:20.989317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:20.989317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:20.989317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:20.989317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:20.989317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:36:20.989317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:20.989317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 357/731] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:36:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:20.996165 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92f996-db6c-4806-a7c2-f8aaa2ea00fa None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:21.016942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3edbf5-707f-4eb5-872a-cb816b87ae4b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:21.084904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82646e94-e5cb-4ca3-9bf8-c856902f9f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:21.086051 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82646e94-e5cb-4ca3-9bf8-c856902f9f00 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:21.086660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82646e94-e5cb-4ca3-9bf8-c856902f9f00 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:21.088158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82646e94-e5cb-4ca3-9bf8-c856902f9f00 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:21.100913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82646e94-e5cb-4ca3-9bf8-c856902f9f00 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:21.103574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82646e94-e5cb-4ca3-9bf8-c856902f9f00 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-82646e94-e5cb-4ca3-9bf8-c856902f9f00 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:21.126392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:21.127419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:21.128370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:21.128370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:21.128370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:21.128370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:21.128370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:21.128370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:21.128370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:21.128370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:21.128370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 03:36:21.128370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:21.131124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 375/732] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:36:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:21.132714 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e45897-1b1d-409b-84d0-8ec086fde3b4 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:21.133236 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e45897-1b1d-409b-84d0-8ec086fde3b4 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:21.133695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e45897-1b1d-409b-84d0-8ec086fde3b4 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:21.135487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 376/733] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:21.137541 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e45897-1b1d-409b-84d0-8ec086fde3b4 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:21.157712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92f996-db6c-4806-a7c2-f8aaa2ea00fa None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:21.197016 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7fc03-c800-4fc3-bcc0-4676a9c9b318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:21.197690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7fc03-c800-4fc3-bcc0-4676a9c9b318 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:21.198001 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7fc03-c800-4fc3-bcc0-4676a9c9b318 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:21.198693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7fc03-c800-4fc3-bcc0-4676a9c9b318 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:21.199495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7fc03-c800-4fc3-bcc0-4676a9c9b318 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:21.199799 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7fc03-c800-4fc3-bcc0-4676a9c9b318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:21.201527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7fc03-c800-4fc3-bcc0-4676a9c9b318 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:21.216268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 358/734] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:36:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:21.216268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac2110-b321-40a5-a059-8731da644989 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:21.216268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac2110-b321-40a5-a059-8731da644989 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:21.216268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac2110-b321-40a5-a059-8731da644989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:21.232374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:21.234556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-2fac2110-b321-40a5-a059-8731da644989 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:21.236310 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2fac2110-b321-40a5-a059-8731da644989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:21.273903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:21.291458 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e45897-1b1d-409b-84d0-8ec086fde3b4 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:21.326849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 359/735] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 03:36:21.328046 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac2110-b321-40a5-a059-8731da644989 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:21.353669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff21b05-3376-4611-9b25-e6cc107aca54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:21.354360 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff21b05-3376-4611-9b25-e6cc107aca54 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:21.354654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff21b05-3376-4611-9b25-e6cc107aca54 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:21.354957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff21b05-3376-4611-9b25-e6cc107aca54 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:21.355802 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff21b05-3376-4611-9b25-e6cc107aca54 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:21.356118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff21b05-3376-4611-9b25-e6cc107aca54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:21.357581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff21b05-3376-4611-9b25-e6cc107aca54 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:21.377618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 377/736] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 30 03:36:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:21.378572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff21b05-3376-4611-9b25-e6cc107aca54 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:21.460362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac2110-b321-40a5-a059-8731da644989 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:21.490334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff21b05-3376-4611-9b25-e6cc107aca54 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:21.500879 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01e0be-054c-4a70-abff-13c6906cb40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:21.502109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e0be-054c-4a70-abff-13c6906cb40c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:21.502614 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e0be-054c-4a70-abff-13c6906cb40c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:21.503108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e0be-054c-4a70-abff-13c6906cb40c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:21.514688 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:21.516614 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01e0be-054c-4a70-abff-13c6906cb40c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:21.518306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01e0be-054c-4a70-abff-13c6906cb40c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:21.531420 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a75f5-4533-4842-92ae-c218ad14d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:21.532143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a75f5-4533-4842-92ae-c218ad14d819 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:21.532432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a75f5-4533-4842-92ae-c218ad14d819 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:21.532707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a75f5-4533-4842-92ae-c218ad14d819 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:21.533440 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a75f5-4533-4842-92ae-c218ad14d819 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:21.534858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a75f5-4533-4842-92ae-c218ad14d819 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-2a01e0be-054c-4a70-abff-13c6906cb40c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:21.539043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:21.539989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:21.540861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:21.540861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:21.540861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:21.540861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:21.543427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 360/737] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:21.544478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01e0be-054c-4a70-abff-13c6906cb40c None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:21.566794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 378/738] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 03:36:21 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:36:21.566794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a75f5-4533-4842-92ae-c218ad14d819 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:21.585647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:21.716076 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01e0be-054c-4a70-abff-13c6906cb40c None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:21.733773 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a75f5-4533-4842-92ae-c218ad14d819 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:21.763978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322b557-1014-4b5d-b0be-f50ccb2bb86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:21.764795 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322b557-1014-4b5d-b0be-f50ccb2bb86f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:21.764964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322b557-1014-4b5d-b0be-f50ccb2bb86f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:21.765198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322b557-1014-4b5d-b0be-f50ccb2bb86f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:21.783443 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74297d67-4b43-44d6-a0d9-c3761f55b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:21.784123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74297d67-4b43-44d6-a0d9-c3761f55b960 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:21.784399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74297d67-4b43-44d6-a0d9-c3761f55b960 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:21.784685 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74297d67-4b43-44d6-a0d9-c3761f55b960 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:21.785402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74297d67-4b43-44d6-a0d9-c3761f55b960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:21.785707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74297d67-4b43-44d6-a0d9-c3761f55b960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:21.787492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74297d67-4b43-44d6-a0d9-c3761f55b960 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:21.799845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 379/739] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:21.801147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f282d-2930-4870-85c3-6d527e5e4106 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:21.801859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f282d-2930-4870-85c3-6d527e5e4106 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:21.801859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f282d-2930-4870-85c3-6d527e5e4106 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:21.811059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 380/740] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:21.812131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f282d-2930-4870-85c3-6d527e5e4106 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:21.860922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322b557-1014-4b5d-b0be-f50ccb2bb86f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:21.862507 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322b557-1014-4b5d-b0be-f50ccb2bb86f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:21.863038 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:21.881953 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:21.938028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f282d-2930-4870-85c3-6d527e5e4106 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:21.967910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 361/741] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:36:21.969527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdad5a1-781a-49e0-a9be-4fbcc69f4b5d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:21.970030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdad5a1-781a-49e0-a9be-4fbcc69f4b5d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:21.970493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdad5a1-781a-49e0-a9be-4fbcc69f4b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:21.975735 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ef478-b780-4d8c-8fdd-78491b619d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:21.976537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ef478-b780-4d8c-8fdd-78491b619d46 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:21.976820 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ef478-b780-4d8c-8fdd-78491b619d46 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:21.977151 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ef478-b780-4d8c-8fdd-78491b619d46 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:21.985530 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ef478-b780-4d8c-8fdd-78491b619d46 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:21.987048 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ef478-b780-4d8c-8fdd-78491b619d46 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:21.989524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6bdad5a1-781a-49e0-a9be-4fbcc69f4b5d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:21.991151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6bdad5a1-781a-49e0-a9be-4fbcc69f4b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-039ef478-b780-4d8c-8fdd-78491b619d46 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:22.002614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:22.003606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:22.004532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:22.004532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:22.004532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:22.004532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:22.004532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:22.004532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:22.004532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:22.004532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:22.004532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:36:22.004532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:22.009453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 381/742] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 03:36:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:22.010380 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ef478-b780-4d8c-8fdd-78491b619d46 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:22.064551 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 362/743] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:22.065768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdad5a1-781a-49e0-a9be-4fbcc69f4b5d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:22.115543 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:22.116244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:22.123878 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ef478-b780-4d8c-8fdd-78491b619d46 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:22.171670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbabca4-af73-46f5-b3d1-20c1b967a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:22.172491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbabca4-af73-46f5-b3d1-20c1b967a988 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:22.172774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbabca4-af73-46f5-b3d1-20c1b967a988 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:22.173103 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbabca4-af73-46f5-b3d1-20c1b967a988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:22.179805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdad5a1-781a-49e0-a9be-4fbcc69f4b5d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:22.192105 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbabca4-af73-46f5-b3d1-20c1b967a988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:22.193676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbabca4-af73-46f5-b3d1-20c1b967a988 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-9cbabca4-af73-46f5-b3d1-20c1b967a988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:22.212145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:22.213065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:22.213946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:22.213946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:22.213946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:22.213946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:22.218155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 382/744] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:22.219021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbabca4-af73-46f5-b3d1-20c1b967a988 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:22.219676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248aadb9-f8fd-4877-9530-63d26c292f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:22.220584 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aadb9-f8fd-4877-9530-63d26c292f77 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:22.221054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aadb9-f8fd-4877-9530-63d26c292f77 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:22.221513 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aadb9-f8fd-4877-9530-63d26c292f77 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:22.222916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248aadb9-f8fd-4877-9530-63d26c292f77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:22.223438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248aadb9-f8fd-4877-9530-63d26c292f77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:22.225188 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248aadb9-f8fd-4877-9530-63d26c292f77 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:22.244257 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 363/745] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 03:36:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:22.245399 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248aadb9-f8fd-4877-9530-63d26c292f77 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:22.329474 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbabca4-af73-46f5-b3d1-20c1b967a988 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:22.344976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248aadb9-f8fd-4877-9530-63d26c292f77 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:22.362843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:22.366544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfd967-5638-4b96-a1a7-8dd9fdfcaaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:22.367397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfd967-5638-4b96-a1a7-8dd9fdfcaaa7 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:22.367678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfd967-5638-4b96-a1a7-8dd9fdfcaaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:22.367952 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfd967-5638-4b96-a1a7-8dd9fdfcaaa7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:22.380634 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfd967-5638-4b96-a1a7-8dd9fdfcaaa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:22.382989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200ae65-2e55-4c6d-924a-9039972029a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:22.383911 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200ae65-2e55-4c6d-924a-9039972029a5 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:22.384394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200ae65-2e55-4c6d-924a-9039972029a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:22.384853 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200ae65-2e55-4c6d-924a-9039972029a5 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:22.385770 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200ae65-2e55-4c6d-924a-9039972029a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:22.386263 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200ae65-2e55-4c6d-924a-9039972029a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:22.387878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200ae65-2e55-4c6d-924a-9039972029a5 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-58bfd967-5638-4b96-a1a7-8dd9fdfcaaa7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:22.388765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:22.389698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:22.390537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:22.390537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:22.390537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:22.390537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:22.390537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:22.390537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:22.390537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:22.390537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:22.390537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:22.390537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:22.390537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:22.390537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:22.395094 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 383/746] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:22.395973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfd967-5638-4b96-a1a7-8dd9fdfcaaa7 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:22.404465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 364/747] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:22.405564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200ae65-2e55-4c6d-924a-9039972029a5 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:22.413687 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:22.510530 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfd967-5638-4b96-a1a7-8dd9fdfcaaa7 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:22.513913 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200ae65-2e55-4c6d-924a-9039972029a5 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:22.545626 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42966bd-67a3-42c5-9f22-e82e48d4a619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:22.546432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42966bd-67a3-42c5-9f22-e82e48d4a619 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:22.546726 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42966bd-67a3-42c5-9f22-e82e48d4a619 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:22.546989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42966bd-67a3-42c5-9f22-e82e48d4a619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:22.556008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11862dc1-3ae7-489a-9315-74134fd4f83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:22.556798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11862dc1-3ae7-489a-9315-74134fd4f83c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:22.557216 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11862dc1-3ae7-489a-9315-74134fd4f83c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:22.557503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11862dc1-3ae7-489a-9315-74134fd4f83c None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:22.558263 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11862dc1-3ae7-489a-9315-74134fd4f83c None admin] RBAC: Adding query filter params (name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:22.558573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11862dc1-3ae7-489a-9315-74134fd4f83c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:22.558952 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42966bd-67a3-42c5-9f22-e82e48d4a619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:22.560002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11862dc1-3ae7-489a-9315-74134fd4f83c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:22.560383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42966bd-67a3-42c5-9f22-e82e48d4a619 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:22.569222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 365/748] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:36:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:22.571653 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11862dc1-3ae7-489a-9315-74134fd4f83c None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-d42966bd-67a3-42c5-9f22-e82e48d4a619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:22.577727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:22.578622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:22.579561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:22.579561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:22.579561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:22.579561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:22.579561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 384/749] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:22.580611 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fcd4f-88ac-416d-95ee-c0f4de6f2a6b None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:22.580964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fcd4f-88ac-416d-95ee-c0f4de6f2a6b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:22.581297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fcd4f-88ac-416d-95ee-c0f4de6f2a6b None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:22.586532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 385/750] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:22.586532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fcd4f-88ac-416d-95ee-c0f4de6f2a6b None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:22.607284 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:22.651052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:22.686170 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11862dc1-3ae7-489a-9315-74134fd4f83c None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:22.698961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fcd4f-88ac-416d-95ee-c0f4de6f2a6b None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:22.723200 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e0283-09b5-4691-82d2-ba7fd4fb5c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:22.724319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e0283-09b5-4691-82d2-ba7fd4fb5c76 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:22.724600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e0283-09b5-4691-82d2-ba7fd4fb5c76 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:22.724868 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e0283-09b5-4691-82d2-ba7fd4fb5c76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:22.732057 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e0283-09b5-4691-82d2-ba7fd4fb5c76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:22.733507 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e0283-09b5-4691-82d2-ba7fd4fb5c76 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:22.735317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc7c8b-3d48-4da1-8cc6-2f8a68738ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:22.736115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7c8b-3d48-4da1-8cc6-2f8a68738ba6 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:22.736415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7c8b-3d48-4da1-8cc6-2f8a68738ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:22.736691 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7c8b-3d48-4da1-8cc6-2f8a68738ba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-8e7e0283-09b5-4691-82d2-ba7fd4fb5c76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:22.748082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:22.749166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:22.750085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:22.750085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:22.750085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:22.750085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:22.750085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:22.750085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:22.750085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:22.750085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:22.750085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 366/751] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:22.750556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e0283-09b5-4691-82d2-ba7fd4fb5c76 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:22.752026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7c8b-3d48-4da1-8cc6-2f8a68738ba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:22.753467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7c8b-3d48-4da1-8cc6-2f8a68738ba6 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-10bc7c8b-3d48-4da1-8cc6-2f8a68738ba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:22.771715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:22.777912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:22.778856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:22.778856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:22.778856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:22.778856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:22.778856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 386/752] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:22.778856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4e9c4-7c81-4835-9f97-bd99f76a7a4c None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:22.778856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4e9c4-7c81-4835-9f97-bd99f76a7a4c None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:22.778856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4e9c4-7c81-4835-9f97-bd99f76a7a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:22.792786 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6ac4e9c4-7c81-4835-9f97-bd99f76a7a4c None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:22.794080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6ac4e9c4-7c81-4835-9f97-bd99f76a7a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:22.861167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:22.876371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e0283-09b5-4691-82d2-ba7fd4fb5c76 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:22.878913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 387/753] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:22.880549 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4e9c4-7c81-4835-9f97-bd99f76a7a4c None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:22.923482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117d84e-1e1e-4be0-b296-2d142424825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:22.924163 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117d84e-1e1e-4be0-b296-2d142424825f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:22.924447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117d84e-1e1e-4be0-b296-2d142424825f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:22.924774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117d84e-1e1e-4be0-b296-2d142424825f None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:22.925505 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117d84e-1e1e-4be0-b296-2d142424825f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:22.925860 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117d84e-1e1e-4be0-b296-2d142424825f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:22.927330 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117d84e-1e1e-4be0-b296-2d142424825f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:22.931828 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:22.939204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 367/754] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:22.940021 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117d84e-1e1e-4be0-b296-2d142424825f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:22.999336 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4e9c4-7c81-4835-9f97-bd99f76a7a4c None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:23.035398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c13b2-ba1f-4c9b-baa7-60deab6771fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:23.036272 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c13b2-ba1f-4c9b-baa7-60deab6771fd None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:23.037281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c13b2-ba1f-4c9b-baa7-60deab6771fd None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:23.037712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c13b2-ba1f-4c9b-baa7-60deab6771fd None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:23.038653 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c13b2-ba1f-4c9b-baa7-60deab6771fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:23.039146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c13b2-ba1f-4c9b-baa7-60deab6771fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:23.040605 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c13b2-ba1f-4c9b-baa7-60deab6771fd None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:23.044803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117d84e-1e1e-4be0-b296-2d142424825f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:23.058334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 388/755] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:23.059326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c13b2-ba1f-4c9b-baa7-60deab6771fd None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:23.080630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071f085-211d-4fa9-a15c-a70b94cb4a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:23.081306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071f085-211d-4fa9-a15c-a70b94cb4a15 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:23.081590 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071f085-211d-4fa9-a15c-a70b94cb4a15 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:23.081857 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071f085-211d-4fa9-a15c-a70b94cb4a15 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:23.082580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071f085-211d-4fa9-a15c-a70b94cb4a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:23.082918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071f085-211d-4fa9-a15c-a70b94cb4a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:23.084437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071f085-211d-4fa9-a15c-a70b94cb4a15 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:23.097313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 368/756] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:23.098439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071f085-211d-4fa9-a15c-a70b94cb4a15 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:23.109931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:23.173902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c13b2-ba1f-4c9b-baa7-60deab6771fd None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:23.175638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:23.210327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071f085-211d-4fa9-a15c-a70b94cb4a15 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:23.215782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be5aa8-bb50-4537-8104-18f0db1c6534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:23.216598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be5aa8-bb50-4537-8104-18f0db1c6534 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:23.216876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be5aa8-bb50-4537-8104-18f0db1c6534 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:23.217203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be5aa8-bb50-4537-8104-18f0db1c6534 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:23.218285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be5aa8-bb50-4537-8104-18f0db1c6534 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:23.219725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be5aa8-bb50-4537-8104-18f0db1c6534 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-21be5aa8-bb50-4537-8104-18f0db1c6534 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:23.233255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:23.234192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 03:36:23.235413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:23.239538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 389/757] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Jun 30 03:36:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:23.240256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be5aa8-bb50-4537-8104-18f0db1c6534 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:23.248620 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5154ab-f855-4f27-ab71-890fe8da0f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:23.249724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5154ab-f855-4f27-ab71-890fe8da0f3f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:23.249920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5154ab-f855-4f27-ab71-890fe8da0f3f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:23.250144 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5154ab-f855-4f27-ab71-890fe8da0f3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:23.257456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5154ab-f855-4f27-ab71-890fe8da0f3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:23.258785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5154ab-f855-4f27-ab71-890fe8da0f3f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-7e5154ab-f855-4f27-ab71-890fe8da0f3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:23.272606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:23.273490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:23.274357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:23.274357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:23.274357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:23.274357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:23.274357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:23.274357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:23.274357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:23.274357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:23.274357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 369/758] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:23.275714 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5154ab-f855-4f27-ab71-890fe8da0f3f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:23.343624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:23.356107 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be5aa8-bb50-4537-8104-18f0db1c6534 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:23.379472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5154ab-f855-4f27-ab71-890fe8da0f3f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:23.392941 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b173353-063f-44e6-b841-d04f76e2c1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:23.393726 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b173353-063f-44e6-b841-d04f76e2c1c9 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:23.393906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b173353-063f-44e6-b841-d04f76e2c1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:23.394157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b173353-063f-44e6-b841-d04f76e2c1c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:23.395020 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b173353-063f-44e6-b841-d04f76e2c1c9 None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=9de5d5c703b84e508e3112f90070e002) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:23.395334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b173353-063f-44e6-b841-d04f76e2c1c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:23.396848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b173353-063f-44e6-b841-d04f76e2c1c9 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:23.410827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 390/759] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:23 2022] GET /identity/v3/role_assignments?user.id=9de5d5c703b84e508e3112f90070e002&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:23.410827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b173353-063f-44e6-b841-d04f76e2c1c9 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:23.424649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e35fd-7c28-40eb-bc5c-10b7162da91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:23.425616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e35fd-7c28-40eb-bc5c-10b7162da91a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:23.425956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e35fd-7c28-40eb-bc5c-10b7162da91a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:23.426291 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e35fd-7c28-40eb-bc5c-10b7162da91a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:23.435578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e35fd-7c28-40eb-bc5c-10b7162da91a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:23.437187 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e35fd-7c28-40eb-bc5c-10b7162da91a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:23.449631 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-138e35fd-7c28-40eb-bc5c-10b7162da91a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:23.453580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:23.454593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:23.455820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:23.455820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:23.455820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:23.455820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:23.455820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:23.455820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:23.455820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:23.455820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:23.455820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 03:36:23.455820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:23.455820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 370/760] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 03:36:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:23.456410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e35fd-7c28-40eb-bc5c-10b7162da91a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:23.549109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b173353-063f-44e6-b841-d04f76e2c1c9 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:23.569726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e35fd-7c28-40eb-bc5c-10b7162da91a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:23.599535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:23.600278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac0710-91c5-49eb-836d-b6669466c1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:23.601451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac0710-91c5-49eb-836d-b6669466c1c6 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:23.601862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac0710-91c5-49eb-836d-b6669466c1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:23.602323 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac0710-91c5-49eb-836d-b6669466c1c6 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:23.603602 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac0710-91c5-49eb-836d-b6669466c1c6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:23.603954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac0710-91c5-49eb-836d-b6669466c1c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:23.606144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac0710-91c5-49eb-836d-b6669466c1c6 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:23.610933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70946b3-bcb6-4432-ae5b-cfd112bc9320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:23.611309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 391/761] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 30 03:36:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:23.611682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70946b3-bcb6-4432-ae5b-cfd112bc9320 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:23.611963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70946b3-bcb6-4432-ae5b-cfd112bc9320 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:23.612125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac0710-91c5-49eb-836d-b6669466c1c6 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:23.612234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70946b3-bcb6-4432-ae5b-cfd112bc9320 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:23.613011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70946b3-bcb6-4432-ae5b-cfd112bc9320 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:23.613417 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70946b3-bcb6-4432-ae5b-cfd112bc9320 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:23.615271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70946b3-bcb6-4432-ae5b-cfd112bc9320 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:23.631461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 371/762] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:23.632594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70946b3-bcb6-4432-ae5b-cfd112bc9320 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:23.714204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac0710-91c5-49eb-836d-b6669466c1c6 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:23.715928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:23.749926 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0a0fb-f742-4241-882f-b23aab473f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:23.750660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0a0fb-f742-4241-882f-b23aab473f19 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:23.750969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0a0fb-f742-4241-882f-b23aab473f19 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:23.751243 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0a0fb-f742-4241-882f-b23aab473f19 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:23.752391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0a0fb-f742-4241-882f-b23aab473f19 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:23.752706 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0a0fb-f742-4241-882f-b23aab473f19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:23.754464 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0a0fb-f742-4241-882f-b23aab473f19 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:23.759183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70946b3-bcb6-4432-ae5b-cfd112bc9320 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:23.774470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 392/763] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 30 03:36:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:23.775352 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0a0fb-f742-4241-882f-b23aab473f19 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:23.804965 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a601460-0152-4778-a7f5-7807892e3bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:23.805649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601460-0152-4778-a7f5-7807892e3bb1 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:23.805931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601460-0152-4778-a7f5-7807892e3bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:23.806206 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601460-0152-4778-a7f5-7807892e3bb1 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:23.806959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a601460-0152-4778-a7f5-7807892e3bb1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:23.807269 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a601460-0152-4778-a7f5-7807892e3bb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:23.808644 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a601460-0152-4778-a7f5-7807892e3bb1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:23.819848 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 372/764] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 30 03:36:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:23.819848 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a601460-0152-4778-a7f5-7807892e3bb1 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:23.878043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:23.891653 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0a0fb-f742-4241-882f-b23aab473f19 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:23.929592 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a601460-0152-4778-a7f5-7807892e3bb1 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:23.930069 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea12697-6c31-4fa0-b84f-f51492f1ad64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:23.931094 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea12697-6c31-4fa0-b84f-f51492f1ad64 None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:23.931368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea12697-6c31-4fa0-b84f-f51492f1ad64 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:23.931637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea12697-6c31-4fa0-b84f-f51492f1ad64 None admin] PATH_INFO: `/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/758b152c320e4a94921bb96541cbea98/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:23.933619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea12697-6c31-4fa0-b84f-f51492f1ad64 None admin] RBAC: Authorizing `identity:create_grant(project_id=96e59c2ab83c477385e5a81b32a7c897, user_id=758b152c320e4a94921bb96541cbea98, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:23.935071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea12697-6c31-4fa0-b84f-f51492f1ad64 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:23.950284 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 393/765] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:36:23 2022] PUT /identity/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/758b152c320e4a94921bb96541cbea98/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:36:23.952590 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441b3da-d595-47c5-8704-8abbddb95573 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:23.953100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441b3da-d595-47c5-8704-8abbddb95573 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:23.953555 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441b3da-d595-47c5-8704-8abbddb95573 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:23.956176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 394/766] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:23.957225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441b3da-d595-47c5-8704-8abbddb95573 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:23.973021 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc364f-93b5-46bc-aff0-2ae4701e94d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:23.973810 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc364f-93b5-46bc-aff0-2ae4701e94d9 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:23.974385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc364f-93b5-46bc-aff0-2ae4701e94d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:23.974827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc364f-93b5-46bc-aff0-2ae4701e94d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:23.978751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:24.062928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc364f-93b5-46bc-aff0-2ae4701e94d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:24.064613 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc364f-93b5-46bc-aff0-2ae4701e94d9 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:24.120047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441b3da-d595-47c5-8704-8abbddb95573 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:24.127392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:24.164601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b58f84-8109-4434-a736-69b0ca80c444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:24.165559 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b58f84-8109-4434-a736-69b0ca80c444 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:24.165809 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b58f84-8109-4434-a736-69b0ca80c444 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:24.166071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b58f84-8109-4434-a736-69b0ca80c444 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:24.166933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b58f84-8109-4434-a736-69b0ca80c444 None admin] RBAC: Adding query filter params (interface=public, service_id=7b37ec5440534e1098bdcaae71dc12b5, region_id=RegionOne) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:24.167243 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b58f84-8109-4434-a736-69b0ca80c444 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:24.168633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b58f84-8109-4434-a736-69b0ca80c444 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:24.177174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 395/767] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 03:36:23 2022] GET /identity/v3/endpoints?service_id=7b37ec5440534e1098bdcaae71dc12b5&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:24.180201 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab2c9e-2f66-4640-ba7f-e0eb100a2ae4 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:24.180491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab2c9e-2f66-4640-ba7f-e0eb100a2ae4 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:24.180923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab2c9e-2f66-4640-ba7f-e0eb100a2ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:24.188091 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 373/768] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:36:24.188908 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc364f-93b5-46bc-aff0-2ae4701e94d9 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:24.204208 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-fdab2c9e-2f66-4640-ba7f-e0eb100a2ae4 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:24.206420 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-fdab2c9e-2f66-4640-ba7f-e0eb100a2ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:24.293151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc364f-93b5-46bc-aff0-2ae4701e94d9 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:24.299754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 396/769] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:24.300799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab2c9e-2f66-4640-ba7f-e0eb100a2ae4 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:24.309999 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:24.351828 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811f9d5-12b1-4a6c-8eea-6daf04dcb032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:24.352723 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811f9d5-12b1-4a6c-8eea-6daf04dcb032 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:24.352946 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811f9d5-12b1-4a6c-8eea-6daf04dcb032 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:24.353292 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811f9d5-12b1-4a6c-8eea-6daf04dcb032 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:24.354182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811f9d5-12b1-4a6c-8eea-6daf04dcb032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:24.355771 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811f9d5-12b1-4a6c-8eea-6daf04dcb032 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:24.361784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 374/770] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 03:36:24 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:24.370791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811f9d5-12b1-4a6c-8eea-6daf04dcb032 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:24.406837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:24.453187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab2c9e-2f66-4640-ba7f-e0eb100a2ae4 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:24.516904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028b5b1-9202-4a9e-a8a5-b3d8ed1fa7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:24.517739 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028b5b1-9202-4a9e-a8a5-b3d8ed1fa7ec None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:24.518018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028b5b1-9202-4a9e-a8a5-b3d8ed1fa7ec None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:24.518293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028b5b1-9202-4a9e-a8a5-b3d8ed1fa7ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:24.541563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028b5b1-9202-4a9e-a8a5-b3d8ed1fa7ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:24.543550 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028b5b1-9202-4a9e-a8a5-b3d8ed1fa7ec None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-5028b5b1-9202-4a9e-a8a5-b3d8ed1fa7ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:24.564330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:24.565288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:24.566303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:24.566303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:24.566303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:24.566303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:24.570623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 397/771] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:24.571696 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028b5b1-9202-4a9e-a8a5-b3d8ed1fa7ec None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:24.577858 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811f9d5-12b1-4a6c-8eea-6daf04dcb032 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:24.616464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c064-a356-4d9a-a91b-4c2b9e50a296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:24.617295 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c064-a356-4d9a-a91b-4c2b9e50a296 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:24.617578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c064-a356-4d9a-a91b-4c2b9e50a296 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:24.617849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c064-a356-4d9a-a91b-4c2b9e50a296 None admin] PATH_INFO: `/v3/services/network` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:24.618661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454c064-a356-4d9a-a91b-4c2b9e50a296 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:24.620108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454c064-a356-4d9a-a91b-4c2b9e50a296 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-c454c064-a356-4d9a-a91b-4c2b9e50a296 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:24.635550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:24.636625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:24.637470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 375/772] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:24 2022] GET /identity/v3/services/network => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:24.638265 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:24.649862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c064-a356-4d9a-a91b-4c2b9e50a296 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:24.697268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028b5b1-9202-4a9e-a8a5-b3d8ed1fa7ec None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:24.737568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89f9b3-1200-4f82-95d9-7c7e2d536cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:24.738133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89f9b3-1200-4f82-95d9-7c7e2d536cb7 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:24.738451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89f9b3-1200-4f82-95d9-7c7e2d536cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:24.738726 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89f9b3-1200-4f82-95d9-7c7e2d536cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:24.739514 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89f9b3-1200-4f82-95d9-7c7e2d536cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:24.739865 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89f9b3-1200-4f82-95d9-7c7e2d536cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:24.741239 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89f9b3-1200-4f82-95d9-7c7e2d536cb7 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:24.753620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 398/773] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:24.759063 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89f9b3-1200-4f82-95d9-7c7e2d536cb7 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:24.857010 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:24.863585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89f9b3-1200-4f82-95d9-7c7e2d536cb7 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:24.882399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:24.900396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58f91d-ceae-4ba0-b3a0-1d775913714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:24.901204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f91d-ceae-4ba0-b3a0-1d775913714b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:24.901486 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f91d-ceae-4ba0-b3a0-1d775913714b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:24.901756 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f91d-ceae-4ba0-b3a0-1d775913714b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:24.908867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58f91d-ceae-4ba0-b3a0-1d775913714b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:24.910318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58f91d-ceae-4ba0-b3a0-1d775913714b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:24.920672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c064-a356-4d9a-a91b-4c2b9e50a296 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-ce58f91d-ceae-4ba0-b3a0-1d775913714b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:24.924797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:24.925713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:24.926610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:24.926610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:24.926610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:24.926610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:24.926610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:24.926610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:24.926610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:24.926610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:24.926610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 399/774] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:24.936016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58f91d-ceae-4ba0-b3a0-1d775913714b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:24.954994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cb72c-cf26-46d4-9006-0eb91223060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:24.955669 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cb72c-cf26-46d4-9006-0eb91223060c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:24.955951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cb72c-cf26-46d4-9006-0eb91223060c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:24.956230 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cb72c-cf26-46d4-9006-0eb91223060c None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:24.956950 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cb72c-cf26-46d4-9006-0eb91223060c None admin] RBAC: Adding query filter params (name=network) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:24.957248 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cb72c-cf26-46d4-9006-0eb91223060c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:24.958715 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cb72c-cf26-46d4-9006-0eb91223060c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:24.963654 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 376/775] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 03:36:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:24.969038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cb72c-cf26-46d4-9006-0eb91223060c None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:25.071104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cb72c-cf26-46d4-9006-0eb91223060c None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:25.106123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c4b67-9866-4052-9caa-d41272822681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:25.106827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c4b67-9866-4052-9caa-d41272822681 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:25.107110 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c4b67-9866-4052-9caa-d41272822681 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:25.107383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c4b67-9866-4052-9caa-d41272822681 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:25.108094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c4b67-9866-4052-9caa-d41272822681 None admin] RBAC: Adding query filter params (type=network) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:25.108396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c4b67-9866-4052-9caa-d41272822681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:25.109788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c4b67-9866-4052-9caa-d41272822681 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:25.121026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 377/776] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 03:36:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:25.122964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58f91d-ceae-4ba0-b3a0-1d775913714b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:25.135928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c4b67-9866-4052-9caa-d41272822681 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:25.156719 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:25.165883 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e2262-b5bd-45b4-b5a3-87c684ad974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:25.166712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e2262-b5bd-45b4-b5a3-87c684ad974f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:25.167121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e2262-b5bd-45b4-b5a3-87c684ad974f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:25.167493 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e2262-b5bd-45b4-b5a3-87c684ad974f None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:25.168998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e2262-b5bd-45b4-b5a3-87c684ad974f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:25.169414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e2262-b5bd-45b4-b5a3-87c684ad974f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:25.171026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e2262-b5bd-45b4-b5a3-87c684ad974f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:25.185010 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 400/777] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:25.190821 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e2262-b5bd-45b4-b5a3-87c684ad974f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:25.243835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:25.331444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c4b67-9866-4052-9caa-d41272822681 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:25.333523 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e2262-b5bd-45b4-b5a3-87c684ad974f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:25.374540 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b00e5-d8e7-4951-92b1-b295cbe48643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:25.375258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b00e5-d8e7-4951-92b1-b295cbe48643 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:25.375541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b00e5-d8e7-4951-92b1-b295cbe48643 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:25.375816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b00e5-d8e7-4951-92b1-b295cbe48643 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:25.376617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b00e5-d8e7-4951-92b1-b295cbe48643 None admin] RBAC: Adding query filter params (interface=public, service_id=3f364b0b096c4c2c848d5d448b1c0d51, region_id=RegionOne) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:25.376932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b00e5-d8e7-4951-92b1-b295cbe48643 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:25.378332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b00e5-d8e7-4951-92b1-b295cbe48643 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:25.388009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 378/778] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 03:36:25 2022] GET /identity/v3/endpoints?service_id=3f364b0b096c4c2c848d5d448b1c0d51&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:25.393637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b00e5-d8e7-4951-92b1-b295cbe48643 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:25.398553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100bc8b-a932-4549-bfce-79b29b05ac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:25.399303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100bc8b-a932-4549-bfce-79b29b05ac04 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:25.399585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100bc8b-a932-4549-bfce-79b29b05ac04 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:25.399855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100bc8b-a932-4549-bfce-79b29b05ac04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:25.400692 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100bc8b-a932-4549-bfce-79b29b05ac04 None admin] RBAC: Adding query filter params (role.id=b9998a2301454764ae06a0f743463c5d, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=f75f5e28008b4189b5feb6438bdf1852) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:25.401000 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100bc8b-a932-4549-bfce-79b29b05ac04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:25.402425 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100bc8b-a932-4549-bfce-79b29b05ac04 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:25.415358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 401/779] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:25 2022] GET /identity/v3/role_assignments?user.id=f75f5e28008b4189b5feb6438bdf1852&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b9998a2301454764ae06a0f743463c5d => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:25.472228 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:25.505732 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b00e5-d8e7-4951-92b1-b295cbe48643 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:25.542261 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74684b00-911f-4f74-aa89-5fb3e485b3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:25.542969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74684b00-911f-4f74-aa89-5fb3e485b3d3 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:25.543562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74684b00-911f-4f74-aa89-5fb3e485b3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:25.543832 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74684b00-911f-4f74-aa89-5fb3e485b3d3 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:25.544535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74684b00-911f-4f74-aa89-5fb3e485b3d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:25.545919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74684b00-911f-4f74-aa89-5fb3e485b3d3 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:25.552278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 379/780] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 03:36:25 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:25.778276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929a43-9f36-46e5-81fe-f3272f0324f6 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:25.778679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929a43-9f36-46e5-81fe-f3272f0324f6 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:25.778877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929a43-9f36-46e5-81fe-f3272f0324f6 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:25.780451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 402/781] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:25.786058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815523b-d757-4e63-911a-ba3cf45c8a90 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:25.786379 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815523b-d757-4e63-911a-ba3cf45c8a90 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:25.786662 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815523b-d757-4e63-911a-ba3cf45c8a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:25.808639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-0815523b-d757-4e63-911a-ba3cf45c8a90 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:25.809878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-0815523b-d757-4e63-911a-ba3cf45c8a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:25.912598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 380/782] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:25.952551 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929a43-9f36-46e5-81fe-f3272f0324f6 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:26.091343 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929a43-9f36-46e5-81fe-f3272f0324f6 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:26.093187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:26.132615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd29549-1ccf-494d-a3b1-68ca61e5fd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:26.133779 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd29549-1ccf-494d-a3b1-68ca61e5fd7d None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:26.134301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd29549-1ccf-494d-a3b1-68ca61e5fd7d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:26.134782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd29549-1ccf-494d-a3b1-68ca61e5fd7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:26.155681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd29549-1ccf-494d-a3b1-68ca61e5fd7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-9dd29549-1ccf-494d-a3b1-68ca61e5fd7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:26.163960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:26.164911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:26.165745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:26.165745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:26.165745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:26.165745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:26.165745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:26.165745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:26.165745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:26.165745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:26.165745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:26.165745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:26.165745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:36:26.165745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:26.168141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 403/783] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:36:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:26.174385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815523b-d757-4e63-911a-ba3cf45c8a90 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:26.277791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:26.324294 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815523b-d757-4e63-911a-ba3cf45c8a90 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:26.370287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d8cd2-5af2-48ed-95dd-7454e952b56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:26.370919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d8cd2-5af2-48ed-95dd-7454e952b56f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:26.371197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d8cd2-5af2-48ed-95dd-7454e952b56f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:26.371465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d8cd2-5af2-48ed-95dd-7454e952b56f None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:26.372216 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d8cd2-5af2-48ed-95dd-7454e952b56f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:26.372518 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d8cd2-5af2-48ed-95dd-7454e952b56f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:26.373896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d8cd2-5af2-48ed-95dd-7454e952b56f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:26.383393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 381/784] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:36:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:26.388741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd29549-1ccf-494d-a3b1-68ca61e5fd7d None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:26.449060 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e110-9b90-4884-91b2-04c01b379ff7 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:26.449344 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e110-9b90-4884-91b2-04c01b379ff7 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:26.449622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e110-9b90-4884-91b2-04c01b379ff7 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:26.451344 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 382/785] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:36:26.458477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b600ed4-8d23-4323-8a4b-806816bb6dda None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:26.458756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b600ed4-8d23-4323-8a4b-806816bb6dda None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:26.459069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b600ed4-8d23-4323-8a4b-806816bb6dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:26.494789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-1b600ed4-8d23-4323-8a4b-806816bb6dda None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:26.494789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-1b600ed4-8d23-4323-8a4b-806816bb6dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:26.546619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd29549-1ccf-494d-a3b1-68ca61e5fd7d None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:26.582914 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0cdb6-9424-4858-b53c-4f5161303c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:26.583961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0cdb6-9424-4858-b53c-4f5161303c37 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:26.584245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0cdb6-9424-4858-b53c-4f5161303c37 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:26.584522 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0cdb6-9424-4858-b53c-4f5161303c37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:26.595923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0cdb6-9424-4858-b53c-4f5161303c37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:26.597879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0cdb6-9424-4858-b53c-4f5161303c37 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-07d0cdb6-9424-4858-b53c-4f5161303c37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:26.616221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:26.617324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:26.618386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:26.618386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:26.618386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:26.618386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:26.618386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 404/786] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:26.623450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0cdb6-9424-4858-b53c-4f5161303c37 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:26.640267 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:26.655496 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 383/787] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:36:26.723057 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b600ed4-8d23-4323-8a4b-806816bb6dda None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:26.741630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0cdb6-9424-4858-b53c-4f5161303c37 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:26.777337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8161a9-b71b-4fb8-b661-ea88d93b7526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:26.778013 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8161a9-b71b-4fb8-b661-ea88d93b7526 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:26.778299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8161a9-b71b-4fb8-b661-ea88d93b7526 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:26.778578 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8161a9-b71b-4fb8-b661-ea88d93b7526 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:26.779453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8161a9-b71b-4fb8-b661-ea88d93b7526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:26.779767 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8161a9-b71b-4fb8-b661-ea88d93b7526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:26.781332 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8161a9-b71b-4fb8-b661-ea88d93b7526 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:26.794130 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 405/788] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:26.799780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8161a9-b71b-4fb8-b661-ea88d93b7526 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:26.874182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:26.903138 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:26.919129 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8161a9-b71b-4fb8-b661-ea88d93b7526 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:26.954901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b600ed4-8d23-4323-8a4b-806816bb6dda None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:26.958016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01714830-59e5-4896-ac75-b3789b48c503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:26.959459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01714830-59e5-4896-ac75-b3789b48c503 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:26.959956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01714830-59e5-4896-ac75-b3789b48c503 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:26.960424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01714830-59e5-4896-ac75-b3789b48c503 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:26.968849 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01714830-59e5-4896-ac75-b3789b48c503 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:26.970753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01714830-59e5-4896-ac75-b3789b48c503 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-01714830-59e5-4896-ac75-b3789b48c503 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:26.986730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:26.987694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:26.988636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:26.988636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:26.988636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:26.988636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:26.988636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:26.988636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:26.988636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:26.988636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:26.988636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 03:36:26.988636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:26.991543 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 406/789] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:36:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:26.997271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01714830-59e5-4896-ac75-b3789b48c503 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:26.999533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617086a-6060-4bd4-95ea-0d687feaae49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:27.000404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617086a-6060-4bd4-95ea-0d687feaae49 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:27.000854 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617086a-6060-4bd4-95ea-0d687feaae49 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:27.001267 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617086a-6060-4bd4-95ea-0d687feaae49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:27.021136 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617086a-6060-4bd4-95ea-0d687feaae49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-1617086a-6060-4bd4-95ea-0d687feaae49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:27.029357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:27.030459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:27.031595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:27.031595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:27.031595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:27.031595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:27.031595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:27.031595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:27.031595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:27.031595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:27.031595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:27.031595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:27.031595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:36:27.031595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:27.033906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 384/790] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:36:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:27.035301 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b43696-2466-4241-979d-9dc18aea9877 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:27.035722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b43696-2466-4241-979d-9dc18aea9877 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:27.036193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b43696-2466-4241-979d-9dc18aea9877 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:27.037953 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 385/791] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:27.049737 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa674038-f140-435b-b132-a47bc0886313 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:27.049737 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa674038-f140-435b-b132-a47bc0886313 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:27.049737 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa674038-f140-435b-b132-a47bc0886313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:27.070347 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-fa674038-f140-435b-b132-a47bc0886313 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:27.072153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-fa674038-f140-435b-b132-a47bc0886313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:27.116009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01714830-59e5-4896-ac75-b3789b48c503 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:27.157823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2036428-0d54-411b-8959-fe459d0d2618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:27.158491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2036428-0d54-411b-8959-fe459d0d2618 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:27.159688 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2036428-0d54-411b-8959-fe459d0d2618 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:27.159688 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2036428-0d54-411b-8959-fe459d0d2618 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:27.159857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2036428-0d54-411b-8959-fe459d0d2618 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:27.164183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2036428-0d54-411b-8959-fe459d0d2618 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:27.164183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2036428-0d54-411b-8959-fe459d0d2618 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:27.164183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:27.164574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 386/792] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:27.166517 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa674038-f140-435b-b132-a47bc0886313 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:27.188505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 407/793] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 30 03:36:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:27.191762 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2036428-0d54-411b-8959-fe459d0d2618 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:27.239315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:27.290419 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa674038-f140-435b-b132-a47bc0886313 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:27.313814 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2036428-0d54-411b-8959-fe459d0d2618 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:27.329897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631af960-af3f-4484-8a29-495158fbd230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:27.331619 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631af960-af3f-4484-8a29-495158fbd230 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:27.332110 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631af960-af3f-4484-8a29-495158fbd230 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:27.332842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631af960-af3f-4484-8a29-495158fbd230 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:27.335050 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631af960-af3f-4484-8a29-495158fbd230 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:27.335621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631af960-af3f-4484-8a29-495158fbd230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:27.337246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631af960-af3f-4484-8a29-495158fbd230 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:27.355069 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bfe01-3a8d-4ea9-af20-66653d878426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:27.355069 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bfe01-3a8d-4ea9-af20-66653d878426 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:27.355339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bfe01-3a8d-4ea9-af20-66653d878426 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:27.355538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bfe01-3a8d-4ea9-af20-66653d878426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:27.356011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 387/794] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:36:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:27.357109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631af960-af3f-4484-8a29-495158fbd230 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:27.367864 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bfe01-3a8d-4ea9-af20-66653d878426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:27.369321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bfe01-3a8d-4ea9-af20-66653d878426 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-cf6bfe01-3a8d-4ea9-af20-66653d878426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:27.392744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:27.393707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:27.395249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:27.395249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:27.395249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:27.395249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:27.395249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 408/795] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:27.395249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bfe01-3a8d-4ea9-af20-66653d878426 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:27.452894 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:27.490955 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631af960-af3f-4484-8a29-495158fbd230 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:27.501670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:27.521049 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bfe01-3a8d-4ea9-af20-66653d878426 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:27.526957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd10934-1c31-4970-b97a-55ffca33f263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:27.527793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd10934-1c31-4970-b97a-55ffca33f263 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:27.528065 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd10934-1c31-4970-b97a-55ffca33f263 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:27.528341 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd10934-1c31-4970-b97a-55ffca33f263 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:27.529005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd10934-1c31-4970-b97a-55ffca33f263 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:27.530668 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd10934-1c31-4970-b97a-55ffca33f263 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-8fd10934-1c31-4970-b97a-55ffca33f263 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:27.543750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:27.544743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 03:36:27.545606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:27.549943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 388/796] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Jun 30 03:36:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:27.550875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd10934-1c31-4970-b97a-55ffca33f263 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:27.565209 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77263a-1b3e-4971-817c-350657d0153f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:27.566485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77263a-1b3e-4971-817c-350657d0153f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:27.566990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77263a-1b3e-4971-817c-350657d0153f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:27.567534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77263a-1b3e-4971-817c-350657d0153f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:27.579207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77263a-1b3e-4971-817c-350657d0153f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:27.581126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77263a-1b3e-4971-817c-350657d0153f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-7b77263a-1b3e-4971-817c-350657d0153f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:27.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:27.602467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:27.603416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:27.603416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:27.603416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:27.603416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:27.610164 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 409/797] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:27.611279 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77263a-1b3e-4971-817c-350657d0153f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:27.656352 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd10934-1c31-4970-b97a-55ffca33f263 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:27.691790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb7e27-715c-44d7-ab60-15048c791a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:27.692515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb7e27-715c-44d7-ab60-15048c791a3e None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:27.692790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb7e27-715c-44d7-ab60-15048c791a3e None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:27.693059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb7e27-715c-44d7-ab60-15048c791a3e None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:27.694118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb7e27-715c-44d7-ab60-15048c791a3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:27.694228 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb7e27-715c-44d7-ab60-15048c791a3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:27.695594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb7e27-715c-44d7-ab60-15048c791a3e None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:27.708705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 389/798] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:27.709488 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb7e27-715c-44d7-ab60-15048c791a3e None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:27.716069 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:27.724058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77263a-1b3e-4971-817c-350657d0153f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:27.746709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:27.766050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7caa67-ee83-4ff2-8f62-ce5c65fac348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:27.767092 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7caa67-ee83-4ff2-8f62-ce5c65fac348 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:27.767619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7caa67-ee83-4ff2-8f62-ce5c65fac348 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:27.768087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7caa67-ee83-4ff2-8f62-ce5c65fac348 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:27.769020 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7caa67-ee83-4ff2-8f62-ce5c65fac348 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:27.769552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7caa67-ee83-4ff2-8f62-ce5c65fac348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:27.771548 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7caa67-ee83-4ff2-8f62-ce5c65fac348 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:27.777322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 410/799] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 30 03:36:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:27.778341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7caa67-ee83-4ff2-8f62-ce5c65fac348 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:27.824161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb7e27-715c-44d7-ab60-15048c791a3e None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:27.860579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc1bb5-bfb9-4808-9737-9b7cfa83454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:27.861256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc1bb5-bfb9-4808-9737-9b7cfa83454c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:27.861537 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc1bb5-bfb9-4808-9737-9b7cfa83454c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:27.861809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc1bb5-bfb9-4808-9737-9b7cfa83454c None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:27.862538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc1bb5-bfb9-4808-9737-9b7cfa83454c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:27.862878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc1bb5-bfb9-4808-9737-9b7cfa83454c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:27.864318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc1bb5-bfb9-4808-9737-9b7cfa83454c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:27.878859 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 390/800] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:27.879786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc1bb5-bfb9-4808-9737-9b7cfa83454c None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:27.893707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7caa67-ee83-4ff2-8f62-ce5c65fac348 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:27.932371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87532ab-13e4-466f-9e95-f37871441d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:27.933314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87532ab-13e4-466f-9e95-f37871441d01 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:27.933572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87532ab-13e4-466f-9e95-f37871441d01 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:27.933862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87532ab-13e4-466f-9e95-f37871441d01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:27.941266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87532ab-13e4-466f-9e95-f37871441d01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:27.943260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87532ab-13e4-466f-9e95-f37871441d01 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-c87532ab-13e4-466f-9e95-f37871441d01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:27.957843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:27.959400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:27.960305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:27.960305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:27.960305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:27.960305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:27.960305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:27.960305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:27.960305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:27.960305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:27.960305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 411/801] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:27.960781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557a9d-2051-47a7-b97c-d88238ce9406 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:27.960781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557a9d-2051-47a7-b97c-d88238ce9406 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:27.961401 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557a9d-2051-47a7-b97c-d88238ce9406 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:27.966294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 412/802] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:27.966294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2557a9d-2051-47a7-b97c-d88238ce9406 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:27.988359 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:27.992068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:27.996939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc1bb5-bfb9-4808-9737-9b7cfa83454c None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:28.033475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f82f37-14b2-457a-829c-fc26faa6a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:28.034147 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f82f37-14b2-457a-829c-fc26faa6a476 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:28.034420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f82f37-14b2-457a-829c-fc26faa6a476 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:28.034691 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f82f37-14b2-457a-829c-fc26faa6a476 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:28.035434 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f82f37-14b2-457a-829c-fc26faa6a476 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:28.035745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f82f37-14b2-457a-829c-fc26faa6a476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:28.037193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f82f37-14b2-457a-829c-fc26faa6a476 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:28.042145 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 391/803] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 30 03:36:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:28.042945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f82f37-14b2-457a-829c-fc26faa6a476 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:28.082972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2557a9d-2051-47a7-b97c-d88238ce9406 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:28.117845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ec7f0-7049-497d-aa2c-475d0ac11bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:28.119045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ec7f0-7049-497d-aa2c-475d0ac11bfd None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:28.119325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ec7f0-7049-497d-aa2c-475d0ac11bfd None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:28.119596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ec7f0-7049-497d-aa2c-475d0ac11bfd None admin] PATH_INFO: `/v3/users/nova` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:28.127109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ec7f0-7049-497d-aa2c-475d0ac11bfd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:28.128560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ec7f0-7049-497d-aa2c-475d0ac11bfd None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:28.142281 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f82f37-14b2-457a-829c-fc26faa6a476 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-db8ec7f0-7049-497d-aa2c-475d0ac11bfd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:28.142746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:28.143731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:28.144662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:28.144662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:28.144662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:28.144662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:28.144662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:28.144662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:28.144662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:28.144662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:28.144662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:36:28.144662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:28.144662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 413/804] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 03:36:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:28.145280 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5798d3-02bb-46de-af49-73956ea463fa None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:28.145358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5798d3-02bb-46de-af49-73956ea463fa None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:28.147395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5798d3-02bb-46de-af49-73956ea463fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:28.164271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-4f5798d3-02bb-46de-af49-73956ea463fa None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:28.165483 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4f5798d3-02bb-46de-af49-73956ea463fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:28.184661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaf80e-c51e-4a97-a8e8-4f7f37bd4cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:28.185332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaf80e-c51e-4a97-a8e8-4f7f37bd4cc8 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:28.185620 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaf80e-c51e-4a97-a8e8-4f7f37bd4cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:28.185892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaf80e-c51e-4a97-a8e8-4f7f37bd4cc8 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:28.186687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aaf80e-c51e-4a97-a8e8-4f7f37bd4cc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:28.187053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aaf80e-c51e-4a97-a8e8-4f7f37bd4cc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:28.188510 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aaf80e-c51e-4a97-a8e8-4f7f37bd4cc8 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:28.200893 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 392/805] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:28.201769 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaf80e-c51e-4a97-a8e8-4f7f37bd4cc8 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:28.221987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:28.233644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 414/806] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:28.235066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbf9bd-4dbc-41b0-b8b9-e730cc4ceff2 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:28.235342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbf9bd-4dbc-41b0-b8b9-e730cc4ceff2 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:28.235617 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbf9bd-4dbc-41b0-b8b9-e730cc4ceff2 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:28.236870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 415/807] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:28.237553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbf9bd-4dbc-41b0-b8b9-e730cc4ceff2 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:28.260018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:28.306580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaf80e-c51e-4a97-a8e8-4f7f37bd4cc8 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:28.340110 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007c9f5-e818-40ae-a2bc-55de31ad2c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:28.340775 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007c9f5-e818-40ae-a2bc-55de31ad2c19 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:28.341055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007c9f5-e818-40ae-a2bc-55de31ad2c19 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:28.341330 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007c9f5-e818-40ae-a2bc-55de31ad2c19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:28.342076 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007c9f5-e818-40ae-a2bc-55de31ad2c19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:28.343493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007c9f5-e818-40ae-a2bc-55de31ad2c19 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:28.350045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbf9bd-4dbc-41b0-b8b9-e730cc4ceff2 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:28.369873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 393/808] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 03:36:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:36:28.371034 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007c9f5-e818-40ae-a2bc-55de31ad2c19 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:28.392199 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae01ae-1a6f-44a6-9776-ce4e03b8fd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:28.392890 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae01ae-1a6f-44a6-9776-ce4e03b8fd45 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:28.393206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae01ae-1a6f-44a6-9776-ce4e03b8fd45 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:28.393553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae01ae-1a6f-44a6-9776-ce4e03b8fd45 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:28.394344 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae01ae-1a6f-44a6-9776-ce4e03b8fd45 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:28.394701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae01ae-1a6f-44a6-9776-ce4e03b8fd45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:28.396224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae01ae-1a6f-44a6-9776-ce4e03b8fd45 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:28.420638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 416/809] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 03:36:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:28.420638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb36ed-99bf-4f7b-a2d0-09328fc56109 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:28.420638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb36ed-99bf-4f7b-a2d0-09328fc56109 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:28.420638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb36ed-99bf-4f7b-a2d0-09328fc56109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:28.436054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-b8eb36ed-99bf-4f7b-a2d0-09328fc56109 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:28.437260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b8eb36ed-99bf-4f7b-a2d0-09328fc56109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:28.472877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:28.503350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:28.503969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007c9f5-e818-40ae-a2bc-55de31ad2c19 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:28.514594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 417/810] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:28.515248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb36ed-99bf-4f7b-a2d0-09328fc56109 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:28.553689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c2d08-75ab-43b5-80f5-0cb162ce99cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:28.554682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c2d08-75ab-43b5-80f5-0cb162ce99cd None admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:28.555016 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c2d08-75ab-43b5-80f5-0cb162ce99cd None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:28.555372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c2d08-75ab-43b5-80f5-0cb162ce99cd None admin] PATH_INFO: `/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/9de5d5c703b84e508e3112f90070e002/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:28.557657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c2d08-75ab-43b5-80f5-0cb162ce99cd None admin] RBAC: Authorizing `identity:create_grant(project_id=96e59c2ab83c477385e5a81b32a7c897, user_id=9de5d5c703b84e508e3112f90070e002, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:28.559200 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c2d08-75ab-43b5-80f5-0cb162ce99cd None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:28.575540 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 394/811] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:36:28 2022] PUT /identity/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/9de5d5c703b84e508e3112f90070e002/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:36:28.576449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c2d08-75ab-43b5-80f5-0cb162ce99cd None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:28.652418 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb36ed-99bf-4f7b-a2d0-09328fc56109 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:28.707640 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f8c09-e564-4dcb-b95b-4c5900cb2d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:28.709307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f8c09-e564-4dcb-b95b-4c5900cb2d10 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:28.709587 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f8c09-e564-4dcb-b95b-4c5900cb2d10 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:28.709861 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f8c09-e564-4dcb-b95b-4c5900cb2d10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:28.716766 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c2d08-75ab-43b5-80f5-0cb162ce99cd None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:28.729918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f8c09-e564-4dcb-b95b-4c5900cb2d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-247f8c09-e564-4dcb-b95b-4c5900cb2d10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:28.738315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:28.740475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:28.741372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:28.741372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:28.741372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:28.741372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:28.741372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:28.741372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:28.741372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:28.741372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:28.741372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:28.741372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:28.741372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:28.741372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:28.742008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 418/812] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:28.742561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f8c09-e564-4dcb-b95b-4c5900cb2d10 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:28.773182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b850d5-2ea8-43d0-aaaa-a3f5d8cc03be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:28.774118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b850d5-2ea8-43d0-aaaa-a3f5d8cc03be None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:28.774437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b850d5-2ea8-43d0-aaaa-a3f5d8cc03be None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:28.774686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b850d5-2ea8-43d0-aaaa-a3f5d8cc03be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:28.777881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:28.814245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:28.865564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b850d5-2ea8-43d0-aaaa-a3f5d8cc03be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:28.867545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b850d5-2ea8-43d0-aaaa-a3f5d8cc03be None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:28.881738 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f8c09-e564-4dcb-b95b-4c5900cb2d10 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:28.933328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a730c8-5e4b-4611-8bde-c66a0ebaf781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:28.934410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a730c8-5e4b-4611-8bde-c66a0ebaf781 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:28.934868 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a730c8-5e4b-4611-8bde-c66a0ebaf781 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:28.935297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a730c8-5e4b-4611-8bde-c66a0ebaf781 None admin] PATH_INFO: `/v3/services/network` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:28.936095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a730c8-5e4b-4611-8bde-c66a0ebaf781 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:28.937621 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a730c8-5e4b-4611-8bde-c66a0ebaf781 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-f6a730c8-5e4b-4611-8bde-c66a0ebaf781 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:28.950080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:28.951318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:28.952290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:28.952290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:28.952290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:28.952290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:28.952290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:28.952290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:28.952290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:28.952290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:28.952290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:28.952290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:28.952290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:28.952290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:28.952290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 03:36:28.952290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:28.954582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 419/813] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:28 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:28.955655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a730c8-5e4b-4611-8bde-c66a0ebaf781 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:28.996670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 395/814] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:36:28.997464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b850d5-2ea8-43d0-aaaa-a3f5d8cc03be None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:29.043623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:29.064736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a730c8-5e4b-4611-8bde-c66a0ebaf781 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:29.085557 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:29.109155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7429b0-7981-420a-a23a-ee9ac3faf0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:29.109848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7429b0-7981-420a-a23a-ee9ac3faf0ab None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:29.110132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7429b0-7981-420a-a23a-ee9ac3faf0ab None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:29.110410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7429b0-7981-420a-a23a-ee9ac3faf0ab None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:29.111222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7429b0-7981-420a-a23a-ee9ac3faf0ab None admin] RBAC: Adding query filter params (name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:29.111523 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7429b0-7981-420a-a23a-ee9ac3faf0ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:29.112941 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7429b0-7981-420a-a23a-ee9ac3faf0ab None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:29.123427 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 420/815] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:36:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:29.124455 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7429b0-7981-420a-a23a-ee9ac3faf0ab None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:29.248095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7429b0-7981-420a-a23a-ee9ac3faf0ab None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:29.261781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b850d5-2ea8-43d0-aaaa-a3f5d8cc03be None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:29.284003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4cfe0-f6dd-43a7-910f-6b9738cc6b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:29.285149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4cfe0-f6dd-43a7-910f-6b9738cc6b16 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:29.285618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4cfe0-f6dd-43a7-910f-6b9738cc6b16 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:29.286105 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4cfe0-f6dd-43a7-910f-6b9738cc6b16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:29.297199 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4cfe0-f6dd-43a7-910f-6b9738cc6b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:29.298915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4cfe0-f6dd-43a7-910f-6b9738cc6b16 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:29.303982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0f39f-3a8c-4267-bbdc-8a7fce3d17d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:29.304846 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f39f-3a8c-4267-bbdc-8a7fce3d17d7 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:29.305171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f39f-3a8c-4267-bbdc-8a7fce3d17d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:29.305451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f39f-3a8c-4267-bbdc-8a7fce3d17d7 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:29.306169 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0f39f-3a8c-4267-bbdc-8a7fce3d17d7 None admin] RBAC: Adding query filter params (name=network) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:29.306482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0f39f-3a8c-4267-bbdc-8a7fce3d17d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:29.308435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0f39f-3a8c-4267-bbdc-8a7fce3d17d7 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:29.314356 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 396/816] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 03:36:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:29.315256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0f39f-3a8c-4267-bbdc-8a7fce3d17d7 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-d6a4cfe0-f6dd-43a7-910f-6b9738cc6b16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:29.320439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:29.321349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:29.322254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:29.322254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:29.322254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:29.322254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:29.324484 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 421/817] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:29.325531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4cfe0-f6dd-43a7-910f-6b9738cc6b16 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:29.359104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:29.438058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4cfe0-f6dd-43a7-910f-6b9738cc6b16 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:29.440266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:29.444477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0f39f-3a8c-4267-bbdc-8a7fce3d17d7 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:29.480199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d4ff4-acb7-4608-8a78-743d4f4f40d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:29.481563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d4ff4-acb7-4608-8a78-743d4f4f40d6 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:29.482121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d4ff4-acb7-4608-8a78-743d4f4f40d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:29.482772 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d4ff4-acb7-4608-8a78-743d4f4f40d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:29.483927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc750be-74dc-44a7-9c05-525e787ca8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:29.484594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc750be-74dc-44a7-9c05-525e787ca8e7 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:29.484876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc750be-74dc-44a7-9c05-525e787ca8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:29.485149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc750be-74dc-44a7-9c05-525e787ca8e7 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:29.486118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc750be-74dc-44a7-9c05-525e787ca8e7 None admin] RBAC: Adding query filter params (type=network) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:29.486428 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc750be-74dc-44a7-9c05-525e787ca8e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:29.488261 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc750be-74dc-44a7-9c05-525e787ca8e7 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:29.495112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 422/818] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 03:36:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:29.496071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc750be-74dc-44a7-9c05-525e787ca8e7 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:29.496617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d4ff4-acb7-4608-8a78-743d4f4f40d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:29.498371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d4ff4-acb7-4608-8a78-743d4f4f40d6 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-2c6d4ff4-acb7-4608-8a78-743d4f4f40d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:29.517146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:29.518124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:29.519105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:29.519105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:29.519105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:29.519105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:29.521488 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 397/819] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:29.522487 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d4ff4-acb7-4608-8a78-743d4f4f40d6 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:29.623777 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:29.628442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d4ff4-acb7-4608-8a78-743d4f4f40d6 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:29.632586 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc750be-74dc-44a7-9c05-525e787ca8e7 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:29.664791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d2c27-afcf-4a95-ba50-8e4be09edac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:29.665464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d2c27-afcf-4a95-ba50-8e4be09edac0 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:29.665752 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d2c27-afcf-4a95-ba50-8e4be09edac0 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:29.666026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d2c27-afcf-4a95-ba50-8e4be09edac0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:29.666792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d2c27-afcf-4a95-ba50-8e4be09edac0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:29.668247 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d2c27-afcf-4a95-ba50-8e4be09edac0 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:29.679632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bbb8e-5c25-4e17-bc31-25ccdb02cbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:29.680453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bbb8e-5c25-4e17-bc31-25ccdb02cbbb None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:29.680746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bbb8e-5c25-4e17-bc31-25ccdb02cbbb None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:29.681104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bbb8e-5c25-4e17-bc31-25ccdb02cbbb None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:29.681891 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bbb8e-5c25-4e17-bc31-25ccdb02cbbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:29.682227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bbb8e-5c25-4e17-bc31-25ccdb02cbbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:29.683948 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bbb8e-5c25-4e17-bc31-25ccdb02cbbb None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:29.690623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 398/820] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 03:36:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:36:29.695992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d2c27-afcf-4a95-ba50-8e4be09edac0 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:29.698411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 423/821] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:29.705394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bbb8e-5c25-4e17-bc31-25ccdb02cbbb None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:29.716786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:29.858802 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bbb8e-5c25-4e17-bc31-25ccdb02cbbb None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:29.937563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db426a-9c3d-4054-bde8-5be8b3e831a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:29.938386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db426a-9c3d-4054-bde8-5be8b3e831a1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:29.938668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db426a-9c3d-4054-bde8-5be8b3e831a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:29.938969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db426a-9c3d-4054-bde8-5be8b3e831a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:29.946597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d2c27-afcf-4a95-ba50-8e4be09edac0 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:29.951272 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db426a-9c3d-4054-bde8-5be8b3e831a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:29.952740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db426a-9c3d-4054-bde8-5be8b3e831a1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-f9db426a-9c3d-4054-bde8-5be8b3e831a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:29.973054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:29.974158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:29.975119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:29.975119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:29.975119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:29.975119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:29.975119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:29.975119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:29.975119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:29.975119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:29.975119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 424/822] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:29.983700 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db426a-9c3d-4054-bde8-5be8b3e831a1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:29.992837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fba77-66ac-4120-9e2f-13349a3bd2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:29.993607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fba77-66ac-4120-9e2f-13349a3bd2ef None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:29.993959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fba77-66ac-4120-9e2f-13349a3bd2ef None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:29.994304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fba77-66ac-4120-9e2f-13349a3bd2ef None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:29.995171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fba77-66ac-4120-9e2f-13349a3bd2ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:29.995548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fba77-66ac-4120-9e2f-13349a3bd2ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:29.997135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fba77-66ac-4120-9e2f-13349a3bd2ef None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:30.002792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:30.012224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 399/823] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:30.017746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fba77-66ac-4120-9e2f-13349a3bd2ef None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:30.086329 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:30.099308 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db426a-9c3d-4054-bde8-5be8b3e831a1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:30.129572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fba77-66ac-4120-9e2f-13349a3bd2ef None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:30.139792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240a318-e67a-4fc7-85cb-647c6c899be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:30.140868 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240a318-e67a-4fc7-85cb-647c6c899be6 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:30.141323 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240a318-e67a-4fc7-85cb-647c6c899be6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:30.141785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240a318-e67a-4fc7-85cb-647c6c899be6 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:30.142833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240a318-e67a-4fc7-85cb-647c6c899be6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:30.143366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240a318-e67a-4fc7-85cb-647c6c899be6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:30.145125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240a318-e67a-4fc7-85cb-647c6c899be6 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:30.162964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 425/824] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:30.166656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240a318-e67a-4fc7-85cb-647c6c899be6 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:30.167732 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab4718-1006-4866-b7ae-d326488570ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:30.168575 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab4718-1006-4866-b7ae-d326488570ba None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:30.168863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab4718-1006-4866-b7ae-d326488570ba None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:30.169129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab4718-1006-4866-b7ae-d326488570ba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:30.177768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab4718-1006-4866-b7ae-d326488570ba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:30.179291 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab4718-1006-4866-b7ae-d326488570ba None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-71ab4718-1006-4866-b7ae-d326488570ba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:30.196547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:30.197563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:30.198978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:30.198978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:30.198978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:30.198978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:30.198978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:30.198978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:30.198978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:30.198978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:30.198978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 03:36:30.198978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:30.198978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 400/825] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 03:36:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:30.203769 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab4718-1006-4866-b7ae-d326488570ba None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:30.263156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:30.289920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240a318-e67a-4fc7-85cb-647c6c899be6 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:30.312115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab4718-1006-4866-b7ae-d326488570ba None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:30.328504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b77b0a-a33f-487b-b33c-6e9916e2c5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:30.329171 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77b0a-a33f-487b-b33c-6e9916e2c5fb None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:30.329453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77b0a-a33f-487b-b33c-6e9916e2c5fb None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:30.329726 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77b0a-a33f-487b-b33c-6e9916e2c5fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:30.330660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b77b0a-a33f-487b-b33c-6e9916e2c5fb None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=758b152c320e4a94921bb96541cbea98) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:30.331010 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b77b0a-a33f-487b-b33c-6e9916e2c5fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:30.332559 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b77b0a-a33f-487b-b33c-6e9916e2c5fb None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:30.337928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:30.340786 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 426/826] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:30 2022] GET /identity/v3/role_assignments?user.id=758b152c320e4a94921bb96541cbea98&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:30.351891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca8a0b-92f0-48a6-a354-0776d0fcc07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:30.352655 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca8a0b-92f0-48a6-a354-0776d0fcc07c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:30.352941 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca8a0b-92f0-48a6-a354-0776d0fcc07c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:30.353216 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca8a0b-92f0-48a6-a354-0776d0fcc07c None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:30.354093 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca8a0b-92f0-48a6-a354-0776d0fcc07c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:30.354404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca8a0b-92f0-48a6-a354-0776d0fcc07c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:30.355918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca8a0b-92f0-48a6-a354-0776d0fcc07c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:30.377950 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 401/827] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 30 03:36:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:30.384831 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b77b0a-a33f-487b-b33c-6e9916e2c5fb None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:30.504002 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b77b0a-a33f-487b-b33c-6e9916e2c5fb None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:30.541874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49f1f6-c139-4203-9c45-8dff8106502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:30.542688 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49f1f6-c139-4203-9c45-8dff8106502b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:30.543008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49f1f6-c139-4203-9c45-8dff8106502b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:30.543278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49f1f6-c139-4203-9c45-8dff8106502b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:30.546396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:30.557833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49f1f6-c139-4203-9c45-8dff8106502b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:30.559419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49f1f6-c139-4203-9c45-8dff8106502b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:30.563898 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3db72-8467-445e-88b3-d6e7716629f3 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:30.564182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3db72-8467-445e-88b3-d6e7716629f3 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:30.564458 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3db72-8467-445e-88b3-d6e7716629f3 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:30.565968 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 402/828] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:36:30.572311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a1659-54e3-4908-b3ea-2e5fafb56f96 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:30.572600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a1659-54e3-4908-b3ea-2e5fafb56f96 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:30.572877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a1659-54e3-4908-b3ea-2e5fafb56f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-bd49f1f6-c139-4203-9c45-8dff8106502b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:30.578006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:30.578908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:30.579829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:30.579829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:30.579829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:30.579829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:30.579829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 427/829] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:30.585563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49f1f6-c139-4203-9c45-8dff8106502b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:30.594552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ed2a1659-54e3-4908-b3ea-2e5fafb56f96 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:30.597355 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ed2a1659-54e3-4908-b3ea-2e5fafb56f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:30.676443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 403/830] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:36:30.698616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a1659-54e3-4908-b3ea-2e5fafb56f96 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:30.813846 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a1659-54e3-4908-b3ea-2e5fafb56f96 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:30.825824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:30.831578 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49f1f6-c139-4203-9c45-8dff8106502b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:30.855496 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4499d1a-3d03-40ab-9b0d-b55f138ef799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:30.856322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4499d1a-3d03-40ab-9b0d-b55f138ef799 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:30.856601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4499d1a-3d03-40ab-9b0d-b55f138ef799 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:30.856880 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4499d1a-3d03-40ab-9b0d-b55f138ef799 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:30.857547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4499d1a-3d03-40ab-9b0d-b55f138ef799 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:30.858978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4499d1a-3d03-40ab-9b0d-b55f138ef799 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:30.867561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6a22-bf03-44b7-b1b7-1f59ca1efd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:30.868228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6a22-bf03-44b7-b1b7-1f59ca1efd94 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:30.868508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6a22-bf03-44b7-b1b7-1f59ca1efd94 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:30.868778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6a22-bf03-44b7-b1b7-1f59ca1efd94 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:30.869498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d6a22-bf03-44b7-b1b7-1f59ca1efd94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:30.869802 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d6a22-bf03-44b7-b1b7-1f59ca1efd94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:30.871208 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d6a22-bf03-44b7-b1b7-1f59ca1efd94 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-d4499d1a-3d03-40ab-9b0d-b55f138ef799 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:30.871754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:30.872763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:30.873603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 404/831] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:36:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:30.875099 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae616e-f884-46af-9bc9-0069472112fe None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:30.875099 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae616e-f884-46af-9bc9-0069472112fe None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:30.875099 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae616e-f884-46af-9bc9-0069472112fe None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:30.876432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 405/832] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:30.882322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae616e-f884-46af-9bc9-0069472112fe None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:30.889236 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 428/833] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:30.890586 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b21ee-6d3c-490c-8f67-19fd31421d64 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:30.890975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b21ee-6d3c-490c-8f67-19fd31421d64 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:30.891317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b21ee-6d3c-490c-8f67-19fd31421d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:30.908021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-f32b21ee-6d3c-490c-8f67-19fd31421d64 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:30.909209 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f32b21ee-6d3c-490c-8f67-19fd31421d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:30.957615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:30.982266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 429/834] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:30.983187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b21ee-6d3c-490c-8f67-19fd31421d64 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:31.007318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae616e-f884-46af-9bc9-0069472112fe None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:31.043523 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f88ed-7c14-4cfd-b0d9-333b739f5af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:31.044197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f88ed-7c14-4cfd-b0d9-333b739f5af8 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:31.044484 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f88ed-7c14-4cfd-b0d9-333b739f5af8 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:31.044766 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f88ed-7c14-4cfd-b0d9-333b739f5af8 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:31.045481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f88ed-7c14-4cfd-b0d9-333b739f5af8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:31.045791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f88ed-7c14-4cfd-b0d9-333b739f5af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:31.047208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f88ed-7c14-4cfd-b0d9-333b739f5af8 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:31.052996 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 406/835] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:36:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:31.053618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f88ed-7c14-4cfd-b0d9-333b739f5af8 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:31.092747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b21ee-6d3c-490c-8f67-19fd31421d64 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:31.094896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:31.130753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07389c-a5c9-499d-9bdc-320dd5e97642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:31.132205 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07389c-a5c9-499d-9bdc-320dd5e97642 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:31.132639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07389c-a5c9-499d-9bdc-320dd5e97642 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:31.132912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07389c-a5c9-499d-9bdc-320dd5e97642 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:31.140021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07389c-a5c9-499d-9bdc-320dd5e97642 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:31.141528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07389c-a5c9-499d-9bdc-320dd5e97642 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-ce07389c-a5c9-499d-9bdc-320dd5e97642 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:31.155722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:31.156615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:31.157506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:31.157506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:31.157506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:31.157506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:31.157506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:31.157506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:31.157506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:31.157506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:31.157506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 430/836] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:31.157989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07389c-a5c9-499d-9bdc-320dd5e97642 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:31.176139 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f88ed-7c14-4cfd-b0d9-333b739f5af8 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:31.206754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:31.215921 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f71844-be80-4e52-8000-94bba67cc139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:31.216697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f71844-be80-4e52-8000-94bba67cc139 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:31.216980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f71844-be80-4e52-8000-94bba67cc139 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:31.217260 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f71844-be80-4e52-8000-94bba67cc139 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:31.228253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f71844-be80-4e52-8000-94bba67cc139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-21f71844-be80-4e52-8000-94bba67cc139 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:31.235944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:31.236892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:31.237740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:31.237740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:31.237740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:31.237740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:31.237740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:31.237740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:31.237740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:31.237740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:31.237740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:31.237740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:31.237740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:36:31.237740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:31.237740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 407/837] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:36:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:31.238430 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f71844-be80-4e52-8000-94bba67cc139 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:31.281072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07389c-a5c9-499d-9bdc-320dd5e97642 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:31.317660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2fa0a-7918-4129-8270-cd330e7a0b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:31.318815 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2fa0a-7918-4129-8270-cd330e7a0b2e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:31.318815 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2fa0a-7918-4129-8270-cd330e7a0b2e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:31.319109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2fa0a-7918-4129-8270-cd330e7a0b2e None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:31.319662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2fa0a-7918-4129-8270-cd330e7a0b2e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:31.319966 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2fa0a-7918-4129-8270-cd330e7a0b2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:31.321381 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2fa0a-7918-4129-8270-cd330e7a0b2e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:31.326587 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 431/838] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:36:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:31.335876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2fa0a-7918-4129-8270-cd330e7a0b2e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:31.352323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:31.357173 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f71844-be80-4e52-8000-94bba67cc139 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:31.397583 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f5f0a-c5cb-4282-849b-f223f1d5a5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:31.398262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f5f0a-c5cb-4282-849b-f223f1d5a5ef None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:31.398538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f5f0a-c5cb-4282-849b-f223f1d5a5ef None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:31.398851 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f5f0a-c5cb-4282-849b-f223f1d5a5ef None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:31.399660 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f5f0a-c5cb-4282-849b-f223f1d5a5ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:31.399967 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f5f0a-c5cb-4282-849b-f223f1d5a5ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:31.401588 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f5f0a-c5cb-4282-849b-f223f1d5a5ef None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:31.416847 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 408/839] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:31.422581 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f5f0a-c5cb-4282-849b-f223f1d5a5ef None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:31.487150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2fa0a-7918-4129-8270-cd330e7a0b2e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:31.489112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:31.535704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eda33b-6364-4274-9b8b-2f36f7b92aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:31.538396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eda33b-6364-4274-9b8b-2f36f7b92aff None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:31.538823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eda33b-6364-4274-9b8b-2f36f7b92aff None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:31.539108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eda33b-6364-4274-9b8b-2f36f7b92aff None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:31.540002 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eda33b-6364-4274-9b8b-2f36f7b92aff None admin] RBAC: Adding query filter params (name=admin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:31.540345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eda33b-6364-4274-9b8b-2f36f7b92aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:31.541871 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eda33b-6364-4274-9b8b-2f36f7b92aff None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:31.558351 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 432/840] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:36:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:31.560878 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eda33b-6364-4274-9b8b-2f36f7b92aff None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:31.567541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f5f0a-c5cb-4282-849b-f223f1d5a5ef None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:31.613681 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4438a12-9295-4735-8cf6-2cc6ae8d3dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:31.615258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4438a12-9295-4735-8cf6-2cc6ae8d3dbb None admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:31.615720 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4438a12-9295-4735-8cf6-2cc6ae8d3dbb None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:31.616304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4438a12-9295-4735-8cf6-2cc6ae8d3dbb None admin] PATH_INFO: `/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/f75f5e28008b4189b5feb6438bdf1852/roles/b9998a2301454764ae06a0f743463c5d` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:31.636446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4438a12-9295-4735-8cf6-2cc6ae8d3dbb None admin] RBAC: Authorizing `identity:create_grant(project_id=96e59c2ab83c477385e5a81b32a7c897, user_id=f75f5e28008b4189b5feb6438bdf1852, role_id=b9998a2301454764ae06a0f743463c5d)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:31.639321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4438a12-9295-4735-8cf6-2cc6ae8d3dbb None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:31.662749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 409/841] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:36:31 2022] PUT /identity/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/f75f5e28008b4189b5feb6438bdf1852/roles/b9998a2301454764ae06a0f743463c5d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:36:31.701979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eda33b-6364-4274-9b8b-2f36f7b92aff None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:31.748492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3eb23-fbc8-42ab-b133-8161db4db03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:31.749663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3eb23-fbc8-42ab-b133-8161db4db03c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:31.750078 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3eb23-fbc8-42ab-b133-8161db4db03c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:31.750485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3eb23-fbc8-42ab-b133-8161db4db03c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:31.766753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3eb23-fbc8-42ab-b133-8161db4db03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:31.768499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3eb23-fbc8-42ab-b133-8161db4db03c None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-1ed3eb23-fbc8-42ab-b133-8161db4db03c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:31.790238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:31.791395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:31.792568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:31.792568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:31.792568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:31.792568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:31.794887 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 433/842] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:31.804200 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4438a12-9295-4735-8cf6-2cc6ae8d3dbb None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:31.843910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:31.933092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4438a12-9295-4735-8cf6-2cc6ae8d3dbb None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:31.974984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323d1e7-b9ac-4d0f-93bb-774547ad9aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:31.975669 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323d1e7-b9ac-4d0f-93bb-774547ad9aa9 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:31.975951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323d1e7-b9ac-4d0f-93bb-774547ad9aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:31.976223 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323d1e7-b9ac-4d0f-93bb-774547ad9aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:31.976966 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323d1e7-b9ac-4d0f-93bb-774547ad9aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:31.977275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323d1e7-b9ac-4d0f-93bb-774547ad9aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:31.978672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323d1e7-b9ac-4d0f-93bb-774547ad9aa9 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:31.991439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 410/843] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:31.997368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3eb23-fbc8-42ab-b133-8161db4db03c None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:32.020401 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:32.143996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3eb23-fbc8-42ab-b133-8161db4db03c None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:32.185388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca015a-abe4-4f4b-b625-6ca43de0f942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:32.186778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca015a-abe4-4f4b-b625-6ca43de0f942 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:32.187107 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca015a-abe4-4f4b-b625-6ca43de0f942 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:32.187424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca015a-abe4-4f4b-b625-6ca43de0f942 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:32.196201 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca015a-abe4-4f4b-b625-6ca43de0f942 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:32.197989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca015a-abe4-4f4b-b625-6ca43de0f942 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-bdca015a-abe4-4f4b-b625-6ca43de0f942 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:32.217913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:32.218972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:32.219974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:32.219974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:32.219974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:32.219974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:32.219974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:32.219974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:32.219974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:32.219974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:32.219974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 03:36:32.219974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:32.219974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 434/844] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:36:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:32.229038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323d1e7-b9ac-4d0f-93bb-774547ad9aa9 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:32.309855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:32.351956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323d1e7-b9ac-4d0f-93bb-774547ad9aa9 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:32.392863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c07011-b48a-419e-972b-02ec71706912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:32.393938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c07011-b48a-419e-972b-02ec71706912 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:32.394330 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c07011-b48a-419e-972b-02ec71706912 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:32.394795 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c07011-b48a-419e-972b-02ec71706912 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:32.396339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c07011-b48a-419e-972b-02ec71706912 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:32.396657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c07011-b48a-419e-972b-02ec71706912 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:32.398244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c07011-b48a-419e-972b-02ec71706912 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:32.417955 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 411/845] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 30 03:36:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:32.423896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca015a-abe4-4f4b-b625-6ca43de0f942 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:32.535136 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:32.558703 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca015a-abe4-4f4b-b625-6ca43de0f942 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:32.594238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffd9b9-ba10-4efe-a5b8-7d9487349905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:32.594928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffd9b9-ba10-4efe-a5b8-7d9487349905 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:32.595240 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffd9b9-ba10-4efe-a5b8-7d9487349905 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:32.595526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffd9b9-ba10-4efe-a5b8-7d9487349905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:32.669836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffd9b9-ba10-4efe-a5b8-7d9487349905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:32.671328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffd9b9-ba10-4efe-a5b8-7d9487349905 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:32.677594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94daeff-b31f-4273-9346-e02d6470c1af None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:32.677879 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94daeff-b31f-4273-9346-e02d6470c1af None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:32.678156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94daeff-b31f-4273-9346-e02d6470c1af None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:32.679819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 412/846] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:36:32.684659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd3476-f5f4-4efd-8b72-465879081d64 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:32.684949 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd3476-f5f4-4efd-8b72-465879081d64 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:32.685232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd3476-f5f4-4efd-8b72-465879081d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:32.701953 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6cbd3476-f5f4-4efd-8b72-465879081d64 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:32.703192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6cbd3476-f5f4-4efd-8b72-465879081d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:32.756650 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:32.787326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 413/848] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:36:32.787844 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 435/848] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:36:32.789526 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd3476-f5f4-4efd-8b72-465879081d64 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:32.808203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffd9b9-ba10-4efe-a5b8-7d9487349905 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:32.871582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:32.926756 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffd9b9-ba10-4efe-a5b8-7d9487349905 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:32.934409 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd3476-f5f4-4efd-8b72-465879081d64 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:32.963748 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3aae3-7277-4879-b6e4-1f6ea4c3ec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:32.964938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3aae3-7277-4879-b6e4-1f6ea4c3ec65 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:32.965433 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3aae3-7277-4879-b6e4-1f6ea4c3ec65 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:32.965895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3aae3-7277-4879-b6e4-1f6ea4c3ec65 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:32.966743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3aae3-7277-4879-b6e4-1f6ea4c3ec65 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:32.968332 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3aae3-7277-4879-b6e4-1f6ea4c3ec65 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:32.976679 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2dcbb-295f-4c0d-a0a5-cd00b2d1da4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:32.977515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2dcbb-295f-4c0d-a0a5-cd00b2d1da4b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:32.977808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2dcbb-295f-4c0d-a0a5-cd00b2d1da4b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:32.978074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2dcbb-295f-4c0d-a0a5-cd00b2d1da4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-34a3aae3-7277-4879-b6e4-1f6ea4c3ec65 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:32.982704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:32.983670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 03:36:32.984495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:32.987400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 436/849] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Jun 30 03:36:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:32.993696 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3aae3-7277-4879-b6e4-1f6ea4c3ec65 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:32.993843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2dcbb-295f-4c0d-a0a5-cd00b2d1da4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:32.995268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2dcbb-295f-4c0d-a0a5-cd00b2d1da4b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-cde2dcbb-295f-4c0d-a0a5-cd00b2d1da4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:33.014252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:33.015498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:33.016412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:33.016412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:33.016412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:33.016412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:33.019018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 414/850] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:33.021426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2dcbb-295f-4c0d-a0a5-cd00b2d1da4b None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:33.050795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:33.129958 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2dcbb-295f-4c0d-a0a5-cd00b2d1da4b None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:33.130561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3aae3-7277-4879-b6e4-1f6ea4c3ec65 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:33.140435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:33.166964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ed3e9-b828-46da-8a83-c792cdf5f246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:33.167641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ed3e9-b828-46da-8a83-c792cdf5f246 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:33.168048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ed3e9-b828-46da-8a83-c792cdf5f246 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:33.168298 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ed3e9-b828-46da-8a83-c792cdf5f246 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:33.169073 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ed3e9-b828-46da-8a83-c792cdf5f246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:33.169576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ed3e9-b828-46da-8a83-c792cdf5f246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:33.170887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ed3e9-b828-46da-8a83-c792cdf5f246 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:33.175178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1fa03-dc7d-4b2a-91f1-42040ac81fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:33.176514 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1fa03-dc7d-4b2a-91f1-42040ac81fc7 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:33.177239 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1fa03-dc7d-4b2a-91f1-42040ac81fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:33.178174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1fa03-dc7d-4b2a-91f1-42040ac81fc7 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:33.179235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1fa03-dc7d-4b2a-91f1-42040ac81fc7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:33.180155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1fa03-dc7d-4b2a-91f1-42040ac81fc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:33.182009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1fa03-dc7d-4b2a-91f1-42040ac81fc7 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:33.188002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 415/851] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:33.189374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 437/852] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 03:36:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:33.189636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ed3e9-b828-46da-8a83-c792cdf5f246 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:33.197398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1fa03-dc7d-4b2a-91f1-42040ac81fc7 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:33.307162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ed3e9-b828-46da-8a83-c792cdf5f246 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:33.325579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1fa03-dc7d-4b2a-91f1-42040ac81fc7 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:33.328406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:33.356631 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70a9a7-dd62-41b9-9251-75e391dba4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:33.357456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70a9a7-dd62-41b9-9251-75e391dba4a3 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:33.358105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70a9a7-dd62-41b9-9251-75e391dba4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:33.358404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70a9a7-dd62-41b9-9251-75e391dba4a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:33.366295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b16f2-3b4b-4e78-be48-f0fff0c4c8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:33.367048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70a9a7-dd62-41b9-9251-75e391dba4a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:33.367528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b16f2-3b4b-4e78-be48-f0fff0c4c8be None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:33.367993 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b16f2-3b4b-4e78-be48-f0fff0c4c8be None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:33.368462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b16f2-3b4b-4e78-be48-f0fff0c4c8be None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:33.368564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70a9a7-dd62-41b9-9251-75e391dba4a3 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:33.369636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b16f2-3b4b-4e78-be48-f0fff0c4c8be None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:33.370146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b16f2-3b4b-4e78-be48-f0fff0c4c8be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:33.371771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b16f2-3b4b-4e78-be48-f0fff0c4c8be None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:33.383188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 438/853] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 03:36:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-eb70a9a7-dd62-41b9-9251-75e391dba4a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:33.384826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:33.385675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:33.386544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:33.386544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:33.386544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:33.386544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:33.386544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:33.386544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:33.386544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:33.386544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:33.391143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 416/854] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:33.392689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b16f2-3b4b-4e78-be48-f0fff0c4c8be None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:33.426861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4778b1b-5a7c-4704-8f8b-8b94d30d0c62 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:33.427442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4778b1b-5a7c-4704-8f8b-8b94d30d0c62 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:33.427442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4778b1b-5a7c-4704-8f8b-8b94d30d0c62 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:33.428959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 417/855] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:36:33.434812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426baf25-b11d-4a6b-b63a-a33365dd1d82 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:33.435061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426baf25-b11d-4a6b-b63a-a33365dd1d82 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:33.435354 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426baf25-b11d-4a6b-b63a-a33365dd1d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:33.457901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-426baf25-b11d-4a6b-b63a-a33365dd1d82 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:33.459784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-426baf25-b11d-4a6b-b63a-a33365dd1d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:33.495135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:33.524093 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b16f2-3b4b-4e78-be48-f0fff0c4c8be None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:33.559729 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 418/856] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:36:33.564185 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb1adf-8dbf-441f-9db7-1efd56bc3885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:33.564858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb1adf-8dbf-441f-9db7-1efd56bc3885 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:33.565141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb1adf-8dbf-441f-9db7-1efd56bc3885 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:33.565416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb1adf-8dbf-441f-9db7-1efd56bc3885 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:33.566211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb1adf-8dbf-441f-9db7-1efd56bc3885 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:33.566520 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb1adf-8dbf-441f-9db7-1efd56bc3885 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:33.568127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb1adf-8dbf-441f-9db7-1efd56bc3885 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:33.582633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426baf25-b11d-4a6b-b63a-a33365dd1d82 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:33.585150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 439/857] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:33.589130 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb1adf-8dbf-441f-9db7-1efd56bc3885 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:33.626668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:33.703050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb1adf-8dbf-441f-9db7-1efd56bc3885 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:33.706240 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426baf25-b11d-4a6b-b63a-a33365dd1d82 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:33.738293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce91c76-ea9d-460f-8d4a-a4e2a8da4f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:33.739102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce91c76-ea9d-460f-8d4a-a4e2a8da4f61 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:33.739386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce91c76-ea9d-460f-8d4a-a4e2a8da4f61 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:33.739698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce91c76-ea9d-460f-8d4a-a4e2a8da4f61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:33.740581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce91c76-ea9d-460f-8d4a-a4e2a8da4f61 None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=9de5d5c703b84e508e3112f90070e002) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:33.740892 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce91c76-ea9d-460f-8d4a-a4e2a8da4f61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:33.742324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce91c76-ea9d-460f-8d4a-a4e2a8da4f61 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:33.748782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 440/858] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:33 2022] GET /identity/v3/role_assignments?user.id=9de5d5c703b84e508e3112f90070e002&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:33.749054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4571a5-1d79-4a17-91d0-da342da9e866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:33.749724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4571a5-1d79-4a17-91d0-da342da9e866 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:33.750000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4571a5-1d79-4a17-91d0-da342da9e866 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:33.750270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4571a5-1d79-4a17-91d0-da342da9e866 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:33.751041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4571a5-1d79-4a17-91d0-da342da9e866 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:33.752415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4571a5-1d79-4a17-91d0-da342da9e866 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:33.771249 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 419/859] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 03:36:33 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:36:33.825836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434777b-146e-48ef-b026-a4d5e465eabc None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:33.826126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434777b-146e-48ef-b026-a4d5e465eabc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:33.826400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434777b-146e-48ef-b026-a4d5e465eabc None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:33.828086 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 441/860] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:33.834578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747caafe-8736-4e0d-9b92-3a2d058ada3f None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:33.835256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747caafe-8736-4e0d-9b92-3a2d058ada3f None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:33.835707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747caafe-8736-4e0d-9b92-3a2d058ada3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:33.859666 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-747caafe-8736-4e0d-9b92-3a2d058ada3f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:33.860982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-747caafe-8736-4e0d-9b92-3a2d058ada3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:33.881723 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:33.958174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 420/861] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:33.982476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434777b-146e-48ef-b026-a4d5e465eabc None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:34.083740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:34.094521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434777b-146e-48ef-b026-a4d5e465eabc None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:34.130910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e499f-0c65-4946-9325-626b8475c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:34.131722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e499f-0c65-4946-9325-626b8475c49d None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:34.132000 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e499f-0c65-4946-9325-626b8475c49d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:34.132273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e499f-0c65-4946-9325-626b8475c49d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:34.143260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e499f-0c65-4946-9325-626b8475c49d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-635e499f-0c65-4946-9325-626b8475c49d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:34.151408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:34.152407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:34.153234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:34.153234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:34.153234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:34.153234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:34.153234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:34.153234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:34.153234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:34.153234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:34.153234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:34.153234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:34.153234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:36:34.153234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:34.153234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 442/862] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:36:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:34.158704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747caafe-8736-4e0d-9b92-3a2d058ada3f None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:34.266152 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747caafe-8736-4e0d-9b92-3a2d058ada3f None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:34.302261 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8463a3d-7fc0-455f-9c14-9fac76d38e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:34.302868 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8463a3d-7fc0-455f-9c14-9fac76d38e63 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:34.303147 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8463a3d-7fc0-455f-9c14-9fac76d38e63 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:34.303416 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8463a3d-7fc0-455f-9c14-9fac76d38e63 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:34.304166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8463a3d-7fc0-455f-9c14-9fac76d38e63 None admin] RBAC: Adding query filter params (name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:34.304467 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8463a3d-7fc0-455f-9c14-9fac76d38e63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:34.305842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8463a3d-7fc0-455f-9c14-9fac76d38e63 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:34.314476 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 421/863] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:36:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:34.320322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e499f-0c65-4946-9325-626b8475c49d None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:34.424999 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e499f-0c65-4946-9325-626b8475c49d None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:34.462125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa907d66-03f1-4cf6-b324-6c9986854e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:34.463005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa907d66-03f1-4cf6-b324-6c9986854e17 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:34.463329 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa907d66-03f1-4cf6-b324-6c9986854e17 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:34.463611 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa907d66-03f1-4cf6-b324-6c9986854e17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:34.475203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa907d66-03f1-4cf6-b324-6c9986854e17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:34.476661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa907d66-03f1-4cf6-b324-6c9986854e17 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-fa907d66-03f1-4cf6-b324-6c9986854e17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:34.495544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:34.497566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:34.499753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:34.499753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:34.499753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:34.499753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:34.499753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 443/864] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:34.502726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8463a3d-7fc0-455f-9c14-9fac76d38e63 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:34.512498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:34.617777 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8463a3d-7fc0-455f-9c14-9fac76d38e63 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:34.655090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0305e-3866-4d60-9fd5-5a47c5b53165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:34.656012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0305e-3866-4d60-9fd5-5a47c5b53165 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:34.656440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0305e-3866-4d60-9fd5-5a47c5b53165 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:34.656855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0305e-3866-4d60-9fd5-5a47c5b53165 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:34.657728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0305e-3866-4d60-9fd5-5a47c5b53165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:34.658212 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0305e-3866-4d60-9fd5-5a47c5b53165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:34.659830 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0305e-3866-4d60-9fd5-5a47c5b53165 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:34.673650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 422/865] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:34.679761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa907d66-03f1-4cf6-b324-6c9986854e17 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:34.683943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:34.788183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa907d66-03f1-4cf6-b324-6c9986854e17 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:34.822001 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65878b1-bb62-4c70-8fd0-a3b2f7888594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:34.822850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65878b1-bb62-4c70-8fd0-a3b2f7888594 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:34.823134 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65878b1-bb62-4c70-8fd0-a3b2f7888594 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:34.823408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65878b1-bb62-4c70-8fd0-a3b2f7888594 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:34.831005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65878b1-bb62-4c70-8fd0-a3b2f7888594 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:34.832664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65878b1-bb62-4c70-8fd0-a3b2f7888594 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-f65878b1-bb62-4c70-8fd0-a3b2f7888594 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:34.853285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:34.854287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:34.855273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:34.855273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:34.855273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:34.855273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:34.855273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:34.855273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:34.855273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:34.855273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:34.855273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 03:36:34.855273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:34.855273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 444/866] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 03:36:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:34.860389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0305e-3866-4d60-9fd5-5a47c5b53165 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:34.933236 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:34.968343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0305e-3866-4d60-9fd5-5a47c5b53165 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:35.009123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185e703-f42c-4868-9574-8da882511202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:35.009807 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185e703-f42c-4868-9574-8da882511202 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:35.010083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185e703-f42c-4868-9574-8da882511202 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:35.010354 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185e703-f42c-4868-9574-8da882511202 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:35.011242 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185e703-f42c-4868-9574-8da882511202 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:35.011546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185e703-f42c-4868-9574-8da882511202 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:35.012984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185e703-f42c-4868-9574-8da882511202 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:35.030939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 423/867] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 30 03:36:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:35.037107 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65878b1-bb62-4c70-8fd0-a3b2f7888594 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:35.103446 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:35.146032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65878b1-bb62-4c70-8fd0-a3b2f7888594 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:35.180095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a521b-9b3c-4b43-b8ed-75c256de2ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:35.180740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a521b-9b3c-4b43-b8ed-75c256de2ea5 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:35.181016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a521b-9b3c-4b43-b8ed-75c256de2ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:35.181285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a521b-9b3c-4b43-b8ed-75c256de2ea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:35.249234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a521b-9b3c-4b43-b8ed-75c256de2ea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:35.250578 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a521b-9b3c-4b43-b8ed-75c256de2ea5 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:35.311897 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:35.358610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 445/868] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:35 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:36:35.364477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185e703-f42c-4868-9574-8da882511202 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:35.468463 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185e703-f42c-4868-9574-8da882511202 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:35.495052 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:35.506475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a4a4c-cded-4d6e-88a9-8feae82e95d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:35.508245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a4a4c-cded-4d6e-88a9-8feae82e95d5 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:35.508539 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a4a4c-cded-4d6e-88a9-8feae82e95d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:35.509123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a4a4c-cded-4d6e-88a9-8feae82e95d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:35.520327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a4a4c-cded-4d6e-88a9-8feae82e95d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:35.521756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a4a4c-cded-4d6e-88a9-8feae82e95d5 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-c47a4a4c-cded-4d6e-88a9-8feae82e95d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:35.540181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:35.541112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:35.542022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:35.542022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:35.542022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:35.542022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:35.542022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 424/869] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:35.547473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a521b-9b3c-4b43-b8ed-75c256de2ea5 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:35.650741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fc688-a94c-4786-820c-987eb852fd00 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:35.651097 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fc688-a94c-4786-820c-987eb852fd00 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:35.651329 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fc688-a94c-4786-820c-987eb852fd00 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:35.653633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a521b-9b3c-4b43-b8ed-75c256de2ea5 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:35.656470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 425/870] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:36:35.658188 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fc552-ff8d-4a13-9dea-8be733acb81b None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:35.658542 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fc552-ff8d-4a13-9dea-8be733acb81b None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:35.658913 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fc552-ff8d-4a13-9dea-8be733acb81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:35.675944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-f03fc552-ff8d-4a13-9dea-8be733acb81b None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:35.677899 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-f03fc552-ff8d-4a13-9dea-8be733acb81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:35.696581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d42c6-5375-4f76-9014-2aa1d6538b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:35.697261 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d42c6-5375-4f76-9014-2aa1d6538b8f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:35.697697 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d42c6-5375-4f76-9014-2aa1d6538b8f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:35.697974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d42c6-5375-4f76-9014-2aa1d6538b8f None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:35.699042 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d42c6-5375-4f76-9014-2aa1d6538b8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:35.699350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d42c6-5375-4f76-9014-2aa1d6538b8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:35.700740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d42c6-5375-4f76-9014-2aa1d6538b8f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:35.716386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 446/871] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:35.722278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d42c6-5375-4f76-9014-2aa1d6538b8f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:35.748064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:35.762938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 426/872] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:35.778135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fc552-ff8d-4a13-9dea-8be733acb81b None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:35.826746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d42c6-5375-4f76-9014-2aa1d6538b8f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:35.862530 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890df5-9f31-45d2-8d01-8e3be8ada5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:35.863469 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890df5-9f31-45d2-8d01-8e3be8ada5cc None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:35.863784 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890df5-9f31-45d2-8d01-8e3be8ada5cc None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:35.864057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890df5-9f31-45d2-8d01-8e3be8ada5cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:35.871945 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf890df5-9f31-45d2-8d01-8e3be8ada5cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:35.873497 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf890df5-9f31-45d2-8d01-8e3be8ada5cc None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-cf890df5-9f31-45d2-8d01-8e3be8ada5cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:35.889207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:35.890309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:35.891359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:35.891359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:35.891359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:35.891359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:35.891359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:35.891359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:35.891359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:35.891359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:35.894658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fc552-ff8d-4a13-9dea-8be733acb81b None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:35.895177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 447/873] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:35.896633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890df5-9f31-45d2-8d01-8e3be8ada5cc None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:35.903382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:35.933457 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750511d9-0512-4e38-9ad7-b99adbb4b709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:35.934117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750511d9-0512-4e38-9ad7-b99adbb4b709 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:35.934396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750511d9-0512-4e38-9ad7-b99adbb4b709 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:35.934751 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750511d9-0512-4e38-9ad7-b99adbb4b709 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:35.935508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750511d9-0512-4e38-9ad7-b99adbb4b709 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:35.937011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750511d9-0512-4e38-9ad7-b99adbb4b709 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:35.954994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 427/874] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 03:36:35 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:36:35.976822 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d3d09-fda7-48fb-a0b7-3b348ab85874 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:35.977026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d3d09-fda7-48fb-a0b7-3b348ab85874 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:35.977398 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d3d09-fda7-48fb-a0b7-3b348ab85874 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:35.979303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 428/875] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:36:35.985273 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7034-b194-49b5-ab76-53b855288749 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:35.985631 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7034-b194-49b5-ab76-53b855288749 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:35.985983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7034-b194-49b5-ab76-53b855288749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:35.997733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:36.005307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e45a7034-b194-49b5-ab76-53b855288749 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:36.006819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e45a7034-b194-49b5-ab76-53b855288749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:36.019413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890df5-9f31-45d2-8d01-8e3be8ada5cc None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:36.068877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f538fa6-6ffd-4c90-baf4-a5435207e294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:36.069568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538fa6-6ffd-4c90-baf4-a5435207e294 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:36.069851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538fa6-6ffd-4c90-baf4-a5435207e294 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:36.070125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538fa6-6ffd-4c90-baf4-a5435207e294 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:36.070971 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f538fa6-6ffd-4c90-baf4-a5435207e294 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:36.071287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f538fa6-6ffd-4c90-baf4-a5435207e294 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:36.072860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f538fa6-6ffd-4c90-baf4-a5435207e294 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:36.086567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 448/876] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:36.088249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3dfc9-bf50-4bce-8558-08e5a45ecec9 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:36.088699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3dfc9-bf50-4bce-8558-08e5a45ecec9 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:36.089150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3dfc9-bf50-4bce-8558-08e5a45ecec9 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:36.090953 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 449/877] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:36.092345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3dfc9-bf50-4bce-8558-08e5a45ecec9 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:36.100802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 429/878] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:36.102164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9145264-b08c-4415-8fe9-06d0daf10a17 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:36.102451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9145264-b08c-4415-8fe9-06d0daf10a17 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:36.102731 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9145264-b08c-4415-8fe9-06d0daf10a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:36.127807 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-b9145264-b08c-4415-8fe9-06d0daf10a17 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:36.129031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-b9145264-b08c-4415-8fe9-06d0daf10a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:36.214784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 430/879] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:36.214784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9145264-b08c-4415-8fe9-06d0daf10a17 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:36.225532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3dfc9-bf50-4bce-8558-08e5a45ecec9 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:36.245294 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:36.261814 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279041f2-b232-48f9-8df8-af4f5858beb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:36.262491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279041f2-b232-48f9-8df8-af4f5858beb9 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:36.262795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279041f2-b232-48f9-8df8-af4f5858beb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:36.263080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279041f2-b232-48f9-8df8-af4f5858beb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:36.263920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279041f2-b232-48f9-8df8-af4f5858beb9 None admin] RBAC: Adding query filter params (role.id=b9998a2301454764ae06a0f743463c5d, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=f75f5e28008b4189b5feb6438bdf1852) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:36.264257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279041f2-b232-48f9-8df8-af4f5858beb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:36.265703 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279041f2-b232-48f9-8df8-af4f5858beb9 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:36.272408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 450/880] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:36 2022] GET /identity/v3/role_assignments?user.id=f75f5e28008b4189b5feb6438bdf1852&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b9998a2301454764ae06a0f743463c5d => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:36.273197 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279041f2-b232-48f9-8df8-af4f5858beb9 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:36.284792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:36.353699 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9145264-b08c-4415-8fe9-06d0daf10a17 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:36.402719 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279041f2-b232-48f9-8df8-af4f5858beb9 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:36.407868 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119196c-c100-4035-862f-320a86e6eb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:36.409020 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119196c-c100-4035-862f-320a86e6eb64 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:36.409452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119196c-c100-4035-862f-320a86e6eb64 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:36.409870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119196c-c100-4035-862f-320a86e6eb64 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:36.410746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119196c-c100-4035-862f-320a86e6eb64 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:36.413097 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119196c-c100-4035-862f-320a86e6eb64 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-9119196c-c100-4035-862f-320a86e6eb64 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:36.430037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:36.431339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:36.432392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:36.432392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:36.432392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:36.432392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:36.432392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:36.432392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:36.432392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:36.432392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:36.432392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:36.432392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:36.432392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:36.432392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:36.432392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 03:36:36.432392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:36.435845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 431/881] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:36:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:36.441732 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119196c-c100-4035-862f-320a86e6eb64 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:36.451635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb5d6c-7687-4b45-a9d1-bf3176e91c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:36.452473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb5d6c-7687-4b45-a9d1-bf3176e91c06 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:36.452757 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb5d6c-7687-4b45-a9d1-bf3176e91c06 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:36.453038 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb5d6c-7687-4b45-a9d1-bf3176e91c06 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:36.453708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb5d6c-7687-4b45-a9d1-bf3176e91c06 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:36.455251 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb5d6c-7687-4b45-a9d1-bf3176e91c06 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-7acb5d6c-7687-4b45-a9d1-bf3176e91c06 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:36.470689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:36.472123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:36.473102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 451/882] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 03:36:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:36.478510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb5d6c-7687-4b45-a9d1-bf3176e91c06 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:36.555439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:36.568788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:36.582705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119196c-c100-4035-862f-320a86e6eb64 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:36.602806 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb5d6c-7687-4b45-a9d1-bf3176e91c06 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:36.620928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e5523-a61d-41ab-a18b-d30b2500abb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:36.621974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e5523-a61d-41ab-a18b-d30b2500abb8 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:36.622452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e5523-a61d-41ab-a18b-d30b2500abb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:36.622970 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e5523-a61d-41ab-a18b-d30b2500abb8 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:36.623881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e5523-a61d-41ab-a18b-d30b2500abb8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:36.624417 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e5523-a61d-41ab-a18b-d30b2500abb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:36.625993 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e5523-a61d-41ab-a18b-d30b2500abb8 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:36.631804 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 432/883] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:36:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:36.636983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e5523-a61d-41ab-a18b-d30b2500abb8 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:36.647293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e36133-f8ec-4294-afeb-c063978e8bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:36.648751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e36133-f8ec-4294-afeb-c063978e8bd3 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:36.649235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e36133-f8ec-4294-afeb-c063978e8bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:36.649957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e36133-f8ec-4294-afeb-c063978e8bd3 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:36.651214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e36133-f8ec-4294-afeb-c063978e8bd3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:36.651698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e36133-f8ec-4294-afeb-c063978e8bd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:36.653824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e36133-f8ec-4294-afeb-c063978e8bd3 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:36.660733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 452/884] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 03:36:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:36.666150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e36133-f8ec-4294-afeb-c063978e8bd3 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:36.759619 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e5523-a61d-41ab-a18b-d30b2500abb8 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:36.789646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e36133-f8ec-4294-afeb-c063978e8bd3 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:36.796343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6fce5-875c-4bd9-bc9a-3796746a1414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:36.797384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6fce5-875c-4bd9-bc9a-3796746a1414 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:36.797885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6fce5-875c-4bd9-bc9a-3796746a1414 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:36.798360 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6fce5-875c-4bd9-bc9a-3796746a1414 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:36.799398 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6fce5-875c-4bd9-bc9a-3796746a1414 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:36.800049 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6fce5-875c-4bd9-bc9a-3796746a1414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:36.801991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6fce5-875c-4bd9-bc9a-3796746a1414 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:36.813007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 433/885] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:36:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:36.814225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6fce5-875c-4bd9-bc9a-3796746a1414 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:36.820093 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:36.825483 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e9199-8246-4891-82a2-9b7cc6aa3f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:36.826963 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9199-8246-4891-82a2-9b7cc6aa3f20 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:36.827148 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9199-8246-4891-82a2-9b7cc6aa3f20 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:36.827394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9199-8246-4891-82a2-9b7cc6aa3f20 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:36.828572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e9199-8246-4891-82a2-9b7cc6aa3f20 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:36.829268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e9199-8246-4891-82a2-9b7cc6aa3f20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:36.830876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e9199-8246-4891-82a2-9b7cc6aa3f20 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:36.842624 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 453/886] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 03:36:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:36.848347 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:36.950688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6fce5-875c-4bd9-bc9a-3796746a1414 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:36.987763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a403290-0c37-438b-9f43-6f4cbb1d017b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:36.988442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a403290-0c37-438b-9f43-6f4cbb1d017b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:36.988778 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a403290-0c37-438b-9f43-6f4cbb1d017b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:36.989054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a403290-0c37-438b-9f43-6f4cbb1d017b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:36.989864 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a403290-0c37-438b-9f43-6f4cbb1d017b None admin] RBAC: Adding query filter params (interface=public, service_id=8d5044e3bbc24f209dd1d218ceb986c4, region_id=RegionOne) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:36.990176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a403290-0c37-438b-9f43-6f4cbb1d017b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:36.991612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a403290-0c37-438b-9f43-6f4cbb1d017b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:36.997810 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 434/887] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 03:36:36 2022] GET /identity/v3/endpoints?service_id=8d5044e3bbc24f209dd1d218ceb986c4&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:37.003916 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e9199-8246-4891-82a2-9b7cc6aa3f20 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:37.123712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e9199-8246-4891-82a2-9b7cc6aa3f20 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:37.159912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692b67a-e863-425a-b02d-fc78b57c524a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:37.161014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692b67a-e863-425a-b02d-fc78b57c524a None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:37.161490 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692b67a-e863-425a-b02d-fc78b57c524a None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:37.161962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692b67a-e863-425a-b02d-fc78b57c524a None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:37.162969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692b67a-e863-425a-b02d-fc78b57c524a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:37.164547 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692b67a-e863-425a-b02d-fc78b57c524a None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:37.170893 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 454/888] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 03:36:37 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:36:38.046840 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eefd6-3770-4ecc-b45e-36c2df2ff822 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:38.047742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eefd6-3770-4ecc-b45e-36c2df2ff822 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:38.048022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eefd6-3770-4ecc-b45e-36c2df2ff822 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:38.049835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 435/889] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:38.056011 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c06c5-10ed-470f-8617-08a85cdaa479 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:38.056910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c06c5-10ed-470f-8617-08a85cdaa479 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:38.057381 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c06c5-10ed-470f-8617-08a85cdaa479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:38.075059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-dd9c06c5-10ed-470f-8617-08a85cdaa479 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:38.076545 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-dd9c06c5-10ed-470f-8617-08a85cdaa479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:38.134037 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:38.147120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 455/890] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:36:38.170322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eefd6-3770-4ecc-b45e-36c2df2ff822 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:38.258024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:38.277218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eefd6-3770-4ecc-b45e-36c2df2ff822 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:38.312258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d347fa1-f6a9-4c32-a792-6c2613293ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:38.313084 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d347fa1-f6a9-4c32-a792-6c2613293ece None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:38.313362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d347fa1-f6a9-4c32-a792-6c2613293ece None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:38.313632 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d347fa1-f6a9-4c32-a792-6c2613293ece None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:38.314282 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d347fa1-f6a9-4c32-a792-6c2613293ece None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:38.315693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d347fa1-f6a9-4c32-a792-6c2613293ece None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-8d347fa1-f6a9-4c32-a792-6c2613293ece None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:38.328338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:38.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:38.330156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 436/891] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Jun 30 03:36:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:38.336319 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c06c5-10ed-470f-8617-08a85cdaa479 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:38.442883 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c06c5-10ed-470f-8617-08a85cdaa479 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:38.477429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ed6ac-b757-46e8-9a2e-91f8b3d71a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:38.478103 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ed6ac-b757-46e8-9a2e-91f8b3d71a2d None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:38.478388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ed6ac-b757-46e8-9a2e-91f8b3d71a2d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:38.478661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ed6ac-b757-46e8-9a2e-91f8b3d71a2d None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:38.479407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ed6ac-b757-46e8-9a2e-91f8b3d71a2d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:38.479713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ed6ac-b757-46e8-9a2e-91f8b3d71a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:38.481083 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ed6ac-b757-46e8-9a2e-91f8b3d71a2d None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:38.486303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 456/892] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 03:36:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:38.492367 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d347fa1-f6a9-4c32-a792-6c2613293ece None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:38.550442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39571a-394f-4ad2-b01d-a3f5990d2dcb None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:38.551570 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39571a-394f-4ad2-b01d-a3f5990d2dcb None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:38.552304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39571a-394f-4ad2-b01d-a3f5990d2dcb None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:38.555232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 457/893] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:36:38.560845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9358c66-dbf5-4cd4-b06f-ff74108a51d3 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:38.561281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9358c66-dbf5-4cd4-b06f-ff74108a51d3 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:38.561707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9358c66-dbf5-4cd4-b06f-ff74108a51d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:38.579111 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e9358c66-dbf5-4cd4-b06f-ff74108a51d3 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:38.580598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e9358c66-dbf5-4cd4-b06f-ff74108a51d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:38.604677 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d347fa1-f6a9-4c32-a792-6c2613293ece None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:38.641085 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:38.644265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf172cb-3251-43fa-8376-d9b8edcf4c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:38.645259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf172cb-3251-43fa-8376-d9b8edcf4c56 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:38.645994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf172cb-3251-43fa-8376-d9b8edcf4c56 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:38.646340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf172cb-3251-43fa-8376-d9b8edcf4c56 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:38.647245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf172cb-3251-43fa-8376-d9b8edcf4c56 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:38.647660 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf172cb-3251-43fa-8376-d9b8edcf4c56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:38.650044 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf172cb-3251-43fa-8376-d9b8edcf4c56 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:38.660721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 437/894] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 03:36:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:38.663007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf172cb-3251-43fa-8376-d9b8edcf4c56 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:38.665979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 458/895] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:36:38.679639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:38.690121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9358c66-dbf5-4cd4-b06f-ff74108a51d3 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:38.776769 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf172cb-3251-43fa-8376-d9b8edcf4c56 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:38.797376 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9358c66-dbf5-4cd4-b06f-ff74108a51d3 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:38.813006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cea1d-ed22-46c3-8325-f6cfe374c92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:38.813999 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cea1d-ed22-46c3-8325-f6cfe374c92a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:38.814473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cea1d-ed22-46c3-8325-f6cfe374c92a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:38.815004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cea1d-ed22-46c3-8325-f6cfe374c92a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:38.816005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cea1d-ed22-46c3-8325-f6cfe374c92a None admin] RBAC: Adding query filter params (interface=public, service_id=6fc668f2c08c4d2b8ad923c6c2449419, region_id=RegionOne) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:38.816612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cea1d-ed22-46c3-8325-f6cfe374c92a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:38.818265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cea1d-ed22-46c3-8325-f6cfe374c92a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:38.829075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 438/896] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 03:36:38 2022] GET /identity/v3/endpoints?service_id=6fc668f2c08c4d2b8ad923c6c2449419&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:38.830487 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cea1d-ed22-46c3-8325-f6cfe374c92a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:38.832754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27fd5c-d209-4a4e-959b-2a34880a12f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:38.833575 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fd5c-d209-4a4e-959b-2a34880a12f9 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:38.833853 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fd5c-d209-4a4e-959b-2a34880a12f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:38.834128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fd5c-d209-4a4e-959b-2a34880a12f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:38.845640 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27fd5c-d209-4a4e-959b-2a34880a12f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-8c27fd5c-d209-4a4e-959b-2a34880a12f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:38.856542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:38.857518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:38.858387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:38.858387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:38.858387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:38.858387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:38.858387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:38.858387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:38.858387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:38.858387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:38.858387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:38.858387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:38.858387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 03:36:38.858387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:38.862756 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 459/897] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 30 03:36:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:38.863817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27fd5c-d209-4a4e-959b-2a34880a12f9 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:38.915323 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:38.918542 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:38.947125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cea1d-ed22-46c3-8325-f6cfe374c92a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:38.973913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27fd5c-d209-4a4e-959b-2a34880a12f9 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:38.983774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce465ef4-7e88-4e78-961a-1000a4cac7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:38.984709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465ef4-7e88-4e78-961a-1000a4cac7c1 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:38.985140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465ef4-7e88-4e78-961a-1000a4cac7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:38.985623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465ef4-7e88-4e78-961a-1000a4cac7c1 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:38.986591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce465ef4-7e88-4e78-961a-1000a4cac7c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:38.988260 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce465ef4-7e88-4e78-961a-1000a4cac7c1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:38.999155 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 439/898] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 03:36:38 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:36:39.010567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a305dce-f5c3-446d-addd-8928b167a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:39.011305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a305dce-f5c3-446d-addd-8928b167a184 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:39.011586 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a305dce-f5c3-446d-addd-8928b167a184 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:39.011860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a305dce-f5c3-446d-addd-8928b167a184 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:39.012624 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a305dce-f5c3-446d-addd-8928b167a184 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:39.012929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a305dce-f5c3-446d-addd-8928b167a184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:39.014344 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a305dce-f5c3-446d-addd-8928b167a184 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:39.024695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 460/899] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 30 03:36:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:39.030523 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce465ef4-7e88-4e78-961a-1000a4cac7c1 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:39.043249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e32968-e033-42a9-899f-5ab3eb5376be None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:39.043526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e32968-e033-42a9-899f-5ab3eb5376be None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:39.043804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e32968-e033-42a9-899f-5ab3eb5376be None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:39.045332 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 461/900] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:39.050509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b3d28-35a4-4b57-9d97-0cb7b7306272 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:39.052184 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b3d28-35a4-4b57-9d97-0cb7b7306272 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:39.054279 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b3d28-35a4-4b57-9d97-0cb7b7306272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:39.073610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-268b3d28-35a4-4b57-9d97-0cb7b7306272 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:39.075705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-268b3d28-35a4-4b57-9d97-0cb7b7306272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:39.151196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 462/901] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:36:39.155644 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce465ef4-7e88-4e78-961a-1000a4cac7c1 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:39.178341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b3d28-35a4-4b57-9d97-0cb7b7306272 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:39.194063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c3153-8533-49a2-a847-4402d70525c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:39.195545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c3153-8533-49a2-a847-4402d70525c9 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:39.195545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c3153-8533-49a2-a847-4402d70525c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:39.195545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c3153-8533-49a2-a847-4402d70525c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:39.204898 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:39.210430 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c3153-8533-49a2-a847-4402d70525c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:39.212066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c3153-8533-49a2-a847-4402d70525c9 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-664c3153-8533-49a2-a847-4402d70525c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:39.230556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:39.231634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:39.232524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:39.232524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:39.232524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:39.232524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:39.232524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 440/902] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:39.237738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c3153-8533-49a2-a847-4402d70525c9 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:39.251184 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:39.319569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b3d28-35a4-4b57-9d97-0cb7b7306272 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:39.344836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c3153-8533-49a2-a847-4402d70525c9 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:39.357568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fdd01-1e83-47f4-97ad-e3936e8edbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:39.358238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fdd01-1e83-47f4-97ad-e3936e8edbd4 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:39.358516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fdd01-1e83-47f4-97ad-e3936e8edbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:39.358812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fdd01-1e83-47f4-97ad-e3936e8edbd4 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:39.359536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fdd01-1e83-47f4-97ad-e3936e8edbd4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:39.360893 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fdd01-1e83-47f4-97ad-e3936e8edbd4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:39.378119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 463/903] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 03:36:39 2022] POST /identity/v3/services => generated 241 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:36:39.380685 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5278f-70d8-4d2b-87d6-d1570ee76342 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:39.381052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5278f-70d8-4d2b-87d6-d1570ee76342 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:39.381400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5278f-70d8-4d2b-87d6-d1570ee76342 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:39.383033 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 464/904] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:39.388834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96cbbd-ac33-417f-8c19-a73f6b30ae01 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:39.389138 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96cbbd-ac33-417f-8c19-a73f6b30ae01 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:39.389389 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96cbbd-ac33-417f-8c19-a73f6b30ae01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:39.392958 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4f13c-a8a5-450a-b69c-4bbff095ba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:39.394044 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4f13c-a8a5-450a-b69c-4bbff095ba0d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:39.394571 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4f13c-a8a5-450a-b69c-4bbff095ba0d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:39.394979 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4f13c-a8a5-450a-b69c-4bbff095ba0d None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:39.395914 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4f13c-a8a5-450a-b69c-4bbff095ba0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:39.396324 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4f13c-a8a5-450a-b69c-4bbff095ba0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:39.397842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4f13c-a8a5-450a-b69c-4bbff095ba0d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:39.408655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-ce96cbbd-ac33-417f-8c19-a73f6b30ae01 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:39.410310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ce96cbbd-ac33-417f-8c19-a73f6b30ae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:39.417085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 441/905] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:39.418229 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4f13c-a8a5-450a-b69c-4bbff095ba0d None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:39.475364 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:39.519028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 465/906] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:39.536488 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96cbbd-ac33-417f-8c19-a73f6b30ae01 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:39.543892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4f13c-a8a5-450a-b69c-4bbff095ba0d None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:39.572927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:39.588411 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eaabce-8c76-4fc7-a0a9-8f67e1eeeb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:39.589241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaabce-8c76-4fc7-a0a9-8f67e1eeeb64 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:39.589524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaabce-8c76-4fc7-a0a9-8f67e1eeeb64 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:39.589806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaabce-8c76-4fc7-a0a9-8f67e1eeeb64 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:39.598067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eaabce-8c76-4fc7-a0a9-8f67e1eeeb64 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:39.599585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eaabce-8c76-4fc7-a0a9-8f67e1eeeb64 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-b7eaabce-8c76-4fc7-a0a9-8f67e1eeeb64 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:39.615277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:39.616253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:39.617385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:39.617385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:39.617385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:39.617385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:39.617385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:39.617385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:39.617385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:39.617385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:39.617385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 03:36:39.617385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:39.617385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 442/907] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 03:36:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:39.622384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eaabce-8c76-4fc7-a0a9-8f67e1eeeb64 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:39.659688 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96cbbd-ac33-417f-8c19-a73f6b30ae01 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:39.695604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948e8ca-e0cb-495e-b6e7-ac5c71bebaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:39.696422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948e8ca-e0cb-495e-b6e7-ac5c71bebaa8 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:39.696702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948e8ca-e0cb-495e-b6e7-ac5c71bebaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:39.696977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948e8ca-e0cb-495e-b6e7-ac5c71bebaa8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:39.697645 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948e8ca-e0cb-495e-b6e7-ac5c71bebaa8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:39.699050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948e8ca-e0cb-495e-b6e7-ac5c71bebaa8 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-c948e8ca-e0cb-495e-b6e7-ac5c71bebaa8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:39.711392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:39.712462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:39.713287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:39.713287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:39.713287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:39.713287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:39.713287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:39.713287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:39.713287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:39.713287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:39.713287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:39.713287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:39.713287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:39.713287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:39.713287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 03:36:39.713287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:39.717573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 466/908] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:36:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:39.718867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948e8ca-e0cb-495e-b6e7-ac5c71bebaa8 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:39.753891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eaabce-8c76-4fc7-a0a9-8f67e1eeeb64 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:39.765177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:39.797359 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62e4e9-b752-4b09-938e-9e0105eb88c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:39.798211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62e4e9-b752-4b09-938e-9e0105eb88c7 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:39.798592 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62e4e9-b752-4b09-938e-9e0105eb88c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:39.798990 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62e4e9-b752-4b09-938e-9e0105eb88c7 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:39.800113 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62e4e9-b752-4b09-938e-9e0105eb88c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:39.800508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62e4e9-b752-4b09-938e-9e0105eb88c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:39.802655 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62e4e9-b752-4b09-938e-9e0105eb88c7 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:39.828452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 443/909] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 30 03:36:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:39.833706 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62e4e9-b752-4b09-938e-9e0105eb88c7 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:39.835225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:39.848234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948e8ca-e0cb-495e-b6e7-ac5c71bebaa8 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:39.896019 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9d06e-3102-40c3-9270-ea44e2e43684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:39.896641 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9d06e-3102-40c3-9270-ea44e2e43684 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:39.896927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9d06e-3102-40c3-9270-ea44e2e43684 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:39.897198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9d06e-3102-40c3-9270-ea44e2e43684 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:39.897905 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9d06e-3102-40c3-9270-ea44e2e43684 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:39.898211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9d06e-3102-40c3-9270-ea44e2e43684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:39.899731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9d06e-3102-40c3-9270-ea44e2e43684 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:39.904982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 467/910] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:36:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:39.910419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9d06e-3102-40c3-9270-ea44e2e43684 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:39.965024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62e4e9-b752-4b09-938e-9e0105eb88c7 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:40.010971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f798536-4138-469b-a90f-f77439e7d235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:40.011872 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f798536-4138-469b-a90f-f77439e7d235 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:40.012157 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f798536-4138-469b-a90f-f77439e7d235 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:40.012432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f798536-4138-469b-a90f-f77439e7d235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:40.021945 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9d06e-3102-40c3-9270-ea44e2e43684 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:40.054703 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:40.059314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe115be1-b210-4eaf-b9e3-045486d52491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:40.060996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe115be1-b210-4eaf-b9e3-045486d52491 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:40.061483 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe115be1-b210-4eaf-b9e3-045486d52491 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:40.061930 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe115be1-b210-4eaf-b9e3-045486d52491 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:40.062862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe115be1-b210-4eaf-b9e3-045486d52491 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:40.063399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe115be1-b210-4eaf-b9e3-045486d52491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:40.065088 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe115be1-b210-4eaf-b9e3-045486d52491 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:40.071133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 468/911] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 03:36:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:40.077422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe115be1-b210-4eaf-b9e3-045486d52491 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:40.101267 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f798536-4138-469b-a90f-f77439e7d235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:40.102154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:40.103181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f798536-4138-469b-a90f-f77439e7d235 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:40.189969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe115be1-b210-4eaf-b9e3-045486d52491 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:40.209810 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 444/912] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:39 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 03:36:40.215233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f798536-4138-469b-a90f-f77439e7d235 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:40.226750 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90de6a-dc02-45be-8967-1cc8a5bf3fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:40.227593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90de6a-dc02-45be-8967-1cc8a5bf3fb8 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:40.227998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90de6a-dc02-45be-8967-1cc8a5bf3fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:40.228452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90de6a-dc02-45be-8967-1cc8a5bf3fb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:40.229557 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90de6a-dc02-45be-8967-1cc8a5bf3fb8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:40.230790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90de6a-dc02-45be-8967-1cc8a5bf3fb8 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:40.262932 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 469/913] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 03:36:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:36:40.290378 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:40.337881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f798536-4138-469b-a90f-f77439e7d235 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:40.382516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1bd09-95a8-403c-9cf2-110ce7bb95d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:40.383633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1bd09-95a8-403c-9cf2-110ce7bb95d4 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:40.384066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1bd09-95a8-403c-9cf2-110ce7bb95d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:40.384475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1bd09-95a8-403c-9cf2-110ce7bb95d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:40.396608 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1bd09-95a8-403c-9cf2-110ce7bb95d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:40.398339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1bd09-95a8-403c-9cf2-110ce7bb95d4 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-a1a1bd09-95a8-403c-9cf2-110ce7bb95d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:40.418094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:40.419208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:40.420124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:40.420124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:40.420124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:40.420124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:40.420582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 445/914] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:40.426789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90de6a-dc02-45be-8967-1cc8a5bf3fb8 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:40.509844 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:40.537847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90de6a-dc02-45be-8967-1cc8a5bf3fb8 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:40.574106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef8305-b62b-4029-95dc-0d60cbeb07b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:40.574794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef8305-b62b-4029-95dc-0d60cbeb07b6 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:40.575084 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef8305-b62b-4029-95dc-0d60cbeb07b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:40.575357 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef8305-b62b-4029-95dc-0d60cbeb07b6 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:40.576090 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef8305-b62b-4029-95dc-0d60cbeb07b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:40.576399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef8305-b62b-4029-95dc-0d60cbeb07b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:40.577782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef8305-b62b-4029-95dc-0d60cbeb07b6 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:40.591178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 470/915] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:40.596820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1bd09-95a8-403c-9cf2-110ce7bb95d4 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:40.704568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1bd09-95a8-403c-9cf2-110ce7bb95d4 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:40.718854 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:40.740315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415f184-6d68-4f25-a715-9136fa805030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:40.741129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f184-6d68-4f25-a715-9136fa805030 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:40.741407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f184-6d68-4f25-a715-9136fa805030 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:40.741676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f184-6d68-4f25-a715-9136fa805030 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:40.748817 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415f184-6d68-4f25-a715-9136fa805030 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:40.750284 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415f184-6d68-4f25-a715-9136fa805030 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-1415f184-6d68-4f25-a715-9136fa805030 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:40.764394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:40.765349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:40.766696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:40.766696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:40.766696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:40.766696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:40.766696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:40.766696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:40.766696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:40.766696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:40.766696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 446/916] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:40.771629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef8305-b62b-4029-95dc-0d60cbeb07b6 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:40.882245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef8305-b62b-4029-95dc-0d60cbeb07b6 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:40.916952 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39031946-372e-4713-af4d-43063e8236ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:40.917619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39031946-372e-4713-af4d-43063e8236ec None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:40.917896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39031946-372e-4713-af4d-43063e8236ec None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:40.918169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39031946-372e-4713-af4d-43063e8236ec None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:40.918991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39031946-372e-4713-af4d-43063e8236ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:40.919299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39031946-372e-4713-af4d-43063e8236ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:40.920759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39031946-372e-4713-af4d-43063e8236ec None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:40.922522 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:40.934554 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 471/917] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:40.940495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415f184-6d68-4f25-a715-9136fa805030 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:41.048451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415f184-6d68-4f25-a715-9136fa805030 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:41.083412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebab3c-3ff9-4596-8152-566b51cf86f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:41.084469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebab3c-3ff9-4596-8152-566b51cf86f6 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:41.084947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebab3c-3ff9-4596-8152-566b51cf86f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:41.085438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebab3c-3ff9-4596-8152-566b51cf86f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:41.086477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebab3c-3ff9-4596-8152-566b51cf86f6 None admin] RBAC: Adding query filter params (role.id=b0a7381e3ca64076bf748e6c394483ca, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=f75f5e28008b4189b5feb6438bdf1852) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:41.087010 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebab3c-3ff9-4596-8152-566b51cf86f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:41.088651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebab3c-3ff9-4596-8152-566b51cf86f6 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:41.095129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 447/918] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:40 2022] GET /identity/v3/role_assignments?user.id=f75f5e28008b4189b5feb6438bdf1852&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b0a7381e3ca64076bf748e6c394483ca => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:41.175677 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc70a3-69a4-490f-b210-cd2843969bd4 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:41.176206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc70a3-69a4-490f-b210-cd2843969bd4 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:41.176435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc70a3-69a4-490f-b210-cd2843969bd4 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:41.178065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 472/919] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:41.183497 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc0632-33bf-4ded-9220-4761d21b6dd4 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:41.184130 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc0632-33bf-4ded-9220-4761d21b6dd4 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:41.184605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc0632-33bf-4ded-9220-4761d21b6dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:41.203134 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-1fdc0632-33bf-4ded-9220-4761d21b6dd4 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:41.204694 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-1fdc0632-33bf-4ded-9220-4761d21b6dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:41.238311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:41.281245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 448/920] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:41.304788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc70a3-69a4-490f-b210-cd2843969bd4 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:41.413257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc70a3-69a4-490f-b210-cd2843969bd4 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:41.451536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e5abc-a6c3-44b8-98cf-3cd884e3632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:41.452357 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5abc-a6c3-44b8-98cf-3cd884e3632f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:41.452639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5abc-a6c3-44b8-98cf-3cd884e3632f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:41.452906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5abc-a6c3-44b8-98cf-3cd884e3632f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:41.453684 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e5abc-a6c3-44b8-98cf-3cd884e3632f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:41.455243 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e5abc-a6c3-44b8-98cf-3cd884e3632f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-188e5abc-a6c3-44b8-98cf-3cd884e3632f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:41.472404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:41.473536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:41.474379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 473/921] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Jun 30 03:36:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:41.482104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc0632-33bf-4ded-9220-4761d21b6dd4 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:41.581555 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a02ec0-5344-4f87-8810-e4338b58db7e None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:41.581757 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a02ec0-5344-4f87-8810-e4338b58db7e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:41.582104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a02ec0-5344-4f87-8810-e4338b58db7e None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:41.583824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 474/922] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:36:41.586599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc0632-33bf-4ded-9220-4761d21b6dd4 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:41.588867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfea33-5f03-4021-a6e2-2f1da258cf80 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:41.589154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfea33-5f03-4021-a6e2-2f1da258cf80 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:41.589429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfea33-5f03-4021-a6e2-2f1da258cf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:41.607481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-98cfea33-5f03-4021-a6e2-2f1da258cf80 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:41.608657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-98cfea33-5f03-4021-a6e2-2f1da258cf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:41.623608 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23cb2f-bdce-4461-a6bd-a6d8315dde5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:41.624526 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23cb2f-bdce-4461-a6bd-a6d8315dde5f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:41.624952 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23cb2f-bdce-4461-a6bd-a6d8315dde5f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:41.625367 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23cb2f-bdce-4461-a6bd-a6d8315dde5f None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:41.626221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23cb2f-bdce-4461-a6bd-a6d8315dde5f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:41.626684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23cb2f-bdce-4461-a6bd-a6d8315dde5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:41.628249 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23cb2f-bdce-4461-a6bd-a6d8315dde5f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:41.633983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 449/923] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 03:36:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:41.639744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23cb2f-bdce-4461-a6bd-a6d8315dde5f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:41.670891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:41.680536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:41.706320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 475/924] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:36:41.727962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfea33-5f03-4021-a6e2-2f1da258cf80 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:41.757326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23cb2f-bdce-4461-a6bd-a6d8315dde5f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:41.798907 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9199331-a6fa-4921-9218-41d5e742472e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:41.799879 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9199331-a6fa-4921-9218-41d5e742472e None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:41.800440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9199331-a6fa-4921-9218-41d5e742472e None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:41.801036 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9199331-a6fa-4921-9218-41d5e742472e None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:41.801947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9199331-a6fa-4921-9218-41d5e742472e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:41.802357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9199331-a6fa-4921-9218-41d5e742472e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:41.803956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9199331-a6fa-4921-9218-41d5e742472e None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:41.809441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 450/925] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 03:36:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:41.814734 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9199331-a6fa-4921-9218-41d5e742472e None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:41.865782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfea33-5f03-4021-a6e2-2f1da258cf80 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:41.908939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920bd5f-78b3-4242-82da-122713d3b3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:41.910290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920bd5f-78b3-4242-82da-122713d3b3d5 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:41.911048 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920bd5f-78b3-4242-82da-122713d3b3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:41.911517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920bd5f-78b3-4242-82da-122713d3b3d5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:41.912364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920bd5f-78b3-4242-82da-122713d3b3d5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:41.914134 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920bd5f-78b3-4242-82da-122713d3b3d5 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:41.922454 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-4920bd5f-78b3-4242-82da-122713d3b3d5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:41.928298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:41.929295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:41.930133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:41.930133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:41.930133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:41.930133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:41.930133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:41.930133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:41.930133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:41.930133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:41.930133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:41.930133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:41.930133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:41.930133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:41.930133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:41.930133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:41.931006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9199331-a6fa-4921-9218-41d5e742472e None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:41.933197 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 476/926] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 03:36:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:41.944829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920bd5f-78b3-4242-82da-122713d3b3d5 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:41.966404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8f5ee-7eb7-4078-aba1-9d1d831e52c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:41.967107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8f5ee-7eb7-4078-aba1-9d1d831e52c0 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:41.967389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8f5ee-7eb7-4078-aba1-9d1d831e52c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:41.967670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8f5ee-7eb7-4078-aba1-9d1d831e52c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:41.968418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8f5ee-7eb7-4078-aba1-9d1d831e52c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:41.969806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8f5ee-7eb7-4078-aba1-9d1d831e52c0 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:41.998862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 451/927] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 03:36:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:36:42.019978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:42.103384 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920bd5f-78b3-4242-82da-122713d3b3d5 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:42.150603 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160a45a-cc99-4fc3-8718-9bb015b99dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:42.151475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160a45a-cc99-4fc3-8718-9bb015b99dab None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:42.151767 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160a45a-cc99-4fc3-8718-9bb015b99dab None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:42.152048 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160a45a-cc99-4fc3-8718-9bb015b99dab None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:42.152818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160a45a-cc99-4fc3-8718-9bb015b99dab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:42.153135 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160a45a-cc99-4fc3-8718-9bb015b99dab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:42.154705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160a45a-cc99-4fc3-8718-9bb015b99dab None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:42.161692 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 477/928] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 03:36:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:42.167725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8f5ee-7eb7-4078-aba1-9d1d831e52c0 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:42.283509 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8f5ee-7eb7-4078-aba1-9d1d831e52c0 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:42.320993 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d1641-70ad-4619-be5e-aeaa2a86e0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:42.321688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d1641-70ad-4619-be5e-aeaa2a86e0e7 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:42.321984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d1641-70ad-4619-be5e-aeaa2a86e0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:42.322237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d1641-70ad-4619-be5e-aeaa2a86e0e7 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:42.323017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d1641-70ad-4619-be5e-aeaa2a86e0e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:42.323333 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d1641-70ad-4619-be5e-aeaa2a86e0e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:42.324736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d1641-70ad-4619-be5e-aeaa2a86e0e7 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:42.330591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 452/929] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 03:36:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:42.337245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160a45a-cc99-4fc3-8718-9bb015b99dab None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:42.445085 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160a45a-cc99-4fc3-8718-9bb015b99dab None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:42.459023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:42.474962 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f978c-4743-4ef8-88b7-63a9c9894a58 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:42.475582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f978c-4743-4ef8-88b7-63a9c9894a58 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:42.475872 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f978c-4743-4ef8-88b7-63a9c9894a58 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:42.477894 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 453/930] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:42.486513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf3c65-bfec-4c30-b627-c5cd9f1d813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:42.486686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bd62d-910b-4530-9ced-633e99e4c436 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:42.487045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bd62d-910b-4530-9ced-633e99e4c436 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:42.487207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf3c65-bfec-4c30-b627-c5cd9f1d813d None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:42.487493 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf3c65-bfec-4c30-b627-c5cd9f1d813d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:42.487606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bd62d-910b-4530-9ced-633e99e4c436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:42.487762 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf3c65-bfec-4c30-b627-c5cd9f1d813d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:42.488808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf3c65-bfec-4c30-b627-c5cd9f1d813d None admin] RBAC: Adding query filter params (interface=public, service_id=aacbef143dd849269e90517bc6cdd656, region_id=RegionOne) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:42.489357 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf3c65-bfec-4c30-b627-c5cd9f1d813d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:42.491228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf3c65-bfec-4c30-b627-c5cd9f1d813d None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:42.497006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 478/931] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 03:36:42 2022] GET /identity/v3/endpoints?service_id=aacbef143dd849269e90517bc6cdd656&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:42.504321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf3c65-bfec-4c30-b627-c5cd9f1d813d None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:42.514823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ac6bd62d-910b-4530-9ced-633e99e4c436 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:42.516481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ac6bd62d-910b-4530-9ced-633e99e4c436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:42.529872 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:42.609445 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 454/932] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:42.624431 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf3c65-bfec-4c30-b627-c5cd9f1d813d None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:42.629589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bd62d-910b-4530-9ced-633e99e4c436 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:42.673271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60722531-22bb-49e3-8ae6-a8cc0b772cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:42.673976 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60722531-22bb-49e3-8ae6-a8cc0b772cae None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:42.674257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60722531-22bb-49e3-8ae6-a8cc0b772cae None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:42.674531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60722531-22bb-49e3-8ae6-a8cc0b772cae None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:42.675263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60722531-22bb-49e3-8ae6-a8cc0b772cae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:42.676951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60722531-22bb-49e3-8ae6-a8cc0b772cae None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:42.686807 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 479/933] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 03:36:42 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:36:42.754586 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bd62d-910b-4530-9ced-633e99e4c436 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:42.794104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a0984-09d7-4b60-8248-65016e37dca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:42.795177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a0984-09d7-4b60-8248-65016e37dca7 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:42.795657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a0984-09d7-4b60-8248-65016e37dca7 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:42.796112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a0984-09d7-4b60-8248-65016e37dca7 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:42.797026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a0984-09d7-4b60-8248-65016e37dca7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:42.798793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a0984-09d7-4b60-8248-65016e37dca7 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:42.800495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: WARNING keystone.server.flask.common [None req-9d3a0984-09d7-4b60-8248-65016e37dca7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 30 03:36:42.817085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:42.824090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.sql.core [None req-9d3a0984-09d7-4b60-8248-65016e37dca7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 03:36:42.824090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 30 03:36:42.824090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [parameters: {'id': 'c5153de1a05d4a76a4f53fbd346f7080', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 30 03:36:42.824090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87039) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 03:36:42.834103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-9d3a0984-09d7-4b60-8248-65016e37dca7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c5153de1a05d4a76a4f53fbd346f7080.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c5153de1a05d4a76a4f53fbd346f7080. Jun 30 03:36:42.834103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:42.834103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 03:36:42.834103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 03:36:42.834103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 03:36:42.834103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 03:36:42.834103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 03:36:42.834103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 03:36:42.834103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 03:36:42.834103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application conn.query(q) Jun 30 03:36:42.834103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 03:36:42.834103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 03:36:42.834103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application result.read() Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 30 03:36:42.835061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application next(self.gen) Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application yield resource Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application next(self.gen) Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise self.value Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application session.commit() Jun 30 03:36:42.836039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self.session.flush() Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application compat.raise_( Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 03:36:42.836922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 03:36:42.837842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application conn.query(q) Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application result.read() Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 03:36:42.838639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [parameters: {'id': 'c5153de1a05d4a76a4f53fbd346f7080', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:42.839617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:42.840408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:42.841369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:42.841369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 30 03:36:42.841369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 30 03:36:42.841369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:42.841369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:42.841369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 30 03:36:42.841369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 30 03:36:42.841369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c5153de1a05d4a76a4f53fbd346f7080. Jun 30 03:36:42.841369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:42.844058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 455/934] 10.222.0.26 () {60 vars in 1140 bytes} [Thu Jun 30 03:36:42 2022] POST /identity/v3/projects => generated 262 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:42.850792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60722531-22bb-49e3-8ae6-a8cc0b772cae None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:42.896112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:42.954657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60722531-22bb-49e3-8ae6-a8cc0b772cae None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:42.990098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b1cf2-9b49-424f-9180-038d322e1ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:42.990972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b1cf2-9b49-424f-9180-038d322e1ae4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:42.991250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b1cf2-9b49-424f-9180-038d322e1ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:42.991522 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b1cf2-9b49-424f-9180-038d322e1ae4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:42.998408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b1cf2-9b49-424f-9180-038d322e1ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:42.999942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b1cf2-9b49-424f-9180-038d322e1ae4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-3f7b1cf2-9b49-424f-9180-038d322e1ae4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:43.014432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:43.015395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:43.016350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:43.016350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:43.016350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:43.016350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:43.016350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:43.016350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:43.016350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:43.016350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:43.016350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 480/935] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:43.022116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a0984-09d7-4b60-8248-65016e37dca7 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:43.126300 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a0984-09d7-4b60-8248-65016e37dca7 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:43.161194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba13584-c0a4-4e15-a7a9-8672d5c24ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:43.161874 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba13584-c0a4-4e15-a7a9-8672d5c24ac8 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:43.162156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba13584-c0a4-4e15-a7a9-8672d5c24ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:43.162432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba13584-c0a4-4e15-a7a9-8672d5c24ac8 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:43.163231 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba13584-c0a4-4e15-a7a9-8672d5c24ac8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:43.163536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba13584-c0a4-4e15-a7a9-8672d5c24ac8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:43.165195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba13584-c0a4-4e15-a7a9-8672d5c24ac8 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:43.186161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 456/936] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 03:36:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:43.187498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e45b1-b701-4317-a616-82c30c983efc None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:43.187784 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e45b1-b701-4317-a616-82c30c983efc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:43.188058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e45b1-b701-4317-a616-82c30c983efc None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:43.189533 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 481/937] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:43.196355 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d0bc1-3151-40ee-873b-10642f039056 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:43.196698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d0bc1-3151-40ee-873b-10642f039056 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:43.196885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d0bc1-3151-40ee-873b-10642f039056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:43.216748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-760d0bc1-3151-40ee-873b-10642f039056 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:43.218405 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-760d0bc1-3151-40ee-873b-10642f039056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:43.287773 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:43.299158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 457/938] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:43.323420 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e45b1-b701-4317-a616-82c30c983efc None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:43.435177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:43.440387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e45b1-b701-4317-a616-82c30c983efc None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:43.479722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ecd2e-50c7-4214-95d3-df3791c1a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:43.480557 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ecd2e-50c7-4214-95d3-df3791c1a68c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:43.480838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ecd2e-50c7-4214-95d3-df3791c1a68c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:43.481114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ecd2e-50c7-4214-95d3-df3791c1a68c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:43.492411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ecd2e-50c7-4214-95d3-df3791c1a68c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-553ecd2e-50c7-4214-95d3-df3791c1a68c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:43.500661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:43.501619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:43.502964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:43.502964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:43.502964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:43.502964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:43.502964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:43.502964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:43.502964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:43.502964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:43.502964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:43.502964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:43.502964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 03:36:43.502964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:43.502964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 482/939] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 30 03:36:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:43.508891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d0bc1-3151-40ee-873b-10642f039056 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:43.611572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d0bc1-3151-40ee-873b-10642f039056 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:43.646359 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401e7ce-3968-4cd6-8dfd-37d6fb707d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:43.647073 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401e7ce-3968-4cd6-8dfd-37d6fb707d39 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:43.647354 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401e7ce-3968-4cd6-8dfd-37d6fb707d39 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:43.647627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401e7ce-3968-4cd6-8dfd-37d6fb707d39 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:43.648386 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401e7ce-3968-4cd6-8dfd-37d6fb707d39 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:43.648695 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401e7ce-3968-4cd6-8dfd-37d6fb707d39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:43.650078 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401e7ce-3968-4cd6-8dfd-37d6fb707d39 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:43.659257 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 458/940] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 30 03:36:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:43.665362 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ecd2e-50c7-4214-95d3-df3791c1a68c None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:43.773662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ecd2e-50c7-4214-95d3-df3791c1a68c None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:43.810571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86a7fc-627f-464b-a74a-8196f1c2f422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:43.811783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86a7fc-627f-464b-a74a-8196f1c2f422 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:43.812244 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86a7fc-627f-464b-a74a-8196f1c2f422 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:43.812672 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86a7fc-627f-464b-a74a-8196f1c2f422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:43.825137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86a7fc-627f-464b-a74a-8196f1c2f422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:43.826857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86a7fc-627f-464b-a74a-8196f1c2f422 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-bd86a7fc-627f-464b-a74a-8196f1c2f422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:43.850485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:43.851502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:43.852406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:43.852406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:43.852406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:43.852406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:43.852406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 483/941] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:43.858317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401e7ce-3968-4cd6-8dfd-37d6fb707d39 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:43.919300 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:43.965432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401e7ce-3968-4cd6-8dfd-37d6fb707d39 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:43.999636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85488d51-2e9f-4168-ac23-5f162a96e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:44.000313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85488d51-2e9f-4168-ac23-5f162a96e199 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:44.000594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85488d51-2e9f-4168-ac23-5f162a96e199 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:44.000870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85488d51-2e9f-4168-ac23-5f162a96e199 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:44.001602 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85488d51-2e9f-4168-ac23-5f162a96e199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:44.001956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85488d51-2e9f-4168-ac23-5f162a96e199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:44.003411 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85488d51-2e9f-4168-ac23-5f162a96e199 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:44.020489 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 459/942] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:44.021912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86a7fc-627f-464b-a74a-8196f1c2f422 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:44.043131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:44.128653 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86a7fc-627f-464b-a74a-8196f1c2f422 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:44.157241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d120e3a-e151-4fc0-9536-1b13c63573ab None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:44.157544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d120e3a-e151-4fc0-9536-1b13c63573ab None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:44.157726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d120e3a-e151-4fc0-9536-1b13c63573ab None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:44.159398 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 460/943] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:36:44.164172 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129b99-9420-4d69-9226-ce1e372b1616 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:44.164459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129b99-9420-4d69-9226-ce1e372b1616 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:44.164740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129b99-9420-4d69-9226-ce1e372b1616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:44.167820 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97bbbc-b3d0-4aa9-a21d-d4c7f9666bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:44.168885 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97bbbc-b3d0-4aa9-a21d-d4c7f9666bb6 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:44.169369 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97bbbc-b3d0-4aa9-a21d-d4c7f9666bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:44.170031 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97bbbc-b3d0-4aa9-a21d-d4c7f9666bb6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:44.179880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97bbbc-b3d0-4aa9-a21d-d4c7f9666bb6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:44.181232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-44129b99-9420-4d69-9226-ce1e372b1616 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:44.181840 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97bbbc-b3d0-4aa9-a21d-d4c7f9666bb6 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:44.182423 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-44129b99-9420-4d69-9226-ce1e372b1616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-3c97bbbc-b3d0-4aa9-a21d-d4c7f9666bb6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:44.200527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:44.201510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:44.202471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:44.202471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:44.202471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:44.202471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:44.202471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:44.202471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:44.202471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:44.202471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:44.202471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 03:36:44.202471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:44.208869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 484/944] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 03:36:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:44.211122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97bbbc-b3d0-4aa9-a21d-d4c7f9666bb6 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:44.279039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 461/945] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:36:44.288684 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:44.297712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44129b99-9420-4d69-9226-ce1e372b1616 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:44.326925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97bbbc-b3d0-4aa9-a21d-d4c7f9666bb6 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:44.349120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:44.365741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f76c9a-1239-4f8f-9f69-2ba100a5b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:44.366424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f76c9a-1239-4f8f-9f69-2ba100a5b51c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:44.366704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f76c9a-1239-4f8f-9f69-2ba100a5b51c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:44.367023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f76c9a-1239-4f8f-9f69-2ba100a5b51c None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:44.367979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f76c9a-1239-4f8f-9f69-2ba100a5b51c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:44.368297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f76c9a-1239-4f8f-9f69-2ba100a5b51c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:44.369841 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f76c9a-1239-4f8f-9f69-2ba100a5b51c None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:44.393113 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 485/946] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 30 03:36:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:44.395384 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f76c9a-1239-4f8f-9f69-2ba100a5b51c None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:44.419244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44129b99-9420-4d69-9226-ce1e372b1616 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:44.455638 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b06b4-af5b-43cd-ae7b-e78012b695c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:44.456801 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b06b4-af5b-43cd-ae7b-e78012b695c7 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:44.457179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b06b4-af5b-43cd-ae7b-e78012b695c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:44.458003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b06b4-af5b-43cd-ae7b-e78012b695c7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:44.458802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b06b4-af5b-43cd-ae7b-e78012b695c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:44.460316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b06b4-af5b-43cd-ae7b-e78012b695c7 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-0a8b06b4-af5b-43cd-ae7b-e78012b695c7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:44.478815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:44.479906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:44.480744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:44.480744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:44.480744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:44.480744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:44.480744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:44.480744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:44.480744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:44.480744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:44.480744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:44.480744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:44.480744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:44.480744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:44.480744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 03:36:44.480744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:44.484439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 462/947] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:44.485351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b06b4-af5b-43cd-ae7b-e78012b695c7 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:44.525982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f76c9a-1239-4f8f-9f69-2ba100a5b51c None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:44.564804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:44.574495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69106e0d-3c1c-4779-b162-40cae1feff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:44.575660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69106e0d-3c1c-4779-b162-40cae1feff63 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:44.576135 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69106e0d-3c1c-4779-b162-40cae1feff63 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:44.576611 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69106e0d-3c1c-4779-b162-40cae1feff63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:44.590278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69106e0d-3c1c-4779-b162-40cae1feff63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:44.592265 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69106e0d-3c1c-4779-b162-40cae1feff63 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:44.606959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b06b4-af5b-43cd-ae7b-e78012b695c7 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:44.614223 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-69106e0d-3c1c-4779-b162-40cae1feff63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:44.616041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:44.618176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:44.619918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:44.619918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:44.619918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:44.619918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:44.619918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 486/948] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:44.625298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69106e0d-3c1c-4779-b162-40cae1feff63 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:44.654285 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8822f-1c5c-4a85-b84e-b9986746ca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:44.655468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8822f-1c5c-4a85-b84e-b9986746ca17 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:44.655994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8822f-1c5c-4a85-b84e-b9986746ca17 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:44.656480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8822f-1c5c-4a85-b84e-b9986746ca17 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:44.657553 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8822f-1c5c-4a85-b84e-b9986746ca17 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:44.658057 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8822f-1c5c-4a85-b84e-b9986746ca17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:44.659909 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8822f-1c5c-4a85-b84e-b9986746ca17 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:44.666204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 463/949] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 03:36:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:44.672077 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8822f-1c5c-4a85-b84e-b9986746ca17 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:44.749836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69106e0d-3c1c-4779-b162-40cae1feff63 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:44.779227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8822f-1c5c-4a85-b84e-b9986746ca17 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:44.797623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaba9c-39db-4966-8665-7a778f5fa3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:44.798618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaba9c-39db-4966-8665-7a778f5fa3d4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:44.799144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaba9c-39db-4966-8665-7a778f5fa3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:44.799635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaba9c-39db-4966-8665-7a778f5fa3d4 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:44.801263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaba9c-39db-4966-8665-7a778f5fa3d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:44.802001 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaba9c-39db-4966-8665-7a778f5fa3d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:44.804250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaba9c-39db-4966-8665-7a778f5fa3d4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:44.817182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7ed2e-3131-4bcb-810d-22f8d536c1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:44.818340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7ed2e-3131-4bcb-810d-22f8d536c1e2 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:44.818628 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7ed2e-3131-4bcb-810d-22f8d536c1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:44.818930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7ed2e-3131-4bcb-810d-22f8d536c1e2 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:44.819655 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7ed2e-3131-4bcb-810d-22f8d536c1e2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:44.819966 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7ed2e-3131-4bcb-810d-22f8d536c1e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:44.821360 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7ed2e-3131-4bcb-810d-22f8d536c1e2 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:44.821853 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 487/950] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:44.823291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28fa67-cf39-4ad2-b046-ef1d5cf46253 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:44.823581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28fa67-cf39-4ad2-b046-ef1d5cf46253 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:44.823860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28fa67-cf39-4ad2-b046-ef1d5cf46253 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:44.825264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 488/951] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:44.826796 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28fa67-cf39-4ad2-b046-ef1d5cf46253 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:44.828315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 464/952] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 03:36:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:44.832513 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab695eb-a45a-4b41-b6ef-b999254356a5 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:44.833022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab695eb-a45a-4b41-b6ef-b999254356a5 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:44.833490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab695eb-a45a-4b41-b6ef-b999254356a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:44.855987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6ab695eb-a45a-4b41-b6ef-b999254356a5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:44.857764 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6ab695eb-a45a-4b41-b6ef-b999254356a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:44.891660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:44.895699 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:44.955557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 465/953] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:44.976590 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28fa67-cf39-4ad2-b046-ef1d5cf46253 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:44.979179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab695eb-a45a-4b41-b6ef-b999254356a5 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:45.023256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283dcf4-822a-47fa-953f-df88c2db0e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:45.024181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283dcf4-822a-47fa-953f-df88c2db0e2e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:45.024533 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283dcf4-822a-47fa-953f-df88c2db0e2e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:45.024885 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283dcf4-822a-47fa-953f-df88c2db0e2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:45.032423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283dcf4-822a-47fa-953f-df88c2db0e2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:45.033898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283dcf4-822a-47fa-953f-df88c2db0e2e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-8283dcf4-822a-47fa-953f-df88c2db0e2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:45.049676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:45.051221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:45.052398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:45.052398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:45.052398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:45.052398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:45.052398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:45.052398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:45.052398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:45.052398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:45.052398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 489/954] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:45.057169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283dcf4-822a-47fa-953f-df88c2db0e2e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:45.116015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab695eb-a45a-4b41-b6ef-b999254356a5 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:45.162860 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb7d5e-c55a-492f-b0cd-c7df1f7e0197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:45.164076 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb7d5e-c55a-492f-b0cd-c7df1f7e0197 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:45.164410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283dcf4-822a-47fa-953f-df88c2db0e2e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:45.164803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb7d5e-c55a-492f-b0cd-c7df1f7e0197 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:45.165267 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb7d5e-c55a-492f-b0cd-c7df1f7e0197 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:45.166096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:45.166756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb7d5e-c55a-492f-b0cd-c7df1f7e0197 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:45.169920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb7d5e-c55a-492f-b0cd-c7df1f7e0197 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-a0eb7d5e-c55a-492f-b0cd-c7df1f7e0197 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:45.187670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:45.188831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:45.189728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:45.189728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:45.189728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:45.189728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:45.189728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:45.189728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:45.189728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:45.189728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:45.189728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:45.189728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:45.189728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:45.189728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:45.189728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:45.189728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:45.192830 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 466/955] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 03:36:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:45.198465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb7d5e-c55a-492f-b0cd-c7df1f7e0197 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:45.210401 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bac4b0-20ba-4b8f-b55e-a43ef3606c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:45.211488 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bac4b0-20ba-4b8f-b55e-a43ef3606c1e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:45.211964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bac4b0-20ba-4b8f-b55e-a43ef3606c1e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:45.212428 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bac4b0-20ba-4b8f-b55e-a43ef3606c1e None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:45.213533 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bac4b0-20ba-4b8f-b55e-a43ef3606c1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:45.214045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bac4b0-20ba-4b8f-b55e-a43ef3606c1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:45.215790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bac4b0-20ba-4b8f-b55e-a43ef3606c1e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:45.234466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 490/956] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:45.235252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:45.236905 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bac4b0-20ba-4b8f-b55e-a43ef3606c1e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:45.321366 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb7d5e-c55a-492f-b0cd-c7df1f7e0197 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:45.362012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df34db-63cd-49aa-92ff-b35f4bc16579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:45.362718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df34db-63cd-49aa-92ff-b35f4bc16579 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:45.363141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df34db-63cd-49aa-92ff-b35f4bc16579 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:45.363345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df34db-63cd-49aa-92ff-b35f4bc16579 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:45.364770 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df34db-63cd-49aa-92ff-b35f4bc16579 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:45.365097 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df34db-63cd-49aa-92ff-b35f4bc16579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:45.366735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df34db-63cd-49aa-92ff-b35f4bc16579 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:45.370858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bac4b0-20ba-4b8f-b55e-a43ef3606c1e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:45.377429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 467/957] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 03:36:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:45.379755 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df34db-63cd-49aa-92ff-b35f4bc16579 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:45.423506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb01d6-7295-42a9-8df8-9fc5aed0c43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:45.424925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb01d6-7295-42a9-8df8-9fc5aed0c43e None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:45.425217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb01d6-7295-42a9-8df8-9fc5aed0c43e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:45.425524 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb01d6-7295-42a9-8df8-9fc5aed0c43e None admin] PATH_INFO: `/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/f75f5e28008b4189b5feb6438bdf1852/roles/b0a7381e3ca64076bf748e6c394483ca` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:45.428323 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb01d6-7295-42a9-8df8-9fc5aed0c43e None admin] RBAC: Authorizing `identity:create_grant(project_id=96e59c2ab83c477385e5a81b32a7c897, user_id=f75f5e28008b4189b5feb6438bdf1852, role_id=b0a7381e3ca64076bf748e6c394483ca)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:45.430080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb01d6-7295-42a9-8df8-9fc5aed0c43e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:45.446423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 491/958] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:36:45 2022] PUT /identity/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/f75f5e28008b4189b5feb6438bdf1852/roles/b0a7381e3ca64076bf748e6c394483ca => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:36:45.447818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bb597-c38f-44f4-b50c-5e123e43dba5 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:45.448155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bb597-c38f-44f4-b50c-5e123e43dba5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:45.448434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bb597-c38f-44f4-b50c-5e123e43dba5 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:45.449905 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 492/959] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:45.470276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653fdde-1775-4fdf-b495-a2a55562ccc5 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:45.470484 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653fdde-1775-4fdf-b495-a2a55562ccc5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:45.470731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653fdde-1775-4fdf-b495-a2a55562ccc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:45.492626 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:45.494213 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-1653fdde-1775-4fdf-b495-a2a55562ccc5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:45.495478 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1653fdde-1775-4fdf-b495-a2a55562ccc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:45.504756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df34db-63cd-49aa-92ff-b35f4bc16579 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:45.518875 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:45.563063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c6087-f140-4bef-8bfa-9489f2df4ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:45.563843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c6087-f140-4bef-8bfa-9489f2df4ba8 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:45.566493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c6087-f140-4bef-8bfa-9489f2df4ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:45.566493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c6087-f140-4bef-8bfa-9489f2df4ba8 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:45.568520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c6087-f140-4bef-8bfa-9489f2df4ba8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:45.568832 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c6087-f140-4bef-8bfa-9489f2df4ba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:45.571938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c6087-f140-4bef-8bfa-9489f2df4ba8 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:45.580682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 468/960] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 03:36:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:45.585634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c6087-f140-4bef-8bfa-9489f2df4ba8 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:45.603033 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 493/961] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:36:45.622321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653fdde-1775-4fdf-b495-a2a55562ccc5 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:45.714999 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c6087-f140-4bef-8bfa-9489f2df4ba8 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:45.742273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653fdde-1775-4fdf-b495-a2a55562ccc5 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:45.753821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9c45d-1407-4e12-bf3f-92d5c197a039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:45.754713 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9c45d-1407-4e12-bf3f-92d5c197a039 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:45.755106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9c45d-1407-4e12-bf3f-92d5c197a039 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:45.755294 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9c45d-1407-4e12-bf3f-92d5c197a039 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:45.756049 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9c45d-1407-4e12-bf3f-92d5c197a039 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:45.757520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9c45d-1407-4e12-bf3f-92d5c197a039 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:45.780009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc4a0f-c7f9-4a41-8605-f21e6eb9dd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:45.781110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc4a0f-c7f9-4a41-8605-f21e6eb9dd28 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:45.781543 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 469/962] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 03:36:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:36:45.781829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc4a0f-c7f9-4a41-8605-f21e6eb9dd28 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:45.782409 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc4a0f-c7f9-4a41-8605-f21e6eb9dd28 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:45.783360 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc4a0f-c7f9-4a41-8605-f21e6eb9dd28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:45.785258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc4a0f-c7f9-4a41-8605-f21e6eb9dd28 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:45.787076 dv-cinder-846842-7-smb devstack@keystone.service[87040]: WARNING keystone.server.flask.common [None req-d5cc4a0f-c7f9-4a41-8605-f21e6eb9dd28 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 30 03:36:45.802322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.sql.core [None req-d5cc4a0f-c7f9-4a41-8605-f21e6eb9dd28 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 03:36:45.802322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 30 03:36:45.802322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [parameters: {'user_id': '6858c3846ec3498daf6d45d4c8c0ac64', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 30 03:36:45.802322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87040) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-d5cc4a0f-c7f9-4a41-8605-f21e6eb9dd28 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application conn.query(q) Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application result.read() Jun 30 03:36:45.821764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 03:36:45.822755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application next(self.gen) Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application yield resource Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application next(self.gen) Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise self.value Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application session.commit() Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 03:36:45.823915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self.session.flush() Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application compat.raise_( Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 03:36:45.825056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 03:36:45.826266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application conn.query(q) Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application result.read() Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 03:36:45.827504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [parameters: {'user_id': '6858c3846ec3498daf6d45d4c8c0ac64', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:45.828567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 30 03:36:45.829598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 30 03:36:45.830643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 30 03:36:45.830643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 30 03:36:45.830643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 03:36:45.830643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 03:36:45.830643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 30 03:36:45.830643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:45.833473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 494/963] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 30 03:36:45 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:45.839936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9c45d-1407-4e12-bf3f-92d5c197a039 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:45.862491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:45.968838 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9c45d-1407-4e12-bf3f-92d5c197a039 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:46.006095 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fbaad-fe42-43f2-8348-24d36b42bccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:46.006876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fbaad-fe42-43f2-8348-24d36b42bccc None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:46.007161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fbaad-fe42-43f2-8348-24d36b42bccc None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:46.007433 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fbaad-fe42-43f2-8348-24d36b42bccc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:46.017888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fbaad-fe42-43f2-8348-24d36b42bccc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:46.019607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fbaad-fe42-43f2-8348-24d36b42bccc None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-b90fbaad-fe42-43f2-8348-24d36b42bccc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:46.035435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:46.036635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:46.037902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:46.037902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:46.037902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:46.037902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:46.037902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:46.037902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:46.037902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:46.037902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:46.037902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 03:36:46.037902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:46.037902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 470/964] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:36:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:46.043122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc4a0f-c7f9-4a41-8605-f21e6eb9dd28 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:46.061415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:46.159712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc4a0f-c7f9-4a41-8605-f21e6eb9dd28 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:46.194171 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c96cd2-83ee-4850-9e74-5e0d923e65c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:46.194876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c96cd2-83ee-4850-9e74-5e0d923e65c1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:46.195157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c96cd2-83ee-4850-9e74-5e0d923e65c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:46.195434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c96cd2-83ee-4850-9e74-5e0d923e65c1 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:46.196245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c96cd2-83ee-4850-9e74-5e0d923e65c1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:46.196546 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c96cd2-83ee-4850-9e74-5e0d923e65c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:46.198184 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c96cd2-83ee-4850-9e74-5e0d923e65c1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:46.237288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 495/965] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 03:36:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:46.935244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4a426-ab11-451f-96e3-b796fadf7c39 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:46.935821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4a426-ab11-451f-96e3-b796fadf7c39 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:46.935821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4a426-ab11-451f-96e3-b796fadf7c39 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:46.937316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 471/966] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:46.942513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295e8f5-fb37-427b-82d0-9e2d04753215 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:46.942989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295e8f5-fb37-427b-82d0-9e2d04753215 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:46.943087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295e8f5-fb37-427b-82d0-9e2d04753215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:46.961172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-c295e8f5-fb37-427b-82d0-9e2d04753215 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:46.962742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c295e8f5-fb37-427b-82d0-9e2d04753215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:47.035183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 496/967] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:47.057535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4a426-ab11-451f-96e3-b796fadf7c39 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:47.126570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:47.163158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4a426-ab11-451f-96e3-b796fadf7c39 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:47.196110 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd8848-04fb-44dc-b5ef-8dff78dee4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:47.196848 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd8848-04fb-44dc-b5ef-8dff78dee4b1 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:47.197191 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd8848-04fb-44dc-b5ef-8dff78dee4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:47.197524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd8848-04fb-44dc-b5ef-8dff78dee4b1 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:47.198316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd8848-04fb-44dc-b5ef-8dff78dee4b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:47.199782 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd8848-04fb-44dc-b5ef-8dff78dee4b1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:47.213883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 472/968] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 03:36:47 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:36:47.550827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919c0a0-1ec1-4b1e-823f-a8d832039ec5 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:47.551191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919c0a0-1ec1-4b1e-823f-a8d832039ec5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:47.551313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919c0a0-1ec1-4b1e-823f-a8d832039ec5 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:47.552915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 497/969] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:47.558235 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d67f8-a85a-4f52-90a7-f2af981242ee None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:47.558470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d67f8-a85a-4f52-90a7-f2af981242ee None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:47.558740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d67f8-a85a-4f52-90a7-f2af981242ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:47.576564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-652d67f8-a85a-4f52-90a7-f2af981242ee None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:47.577760 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-652d67f8-a85a-4f52-90a7-f2af981242ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:47.654468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 473/970] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:47.677765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919c0a0-1ec1-4b1e-823f-a8d832039ec5 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:47.680775 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:47.782410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919c0a0-1ec1-4b1e-823f-a8d832039ec5 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:47.816282 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3713ba3-e098-46f8-8d2f-d025cd8f020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:47.817028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3713ba3-e098-46f8-8d2f-d025cd8f020e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:47.817306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3713ba3-e098-46f8-8d2f-d025cd8f020e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:47.817574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3713ba3-e098-46f8-8d2f-d025cd8f020e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:47.827915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3713ba3-e098-46f8-8d2f-d025cd8f020e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-a3713ba3-e098-46f8-8d2f-d025cd8f020e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:47.836167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:47.837098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:47.837944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:47.837944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:47.837944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:47.837944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:47.837944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:47.837944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:47.837944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:47.837944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:47.837944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:47.837944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:47.837944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 03:36:47.837944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:47.839255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 498/971] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 30 03:36:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:47.843471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d67f8-a85a-4f52-90a7-f2af981242ee None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:47.894469 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5f985-358d-4c34-bc75-faac96a6f508 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:47.894797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5f985-358d-4c34-bc75-faac96a6f508 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:47.895058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5f985-358d-4c34-bc75-faac96a6f508 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:47.896599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 499/972] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:36:47.901709 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ea98f-b577-42a5-a2ac-8400003c80d5 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:47.901966 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ea98f-b577-42a5-a2ac-8400003c80d5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:47.902245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ea98f-b577-42a5-a2ac-8400003c80d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:47.913555 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:47.920212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-c89ea98f-b577-42a5-a2ac-8400003c80d5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:47.921400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c89ea98f-b577-42a5-a2ac-8400003c80d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:47.966497 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d67f8-a85a-4f52-90a7-f2af981242ee None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:47.985029 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:47.995791 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 500/973] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:36:48.006408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad54766-c25e-42dc-bf84-d1958c792079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:48.007206 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad54766-c25e-42dc-bf84-d1958c792079 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:48.007563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad54766-c25e-42dc-bf84-d1958c792079 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:48.007922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad54766-c25e-42dc-bf84-d1958c792079 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:48.008740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad54766-c25e-42dc-bf84-d1958c792079 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:48.009116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad54766-c25e-42dc-bf84-d1958c792079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:48.010567 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad54766-c25e-42dc-bf84-d1958c792079 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:48.018736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ea98f-b577-42a5-a2ac-8400003c80d5 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:48.023561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 474/974] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 30 03:36:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:48.024531 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad54766-c25e-42dc-bf84-d1958c792079 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:48.124828 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad54766-c25e-42dc-bf84-d1958c792079 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:48.137519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ea98f-b577-42a5-a2ac-8400003c80d5 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:48.141450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:48.160042 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592f28a-8ffc-458c-b1f9-470baad28f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:48.160848 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592f28a-8ffc-458c-b1f9-470baad28f04 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:48.161131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592f28a-8ffc-458c-b1f9-470baad28f04 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:48.161413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592f28a-8ffc-458c-b1f9-470baad28f04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:48.172230 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592f28a-8ffc-458c-b1f9-470baad28f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:48.173702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592f28a-8ffc-458c-b1f9-470baad28f04 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:48.175192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70538468-c53c-4ea1-b1cd-c82e1070c868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:48.176015 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70538468-c53c-4ea1-b1cd-c82e1070c868 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:48.176297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70538468-c53c-4ea1-b1cd-c82e1070c868 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:48.176711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70538468-c53c-4ea1-b1cd-c82e1070c868 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:48.177228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70538468-c53c-4ea1-b1cd-c82e1070c868 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:48.178589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70538468-c53c-4ea1-b1cd-c82e1070c868 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-70538468-c53c-4ea1-b1cd-c82e1070c868 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:48.190855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:48.197623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:48.198482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:48.198482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:48.198482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:48.198482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:48.198482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:48.198482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:48.198482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:48.198482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:48.198482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:48.198482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:48.198482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:48.198482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:48.198482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:48.198482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-4592f28a-8ffc-458c-b1f9-470baad28f04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:48.199314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:48.200101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:48.202957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:48.202957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:48.202957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:48.202957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:48.203623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 501/975] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 03:36:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:48.203786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 475/976] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:48.203939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70538468-c53c-4ea1-b1cd-c82e1070c868 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:48.204097 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592f28a-8ffc-458c-b1f9-470baad28f04 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:48.262208 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:48.302246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592f28a-8ffc-458c-b1f9-470baad28f04 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:48.313895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70538468-c53c-4ea1-b1cd-c82e1070c868 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:48.339256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f9106-2f0f-4b42-9b16-db7bc7eec0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:48.340020 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f9106-2f0f-4b42-9b16-db7bc7eec0a5 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:48.340373 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f9106-2f0f-4b42-9b16-db7bc7eec0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:48.340718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f9106-2f0f-4b42-9b16-db7bc7eec0a5 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:48.341519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f9106-2f0f-4b42-9b16-db7bc7eec0a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:48.341832 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f9106-2f0f-4b42-9b16-db7bc7eec0a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:48.343261 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f9106-2f0f-4b42-9b16-db7bc7eec0a5 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:48.355018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1a983-2714-4e88-87d6-728051f606a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:48.355699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1a983-2714-4e88-87d6-728051f606a1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:48.355981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1a983-2714-4e88-87d6-728051f606a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:48.356280 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1a983-2714-4e88-87d6-728051f606a1 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:48.361017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 476/977] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:48.361145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1a983-2714-4e88-87d6-728051f606a1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:48.361145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1a983-2714-4e88-87d6-728051f606a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:48.361145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1a983-2714-4e88-87d6-728051f606a1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:48.362093 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f9106-2f0f-4b42-9b16-db7bc7eec0a5 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:48.366542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 502/978] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 03:36:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:48.371582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1a983-2714-4e88-87d6-728051f606a1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:48.403251 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:48.477730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1a983-2714-4e88-87d6-728051f606a1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:48.480076 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f9106-2f0f-4b42-9b16-db7bc7eec0a5 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:48.498325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:48.513279 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac7406-1447-499a-a3fa-8984537be6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:48.513955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac7406-1447-499a-a3fa-8984537be6f8 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:48.514241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac7406-1447-499a-a3fa-8984537be6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:48.514520 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac7406-1447-499a-a3fa-8984537be6f8 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:48.515258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac7406-1447-499a-a3fa-8984537be6f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:48.515570 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac7406-1447-499a-a3fa-8984537be6f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:48.515682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c32ce7-3f38-48bf-95ea-de741922822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:48.516484 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c32ce7-3f38-48bf-95ea-de741922822e None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:48.516760 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c32ce7-3f38-48bf-95ea-de741922822e None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:48.516948 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac7406-1447-499a-a3fa-8984537be6f8 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:48.517103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c32ce7-3f38-48bf-95ea-de741922822e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:48.526806 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 503/979] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 03:36:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:48.528510 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c32ce7-3f38-48bf-95ea-de741922822e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:48.528625 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac7406-1447-499a-a3fa-8984537be6f8 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:48.530000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c32ce7-3f38-48bf-95ea-de741922822e None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-79c32ce7-3f38-48bf-95ea-de741922822e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:48.545618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:48.546561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:48.547837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:48.547837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:48.547837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:48.547837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:48.547837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:48.547837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:48.547837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:48.547837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:48.547837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 03:36:48.547837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:48.547837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 477/980] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 03:36:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:48.552627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c32ce7-3f38-48bf-95ea-de741922822e None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:48.632593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac7406-1447-499a-a3fa-8984537be6f8 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:48.643596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:48.656927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c32ce7-3f38-48bf-95ea-de741922822e None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:48.671923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e4884-d2fa-4067-9829-06589a11e959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:48.673101 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e4884-d2fa-4067-9829-06589a11e959 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:48.673723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e4884-d2fa-4067-9829-06589a11e959 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:48.674188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e4884-d2fa-4067-9829-06589a11e959 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:48.675563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e4884-d2fa-4067-9829-06589a11e959 None admin] RBAC: Adding query filter params (interface=admin, service_id=aacbef143dd849269e90517bc6cdd656, region_id=RegionOne) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:48.676058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e4884-d2fa-4067-9829-06589a11e959 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:48.678027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e4884-d2fa-4067-9829-06589a11e959 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:48.688275 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 504/981] 10.222.0.26 () {56 vars in 1249 bytes} [Thu Jun 30 03:36:48 2022] GET /identity/v3/endpoints?service_id=aacbef143dd849269e90517bc6cdd656&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:48.689274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e4884-d2fa-4067-9829-06589a11e959 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:48.696571 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b3a99-189a-4947-a49f-e8dfe16e657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:48.697253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b3a99-189a-4947-a49f-e8dfe16e657d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:48.697536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b3a99-189a-4947-a49f-e8dfe16e657d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:48.697810 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b3a99-189a-4947-a49f-e8dfe16e657d None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:48.698800 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b3a99-189a-4947-a49f-e8dfe16e657d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:48.699115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b3a99-189a-4947-a49f-e8dfe16e657d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:48.700554 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b3a99-189a-4947-a49f-e8dfe16e657d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:48.718098 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 478/982] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 30 03:36:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:48.723966 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b3a99-189a-4947-a49f-e8dfe16e657d None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:48.747021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:48.803048 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e4884-d2fa-4067-9829-06589a11e959 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:48.823729 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b3a99-189a-4947-a49f-e8dfe16e657d None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:48.839799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dd7ae-4983-467e-8194-90755daf3c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:48.840896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dd7ae-4983-467e-8194-90755daf3c0a None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:48.841409 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dd7ae-4983-467e-8194-90755daf3c0a None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:48.841848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dd7ae-4983-467e-8194-90755daf3c0a None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:48.842698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75dd7ae-4983-467e-8194-90755daf3c0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:48.844404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75dd7ae-4983-467e-8194-90755daf3c0a None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:48.854963 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 505/983] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 03:36:48 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:36:48.873185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4ce8-d427-43e5-aadd-864ea29c4c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:48.873870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4ce8-d427-43e5-aadd-864ea29c4c7f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:48.874154 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4ce8-d427-43e5-aadd-864ea29c4c7f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:48.874431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4ce8-d427-43e5-aadd-864ea29c4c7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:48.893184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:48.953900 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd4ce8-d427-43e5-aadd-864ea29c4c7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:48.955340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd4ce8-d427-43e5-aadd-864ea29c4c7f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:49.064519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 479/984] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:48 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 03:36:49.070287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dd7ae-4983-467e-8194-90755daf3c0a None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:49.176342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dd7ae-4983-467e-8194-90755daf3c0a None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:49.189792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:49.213990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdc046-201a-46bd-8a94-1b0a6e798748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:49.214700 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdc046-201a-46bd-8a94-1b0a6e798748 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:49.215005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdc046-201a-46bd-8a94-1b0a6e798748 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:49.215277 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdc046-201a-46bd-8a94-1b0a6e798748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:49.226817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdc046-201a-46bd-8a94-1b0a6e798748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:49.228279 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdc046-201a-46bd-8a94-1b0a6e798748 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:49.235230 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f428-d26a-4adc-9baf-94035887509e None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:49.235531 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f428-d26a-4adc-9baf-94035887509e None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:49.235798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f428-d26a-4adc-9baf-94035887509e None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:49.237328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 480/985] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:49.242162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301627d-44a3-49f7-ad7f-f9e562f2212b None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:49.242442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301627d-44a3-49f7-ad7f-f9e562f2212b None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:49.242717 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301627d-44a3-49f7-ad7f-f9e562f2212b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-c8fdc046-201a-46bd-8a94-1b0a6e798748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:49.245792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:49.246651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:49.252271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:49.252271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:49.252271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:49.252271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:49.252271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 506/986] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:49.252560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdc046-201a-46bd-8a94-1b0a6e798748 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:49.266789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-7301627d-44a3-49f7-ad7f-f9e562f2212b None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:49.267994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7301627d-44a3-49f7-ad7f-f9e562f2212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:49.310003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:49.354943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 481/987] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:36:49.363322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdc046-201a-46bd-8a94-1b0a6e798748 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:49.367568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301627d-44a3-49f7-ad7f-f9e562f2212b None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:49.399104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390258e0-9924-472c-95a4-33ca9efa3aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:49.399776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390258e0-9924-472c-95a4-33ca9efa3aad None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:49.400058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390258e0-9924-472c-95a4-33ca9efa3aad None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:49.400333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390258e0-9924-472c-95a4-33ca9efa3aad None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:49.401058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390258e0-9924-472c-95a4-33ca9efa3aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:49.401364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390258e0-9924-472c-95a4-33ca9efa3aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:49.402733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390258e0-9924-472c-95a4-33ca9efa3aad None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:49.415157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 507/988] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:49.420624 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390258e0-9924-472c-95a4-33ca9efa3aad None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:49.448938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:49.470844 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301627d-44a3-49f7-ad7f-f9e562f2212b None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:49.508122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c86cfd-299e-4d62-9333-486614a12e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:49.508938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c86cfd-299e-4d62-9333-486614a12e4f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:49.509554 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c86cfd-299e-4d62-9333-486614a12e4f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:49.509830 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c86cfd-299e-4d62-9333-486614a12e4f None admin] PATH_INFO: `/v3/services/compute` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:49.510804 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c86cfd-299e-4d62-9333-486614a12e4f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:49.512194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c86cfd-299e-4d62-9333-486614a12e4f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-d2c86cfd-299e-4d62-9333-486614a12e4f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:49.524207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:49.525253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:49.526520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:49.526520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:49.526520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:49.526520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:49.526520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:49.526520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:49.526520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:49.526520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:49.526520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:49.526520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:49.526520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:49.526520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:49.526520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 03:36:49.526520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:49.530578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 482/989] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:49.531258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c86cfd-299e-4d62-9333-486614a12e4f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:49.541758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390258e0-9924-472c-95a4-33ca9efa3aad None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:49.579908 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:49.581603 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf8482-98ba-4d56-ac0b-de97fd3bc975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:49.582496 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf8482-98ba-4d56-ac0b-de97fd3bc975 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:49.583011 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf8482-98ba-4d56-ac0b-de97fd3bc975 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:49.583252 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf8482-98ba-4d56-ac0b-de97fd3bc975 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:49.590700 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf8482-98ba-4d56-ac0b-de97fd3bc975 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:49.592169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf8482-98ba-4d56-ac0b-de97fd3bc975 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-bfdf8482-98ba-4d56-ac0b-de97fd3bc975 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:49.607480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:49.608402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:49.609316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:49.609316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:49.609316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:49.609316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:49.609316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:49.609316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:49.609316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:49.609316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:49.609316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 508/990] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:49.614604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf8482-98ba-4d56-ac0b-de97fd3bc975 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:49.645424 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c86cfd-299e-4d62-9333-486614a12e4f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:49.684116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec65fbf-ca25-4c57-ba81-f4f441908ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:49.684746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec65fbf-ca25-4c57-ba81-f4f441908ce2 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:49.685032 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec65fbf-ca25-4c57-ba81-f4f441908ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:49.685302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec65fbf-ca25-4c57-ba81-f4f441908ce2 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:49.686006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec65fbf-ca25-4c57-ba81-f4f441908ce2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:49.686309 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec65fbf-ca25-4c57-ba81-f4f441908ce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:49.687711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec65fbf-ca25-4c57-ba81-f4f441908ce2 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:49.697766 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 483/991] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 03:36:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:49.698407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec65fbf-ca25-4c57-ba81-f4f441908ce2 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:49.699644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:49.717758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf8482-98ba-4d56-ac0b-de97fd3bc975 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:49.751496 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03ea3-008f-48e5-99d7-2f95d8b9e88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:49.752155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03ea3-008f-48e5-99d7-2f95d8b9e88f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:49.752367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03ea3-008f-48e5-99d7-2f95d8b9e88f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:49.752624 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03ea3-008f-48e5-99d7-2f95d8b9e88f None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:49.753509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e03ea3-008f-48e5-99d7-2f95d8b9e88f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:49.753901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e03ea3-008f-48e5-99d7-2f95d8b9e88f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:49.755374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e03ea3-008f-48e5-99d7-2f95d8b9e88f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:49.767234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 509/992] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:49.773303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03ea3-008f-48e5-99d7-2f95d8b9e88f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:49.809301 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec65fbf-ca25-4c57-ba81-f4f441908ce2 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:49.811875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:49.857131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb15cc-e6b6-4b2e-91bc-47b7de251ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:49.857834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb15cc-e6b6-4b2e-91bc-47b7de251ba5 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:49.858140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb15cc-e6b6-4b2e-91bc-47b7de251ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:49.858384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb15cc-e6b6-4b2e-91bc-47b7de251ba5 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:49.859122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb15cc-e6b6-4b2e-91bc-47b7de251ba5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:49.859438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb15cc-e6b6-4b2e-91bc-47b7de251ba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:49.860842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb15cc-e6b6-4b2e-91bc-47b7de251ba5 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:49.872022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 484/993] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 03:36:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:49.873121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb15cc-e6b6-4b2e-91bc-47b7de251ba5 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:49.883732 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03ea3-008f-48e5-99d7-2f95d8b9e88f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:49.919697 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0a6d4-4413-4c4d-b58d-eccb1e27664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:49.920355 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0a6d4-4413-4c4d-b58d-eccb1e27664c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:49.920730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0a6d4-4413-4c4d-b58d-eccb1e27664c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:49.920900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0a6d4-4413-4c4d-b58d-eccb1e27664c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:49.921796 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0a6d4-4413-4c4d-b58d-eccb1e27664c None admin] RBAC: Adding query filter params (role.id=b0a7381e3ca64076bf748e6c394483ca, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=f75f5e28008b4189b5feb6438bdf1852) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:49.922081 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0a6d4-4413-4c4d-b58d-eccb1e27664c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:49.923607 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0a6d4-4413-4c4d-b58d-eccb1e27664c None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:49.931378 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 510/994] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:49 2022] GET /identity/v3/role_assignments?user.id=f75f5e28008b4189b5feb6438bdf1852&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b0a7381e3ca64076bf748e6c394483ca => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:49.995327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb15cc-e6b6-4b2e-91bc-47b7de251ba5 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:50.034441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a291d-d32e-4529-a5c3-2738d0e0509b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:50.035624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a291d-d32e-4529-a5c3-2738d0e0509b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:50.036094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a291d-d32e-4529-a5c3-2738d0e0509b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:50.036561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a291d-d32e-4529-a5c3-2738d0e0509b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:50.037550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a291d-d32e-4529-a5c3-2738d0e0509b None admin] RBAC: Adding query filter params (interface=public, service_id=3817080c37844e69829235768710838e, region_id=RegionOne) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:50.038047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a291d-d32e-4529-a5c3-2738d0e0509b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:50.039700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a291d-d32e-4529-a5c3-2738d0e0509b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:50.046340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 485/995] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 03:36:49 2022] GET /identity/v3/endpoints?service_id=3817080c37844e69829235768710838e&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:50.052163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0a6d4-4413-4c4d-b58d-eccb1e27664c None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:50.066104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:50.164983 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0a6d4-4413-4c4d-b58d-eccb1e27664c None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:50.199520 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53798eac-fd14-48ad-867c-ab3ab2c9ed71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:50.200491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53798eac-fd14-48ad-867c-ab3ab2c9ed71 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:50.200964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53798eac-fd14-48ad-867c-ab3ab2c9ed71 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:50.201418 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53798eac-fd14-48ad-867c-ab3ab2c9ed71 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:50.202277 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53798eac-fd14-48ad-867c-ab3ab2c9ed71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:50.203879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53798eac-fd14-48ad-867c-ab3ab2c9ed71 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:50.211107 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 511/996] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 03:36:50 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:36:50.895044 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe059bf-9cd9-4859-a0ee-23fa82ffbd38 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:50.895555 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe059bf-9cd9-4859-a0ee-23fa82ffbd38 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:50.895555 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe059bf-9cd9-4859-a0ee-23fa82ffbd38 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:50.897133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 486/997] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:50.902221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b34d3-133f-42e4-9fe1-d60d2a93031e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:50.902513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b34d3-133f-42e4-9fe1-d60d2a93031e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:50.902820 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b34d3-133f-42e4-9fe1-d60d2a93031e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:50.920592 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-001b34d3-133f-42e4-9fe1-d60d2a93031e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:50.921809 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-001b34d3-133f-42e4-9fe1-d60d2a93031e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:50.993585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 512/998] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:51.016547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe059bf-9cd9-4859-a0ee-23fa82ffbd38 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:51.051843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:51.129704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe059bf-9cd9-4859-a0ee-23fa82ffbd38 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:51.163870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de229f-1c42-4cc6-a7db-94ae9918d1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:51.164686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de229f-1c42-4cc6-a7db-94ae9918d1a1 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:51.164963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de229f-1c42-4cc6-a7db-94ae9918d1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:51.165231 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de229f-1c42-4cc6-a7db-94ae9918d1a1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:51.165881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de229f-1c42-4cc6-a7db-94ae9918d1a1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:51.167289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de229f-1c42-4cc6-a7db-94ae9918d1a1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-65de229f-1c42-4cc6-a7db-94ae9918d1a1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:51.179380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:51.180415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:51.186345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 487/999] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 03:36:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:51.188347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b34d3-133f-42e4-9fe1-d60d2a93031e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:51.190818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:51.302735 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b34d3-133f-42e4-9fe1-d60d2a93031e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:51.341116 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833376b9-d572-448c-b3c7-37011c7eff55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:51.341781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833376b9-d572-448c-b3c7-37011c7eff55 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:51.342065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833376b9-d572-448c-b3c7-37011c7eff55 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:51.342307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833376b9-d572-448c-b3c7-37011c7eff55 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:51.343075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833376b9-d572-448c-b3c7-37011c7eff55 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:51.343383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833376b9-d572-448c-b3c7-37011c7eff55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:51.344759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833376b9-d572-448c-b3c7-37011c7eff55 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:51.350509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 513/1000] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 03:36:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:51.356262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de229f-1c42-4cc6-a7db-94ae9918d1a1 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:51.453347 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:51.460042 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de229f-1c42-4cc6-a7db-94ae9918d1a1 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:51.493635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58529ecc-ad98-4b32-a69a-f1d1915bd022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:51.494304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58529ecc-ad98-4b32-a69a-f1d1915bd022 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:51.494582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58529ecc-ad98-4b32-a69a-f1d1915bd022 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:51.494877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58529ecc-ad98-4b32-a69a-f1d1915bd022 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:51.495587 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58529ecc-ad98-4b32-a69a-f1d1915bd022 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:51.495893 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58529ecc-ad98-4b32-a69a-f1d1915bd022 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:51.497279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58529ecc-ad98-4b32-a69a-f1d1915bd022 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:51.502980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 488/1001] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 03:36:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:51.508454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833376b9-d572-448c-b3c7-37011c7eff55 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:51.576091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:51.611869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833376b9-d572-448c-b3c7-37011c7eff55 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:51.645720 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b22a6-4b80-4b8f-8a85-e721a8485ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:51.646387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b22a6-4b80-4b8f-8a85-e721a8485ee5 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:51.646683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b22a6-4b80-4b8f-8a85-e721a8485ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:51.646985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b22a6-4b80-4b8f-8a85-e721a8485ee5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:51.647739 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b22a6-4b80-4b8f-8a85-e721a8485ee5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:51.649108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b22a6-4b80-4b8f-8a85-e721a8485ee5 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:51.674798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 514/1002] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 03:36:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:36:52.009493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eca063-4e54-46bb-ac79-a0dccaf476aa None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:52.010029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eca063-4e54-46bb-ac79-a0dccaf476aa None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:52.010029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eca063-4e54-46bb-ac79-a0dccaf476aa None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:52.011650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 489/1003] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:52.016780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca641c28-cfc0-4209-a051-15408b7516e9 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:52.017080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca641c28-cfc0-4209-a051-15408b7516e9 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:52.017322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca641c28-cfc0-4209-a051-15408b7516e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:52.034534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-ca641c28-cfc0-4209-a051-15408b7516e9 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:52.035790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ca641c28-cfc0-4209-a051-15408b7516e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:52.113287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 515/1004] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:52.135896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eca063-4e54-46bb-ac79-a0dccaf476aa None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:52.241839 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eca063-4e54-46bb-ac79-a0dccaf476aa None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:52.258456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cf3a3-0dd6-4c99-8d5b-ef2c10f1d518 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:52.258985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cf3a3-0dd6-4c99-8d5b-ef2c10f1d518 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:52.259101 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cf3a3-0dd6-4c99-8d5b-ef2c10f1d518 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:52.260505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 516/1005] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:36:52.265589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebb348-2315-4a81-93ff-bfbdaaf67c65 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:52.266026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebb348-2315-4a81-93ff-bfbdaaf67c65 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:52.266501 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebb348-2315-4a81-93ff-bfbdaaf67c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:52.277768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a7f1-e143-44ca-b8c6-84f97dc225b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:52.278550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a7f1-e143-44ca-b8c6-84f97dc225b2 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:52.278866 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a7f1-e143-44ca-b8c6-84f97dc225b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:52.279139 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a7f1-e143-44ca-b8c6-84f97dc225b2 None admin] PATH_INFO: `/v3/services/image` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:52.280132 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43a7f1-e143-44ca-b8c6-84f97dc225b2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:52.281502 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43a7f1-e143-44ca-b8c6-84f97dc225b2 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:52.285542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-afebb348-2315-4a81-93ff-bfbdaaf67c65 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:52.286857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-afebb348-2315-4a81-93ff-bfbdaaf67c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-6c43a7f1-e143-44ca-b8c6-84f97dc225b2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:52.293304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:52.294316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:52.295322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 490/1006] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Jun 30 03:36:52 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:52.302951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a7f1-e143-44ca-b8c6-84f97dc225b2 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:52.331759 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:52.344831 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:52.370803 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 517/1007] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:36:52.393078 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebb348-2315-4a81-93ff-bfbdaaf67c65 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:52.410756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a7f1-e143-44ca-b8c6-84f97dc225b2 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:52.447142 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7f5d3-8707-47c9-924d-80b51a924bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:52.447894 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7f5d3-8707-47c9-924d-80b51a924bd8 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:52.448177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7f5d3-8707-47c9-924d-80b51a924bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:52.448454 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7f5d3-8707-47c9-924d-80b51a924bd8 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:52.449171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7f5d3-8707-47c9-924d-80b51a924bd8 None admin] RBAC: Adding query filter params (name=image) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:52.449483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7f5d3-8707-47c9-924d-80b51a924bd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:52.451216 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7f5d3-8707-47c9-924d-80b51a924bd8 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:52.456724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 491/1008] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:52.462417 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7f5d3-8707-47c9-924d-80b51a924bd8 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:52.499417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebb348-2315-4a81-93ff-bfbdaaf67c65 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:52.534666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2e665-d66a-4b8c-9201-cfd990261e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:52.535493 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2e665-d66a-4b8c-9201-cfd990261e98 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:52.535774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2e665-d66a-4b8c-9201-cfd990261e98 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:52.536041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2e665-d66a-4b8c-9201-cfd990261e98 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:52.536696 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2e665-d66a-4b8c-9201-cfd990261e98 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:52.538068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2e665-d66a-4b8c-9201-cfd990261e98 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-32e2e665-d66a-4b8c-9201-cfd990261e98 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:52.549651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:52.550836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:52.551683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:52.551683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:52.551683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:52.551683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:52.551683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:52.551683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:52.551683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:52.551683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:52.551683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:52.551683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:52.551683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:52.551683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:52.551683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 03:36:52.551683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:52.555934 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 518/1009] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:52.557011 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2e665-d66a-4b8c-9201-cfd990261e98 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:52.558788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:52.573907 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7f5d3-8707-47c9-924d-80b51a924bd8 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:52.611914 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:52.613856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a99eb5-35ae-4adf-af9b-bfcbfc20671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:52.614710 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a99eb5-35ae-4adf-af9b-bfcbfc20671c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:52.615168 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a99eb5-35ae-4adf-af9b-bfcbfc20671c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:52.615450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a99eb5-35ae-4adf-af9b-bfcbfc20671c None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:52.616173 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a99eb5-35ae-4adf-af9b-bfcbfc20671c None admin] RBAC: Adding query filter params (type=image) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:52.616487 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a99eb5-35ae-4adf-af9b-bfcbfc20671c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:52.617872 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a99eb5-35ae-4adf-af9b-bfcbfc20671c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:52.622514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 492/1010] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:52.676726 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2e665-d66a-4b8c-9201-cfd990261e98 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:52.715443 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa515c5-9321-4166-9d06-ff9d538a6bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:52.716127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa515c5-9321-4166-9d06-ff9d538a6bfe None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:52.716411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa515c5-9321-4166-9d06-ff9d538a6bfe None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:52.716681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa515c5-9321-4166-9d06-ff9d538a6bfe None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:52.717407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa515c5-9321-4166-9d06-ff9d538a6bfe None admin] RBAC: Adding query filter params (name=compute) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:52.717717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa515c5-9321-4166-9d06-ff9d538a6bfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:52.719143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa515c5-9321-4166-9d06-ff9d538a6bfe None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:52.729881 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 519/1011] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 03:36:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:52.731703 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a99eb5-35ae-4adf-af9b-bfcbfc20671c None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:52.842409 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a99eb5-35ae-4adf-af9b-bfcbfc20671c None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:52.883410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa2020-ae8d-4d4c-9916-7587dd01b8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:52.884097 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa2020-ae8d-4d4c-9916-7587dd01b8ee None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:52.884383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa2020-ae8d-4d4c-9916-7587dd01b8ee None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:52.884659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa2020-ae8d-4d4c-9916-7587dd01b8ee None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:52.885381 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa2020-ae8d-4d4c-9916-7587dd01b8ee None admin] RBAC: Adding query filter params (type=compute) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:52.885691 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa2020-ae8d-4d4c-9916-7587dd01b8ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:52.887104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa2020-ae8d-4d4c-9916-7587dd01b8ee None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:52.896863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 493/1012] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 03:36:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:52.898399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa515c5-9321-4166-9d06-ff9d538a6bfe None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:53.003333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa515c5-9321-4166-9d06-ff9d538a6bfe None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:53.014165 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:53.038942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134a3e8-18fb-46fd-8185-4b2b393049d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:53.039608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134a3e8-18fb-46fd-8185-4b2b393049d6 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:53.039889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134a3e8-18fb-46fd-8185-4b2b393049d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:53.040162 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134a3e8-18fb-46fd-8185-4b2b393049d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:53.040917 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134a3e8-18fb-46fd-8185-4b2b393049d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:53.042295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134a3e8-18fb-46fd-8185-4b2b393049d6 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:53.070799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 520/1013] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 03:36:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:36:53.717343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462d1b4-e77b-4298-ac9a-12c67db022cf None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:53.717930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462d1b4-e77b-4298-ac9a-12c67db022cf None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:53.717930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462d1b4-e77b-4298-ac9a-12c67db022cf None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:53.719475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 494/1014] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:53.725096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d9a72-e59e-4766-858b-1f6e53a4a60f None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:53.725536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d9a72-e59e-4766-858b-1f6e53a4a60f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:53.725716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d9a72-e59e-4766-858b-1f6e53a4a60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:53.743451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-d39d9a72-e59e-4766-858b-1f6e53a4a60f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:53.744664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d39d9a72-e59e-4766-858b-1f6e53a4a60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:53.821604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 521/1015] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:53 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:53.848320 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462d1b4-e77b-4298-ac9a-12c67db022cf None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:53.868638 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:53.960881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462d1b4-e77b-4298-ac9a-12c67db022cf None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:53.998289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715331d-70b0-476e-bbbd-ee864c5aa12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:53.999019 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715331d-70b0-476e-bbbd-ee864c5aa12b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:53.999304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715331d-70b0-476e-bbbd-ee864c5aa12b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:53.999577 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715331d-70b0-476e-bbbd-ee864c5aa12b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:54.000769 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715331d-70b0-476e-bbbd-ee864c5aa12b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:54.002232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715331d-70b0-476e-bbbd-ee864c5aa12b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:54.004097 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 495/1016] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:54.009768 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d9a72-e59e-4766-858b-1f6e53a4a60f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:54.100269 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:54.110993 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d9a72-e59e-4766-858b-1f6e53a4a60f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:54.145811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642d9cb-53ed-428d-a427-236c7b2bca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:54.146477 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642d9cb-53ed-428d-a427-236c7b2bca88 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:54.146776 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642d9cb-53ed-428d-a427-236c7b2bca88 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:54.147074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642d9cb-53ed-428d-a427-236c7b2bca88 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:54.147787 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642d9cb-53ed-428d-a427-236c7b2bca88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:54.149248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642d9cb-53ed-428d-a427-236c7b2bca88 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:54.178045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 522/1017] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 03:36:54 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:36:54.692397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c879d-1969-4f9c-96ae-0be876c2851d None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:54.692661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c879d-1969-4f9c-96ae-0be876c2851d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:54.692950 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c879d-1969-4f9c-96ae-0be876c2851d None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:54.694486 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 496/1018] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:54.699725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617a794-0504-41ec-901d-05bb763ea2b8 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:54.700014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617a794-0504-41ec-901d-05bb763ea2b8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:54.700296 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617a794-0504-41ec-901d-05bb763ea2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:54.717599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-0617a794-0504-41ec-901d-05bb763ea2b8 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:54.718799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0617a794-0504-41ec-901d-05bb763ea2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:54.788274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 523/1019] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:54 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:54.811120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c879d-1969-4f9c-96ae-0be876c2851d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:54.911563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:54.929494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c879d-1969-4f9c-96ae-0be876c2851d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:54.963400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a24e72-9792-43d8-be3f-9fb1d73ddbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:54.963988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a24e72-9792-43d8-be3f-9fb1d73ddbbf None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:54.964270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a24e72-9792-43d8-be3f-9fb1d73ddbbf None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:54.964541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a24e72-9792-43d8-be3f-9fb1d73ddbbf None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:54.965276 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a24e72-9792-43d8-be3f-9fb1d73ddbbf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:54.966654 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a24e72-9792-43d8-be3f-9fb1d73ddbbf None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:54.982870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 497/1020] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 03:36:54 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:36:55.302300 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef4956-776d-4dfa-9dff-d1a8147fb680 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:55.302512 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef4956-776d-4dfa-9dff-d1a8147fb680 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:55.302831 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef4956-776d-4dfa-9dff-d1a8147fb680 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:55.304301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 524/1021] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:55.310369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8177-cb26-493b-9ff4-2365b63ff83d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:55.310706 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8177-cb26-493b-9ff4-2365b63ff83d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:55.310935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8177-cb26-493b-9ff4-2365b63ff83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:55.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-2b5d8177-cb26-493b-9ff4-2365b63ff83d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:55.330656 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2b5d8177-cb26-493b-9ff4-2365b63ff83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:55.436266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 498/1022] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:55.476747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef4956-776d-4dfa-9dff-d1a8147fb680 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:55.609024 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:55.655330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef4956-776d-4dfa-9dff-d1a8147fb680 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:55.715029 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9e023-de15-470c-96d1-aef418a18817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:55.716431 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9e023-de15-470c-96d1-aef418a18817 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:55.716921 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9e023-de15-470c-96d1-aef418a18817 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:55.717415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9e023-de15-470c-96d1-aef418a18817 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:55.735243 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9e023-de15-470c-96d1-aef418a18817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-2da9e023-de15-470c-96d1-aef418a18817 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:55.751404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:55.752366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:55.753335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:55.753335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:55.753335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:55.753335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:55.753335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:55.753335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:55.753335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:55.753335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:55.753335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:55.753335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:55.753335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 03:36:55.753335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:55.755135 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 525/1023] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 30 03:36:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:55.762984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d8177-cb26-493b-9ff4-2365b63ff83d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:55.869439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:55.906775 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d8177-cb26-493b-9ff4-2365b63ff83d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:55.942370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765bb19-973f-46af-b993-d0b935bdfc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:55.943064 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765bb19-973f-46af-b993-d0b935bdfc96 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:55.943340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765bb19-973f-46af-b993-d0b935bdfc96 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:55.943602 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765bb19-973f-46af-b993-d0b935bdfc96 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:55.944345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765bb19-973f-46af-b993-d0b935bdfc96 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:55.944644 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765bb19-973f-46af-b993-d0b935bdfc96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:55.946007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765bb19-973f-46af-b993-d0b935bdfc96 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:55.954707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 499/1024] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 30 03:36:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:55.960527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9e023-de15-470c-96d1-aef418a18817 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:56.076439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9e023-de15-470c-96d1-aef418a18817 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:56.113498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56006f-d090-4293-b9b8-5f4a8c49fc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:56.114311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56006f-d090-4293-b9b8-5f4a8c49fc80 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:56.114590 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56006f-d090-4293-b9b8-5f4a8c49fc80 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:56.114892 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56006f-d090-4293-b9b8-5f4a8c49fc80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:56.117729 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:56.128084 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56006f-d090-4293-b9b8-5f4a8c49fc80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:56.129770 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56006f-d090-4293-b9b8-5f4a8c49fc80 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-6c56006f-d090-4293-b9b8-5f4a8c49fc80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:56.147565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:56.148569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:56.149514 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:56.149514 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:56.149514 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:56.149514 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:56.151098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 526/1025] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:56.154543 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765bb19-973f-46af-b993-d0b935bdfc96 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:56.259393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765bb19-973f-46af-b993-d0b935bdfc96 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:56.289141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:56.295365 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec028ac-4c93-4b69-94da-89a33043b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:56.296048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec028ac-4c93-4b69-94da-89a33043b6b3 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:56.296499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec028ac-4c93-4b69-94da-89a33043b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:56.296812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec028ac-4c93-4b69-94da-89a33043b6b3 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:56.297530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec028ac-4c93-4b69-94da-89a33043b6b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:56.297835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec028ac-4c93-4b69-94da-89a33043b6b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:56.299252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec028ac-4c93-4b69-94da-89a33043b6b3 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:56.312172 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 500/1026] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:56.317765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56006f-d090-4293-b9b8-5f4a8c49fc80 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:56.421688 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56006f-d090-4293-b9b8-5f4a8c49fc80 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:56.447337 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1714b6-6b71-450e-b6ba-c1010b038ceb None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:56.447660 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1714b6-6b71-450e-b6ba-c1010b038ceb None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:56.447877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1714b6-6b71-450e-b6ba-c1010b038ceb None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:56.449392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 501/1027] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:36:56.454568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36c51b-c772-47e0-b732-1da9ab1b5331 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:56.454868 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36c51b-c772-47e0-b732-1da9ab1b5331 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:56.455144 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36c51b-c772-47e0-b732-1da9ab1b5331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:56.457351 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b8d8b-0848-4978-ac08-82930a0921e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:56.458323 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b8d8b-0848-4978-ac08-82930a0921e1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:56.458755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b8d8b-0848-4978-ac08-82930a0921e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:56.459188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b8d8b-0848-4978-ac08-82930a0921e1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:56.468152 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b8d8b-0848-4978-ac08-82930a0921e1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:56.469758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b8d8b-0848-4978-ac08-82930a0921e1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:56.472560 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-7e36c51b-c772-47e0-b732-1da9ab1b5331 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:56.473836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7e36c51b-c772-47e0-b732-1da9ab1b5331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-cd6b8d8b-0848-4978-ac08-82930a0921e1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:36:56.485453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:56.486598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:56.487920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:56.487920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:56.487920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:36:56.487920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:36:56.487920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:36:56.487920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:36:56.487920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:36:56.487920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:36:56.487920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:36:56.487920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:56.488481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 527/1028] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 03:36:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:56.494021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b8d8b-0848-4978-ac08-82930a0921e1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:56.544541 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:56.558803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 502/1029] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:56.578346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36c51b-c772-47e0-b732-1da9ab1b5331 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:56.606057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b8d8b-0848-4978-ac08-82930a0921e1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:56.640610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc852edc-170d-4765-b096-5aa7a710ee16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:56.641383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc852edc-170d-4765-b096-5aa7a710ee16 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:56.641666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc852edc-170d-4765-b096-5aa7a710ee16 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:56.641939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc852edc-170d-4765-b096-5aa7a710ee16 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:56.642799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc852edc-170d-4765-b096-5aa7a710ee16 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:56.643126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc852edc-170d-4765-b096-5aa7a710ee16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:56.644527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc852edc-170d-4765-b096-5aa7a710ee16 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:56.667718 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 528/1030] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 03:36:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:56.668737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc852edc-170d-4765-b096-5aa7a710ee16 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:56.692647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36c51b-c772-47e0-b732-1da9ab1b5331 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:56.716781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:56.730511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa4c13-84f8-4833-b357-dc12c6683be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:56.731358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa4c13-84f8-4833-b357-dc12c6683be6 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:56.731640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa4c13-84f8-4833-b357-dc12c6683be6 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:56.731912 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa4c13-84f8-4833-b357-dc12c6683be6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:56.733096 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa4c13-84f8-4833-b357-dc12c6683be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:56.734551 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa4c13-84f8-4833-b357-dc12c6683be6 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:56.736233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 503/1031] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:56.741906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa4c13-84f8-4833-b357-dc12c6683be6 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:56.775094 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc852edc-170d-4765-b096-5aa7a710ee16 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:56.777504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:56.813200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908274d-f114-457b-864d-75be7fc91d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:56.813855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908274d-f114-457b-864d-75be7fc91d48 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:56.814132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908274d-f114-457b-864d-75be7fc91d48 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:56.814408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908274d-f114-457b-864d-75be7fc91d48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:56.851624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa4c13-84f8-4833-b357-dc12c6683be6 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:56.888371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e792cd6-0dea-41d1-ae62-4b6bb5a9ae83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:56.889063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e792cd6-0dea-41d1-ae62-4b6bb5a9ae83 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:56.889341 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e792cd6-0dea-41d1-ae62-4b6bb5a9ae83 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:56.889610 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e792cd6-0dea-41d1-ae62-4b6bb5a9ae83 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:56.890214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908274d-f114-457b-864d-75be7fc91d48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:56.890319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e792cd6-0dea-41d1-ae62-4b6bb5a9ae83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:56.891717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908274d-f114-457b-864d-75be7fc91d48 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:56.891819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e792cd6-0dea-41d1-ae62-4b6bb5a9ae83 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:56.915454 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 504/1032] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:36:56 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:36:57.022029 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 529/1033] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:36:57.024524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4f164-ebf1-461c-9b6e-56824bbd7a80 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:57.024887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4f164-ebf1-461c-9b6e-56824bbd7a80 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:57.025235 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4f164-ebf1-461c-9b6e-56824bbd7a80 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:57.026855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 505/1034] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:57.027654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908274d-f114-457b-864d-75be7fc91d48 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:57.031398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:57.032509 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddef00-d306-4f98-8d0f-00e8ddf25b44 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:57.032801 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddef00-d306-4f98-8d0f-00e8ddf25b44 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:57.033080 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddef00-d306-4f98-8d0f-00e8ddf25b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:57.051162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-70ddef00-d306-4f98-8d0f-00e8ddf25b44 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:57.052741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-70ddef00-d306-4f98-8d0f-00e8ddf25b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:57.104187 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:57.139566 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 506/1035] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:36:57.150853 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908274d-f114-457b-864d-75be7fc91d48 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:57.162967 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddef00-d306-4f98-8d0f-00e8ddf25b44 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:57.187430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cf547-dcf6-4745-94e3-a08a0077b66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:57.188233 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cf547-dcf6-4745-94e3-a08a0077b66e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:57.188514 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cf547-dcf6-4745-94e3-a08a0077b66e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:57.188786 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cf547-dcf6-4745-94e3-a08a0077b66e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:57.199860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cf547-dcf6-4745-94e3-a08a0077b66e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:57.201317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cf547-dcf6-4745-94e3-a08a0077b66e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-e00cf547-dcf6-4745-94e3-a08a0077b66e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:36:57.219100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:57.220054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:57.221438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:36:57.221438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:36:57.221438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:36:57.221438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:57.221438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 530/1036] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:57.226259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cf547-dcf6-4745-94e3-a08a0077b66e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:57.273492 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddef00-d306-4f98-8d0f-00e8ddf25b44 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:57.286424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:57.312679 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc405c-16ac-40e2-9d8d-76cc14fe3736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:57.313502 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc405c-16ac-40e2-9d8d-76cc14fe3736 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:57.313786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc405c-16ac-40e2-9d8d-76cc14fe3736 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:57.314053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc405c-16ac-40e2-9d8d-76cc14fe3736 None admin] PATH_INFO: `/v3/services/image` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:57.314713 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc405c-16ac-40e2-9d8d-76cc14fe3736 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:57.316347 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc405c-16ac-40e2-9d8d-76cc14fe3736 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-d4fc405c-16ac-40e2-9d8d-76cc14fe3736 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:57.328841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:57.330118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:36:57.331427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 507/1037] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Jun 30 03:36:57 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:36:57.336070 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc405c-16ac-40e2-9d8d-76cc14fe3736 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:57.339938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cf547-dcf6-4745-94e3-a08a0077b66e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:57.377879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d81395-686a-4a08-91ba-4a71d95f9dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:57.380030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d81395-686a-4a08-91ba-4a71d95f9dc1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:57.380480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d81395-686a-4a08-91ba-4a71d95f9dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:57.380887 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d81395-686a-4a08-91ba-4a71d95f9dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:57.381625 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d81395-686a-4a08-91ba-4a71d95f9dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:57.381935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d81395-686a-4a08-91ba-4a71d95f9dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:57.383340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d81395-686a-4a08-91ba-4a71d95f9dc1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:57.389237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:57.401519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 531/1038] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:57.402546 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d81395-686a-4a08-91ba-4a71d95f9dc1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:57.457837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc405c-16ac-40e2-9d8d-76cc14fe3736 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:57.494552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab28c53-4ff2-498a-9db4-a41b3ec84d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:57.495253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab28c53-4ff2-498a-9db4-a41b3ec84d4a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:57.495540 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab28c53-4ff2-498a-9db4-a41b3ec84d4a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:57.495817 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab28c53-4ff2-498a-9db4-a41b3ec84d4a None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:57.496599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab28c53-4ff2-498a-9db4-a41b3ec84d4a None admin] RBAC: Adding query filter params (name=image) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:57.496856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab28c53-4ff2-498a-9db4-a41b3ec84d4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:57.498199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab28c53-4ff2-498a-9db4-a41b3ec84d4a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:57.507987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 508/1039] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:57.509006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab28c53-4ff2-498a-9db4-a41b3ec84d4a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:57.519553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d81395-686a-4a08-91ba-4a71d95f9dc1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:57.536232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:57.556405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dd76f-40be-4d4a-8431-7455d178c3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:57.557215 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dd76f-40be-4d4a-8431-7455d178c3dc None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:57.557501 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dd76f-40be-4d4a-8431-7455d178c3dc None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:57.557778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dd76f-40be-4d4a-8431-7455d178c3dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:57.564870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dd76f-40be-4d4a-8431-7455d178c3dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:57.566646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dd76f-40be-4d4a-8431-7455d178c3dc None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-ba6dd76f-40be-4d4a-8431-7455d178c3dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:36:57.581210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:57.582127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:57.587954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:36:57.587954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:36:57.587954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:36:57.587954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:36:57.587954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:36:57.587954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:36:57.587954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:36:57.587954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:57.587954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 532/1040] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:57.588442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dd76f-40be-4d4a-8431-7455d178c3dc None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:57.624193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab28c53-4ff2-498a-9db4-a41b3ec84d4a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:57.626551 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:57.664441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41969704-30b1-4564-ab9a-61b80cd19f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:57.665119 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969704-30b1-4564-ab9a-61b80cd19f9a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:57.665754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969704-30b1-4564-ab9a-61b80cd19f9a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:57.665754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969704-30b1-4564-ab9a-61b80cd19f9a None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:57.666440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41969704-30b1-4564-ab9a-61b80cd19f9a None admin] RBAC: Adding query filter params (type=image) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:57.666676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41969704-30b1-4564-ab9a-61b80cd19f9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:57.668203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41969704-30b1-4564-ab9a-61b80cd19f9a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:57.673302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 509/1041] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:36:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:57.679864 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41969704-30b1-4564-ab9a-61b80cd19f9a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:57.706899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dd76f-40be-4d4a-8431-7455d178c3dc None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:57.743103 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3124b2-66ec-42a1-9058-5bbdeb1dbef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:57.743778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3124b2-66ec-42a1-9058-5bbdeb1dbef5 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:57.744061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3124b2-66ec-42a1-9058-5bbdeb1dbef5 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:57.744335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3124b2-66ec-42a1-9058-5bbdeb1dbef5 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:57.745131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3124b2-66ec-42a1-9058-5bbdeb1dbef5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:57.745438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3124b2-66ec-42a1-9058-5bbdeb1dbef5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:57.746911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3124b2-66ec-42a1-9058-5bbdeb1dbef5 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:57.759026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 533/1042] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:57.765129 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3124b2-66ec-42a1-9058-5bbdeb1dbef5 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:57.789465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41969704-30b1-4564-ab9a-61b80cd19f9a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:57.799209 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:57.827456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ecb4f-19fa-4550-9b06-4122954a9746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:57.828124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ecb4f-19fa-4550-9b06-4122954a9746 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:57.828403 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ecb4f-19fa-4550-9b06-4122954a9746 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:57.828676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ecb4f-19fa-4550-9b06-4122954a9746 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:57.829499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ecb4f-19fa-4550-9b06-4122954a9746 None admin] RBAC: Adding query filter params (interface=public, service_id=ded99129d08a480881d1b9e75907762c, region_id=RegionOne) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:57.829797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ecb4f-19fa-4550-9b06-4122954a9746 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:57.831443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ecb4f-19fa-4550-9b06-4122954a9746 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:57.841052 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 510/1043] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 03:36:57 2022] GET /identity/v3/endpoints?service_id=ded99129d08a480881d1b9e75907762c&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:57.842080 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ecb4f-19fa-4550-9b06-4122954a9746 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:57.872824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3124b2-66ec-42a1-9058-5bbdeb1dbef5 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:57.882011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:57.913593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445a13d-0a86-47e8-ad21-4a75dff3f142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:57.914263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445a13d-0a86-47e8-ad21-4a75dff3f142 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:57.914539 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445a13d-0a86-47e8-ad21-4a75dff3f142 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:57.914836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445a13d-0a86-47e8-ad21-4a75dff3f142 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:57.915673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445a13d-0a86-47e8-ad21-4a75dff3f142 None admin] RBAC: Adding query filter params (role.id=b0a7381e3ca64076bf748e6c394483ca, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=758b152c320e4a94921bb96541cbea98) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:57.915982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445a13d-0a86-47e8-ad21-4a75dff3f142 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:57.917417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445a13d-0a86-47e8-ad21-4a75dff3f142 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:57.924203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 534/1044] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:36:57 2022] GET /identity/v3/role_assignments?user.id=758b152c320e4a94921bb96541cbea98&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b0a7381e3ca64076bf748e6c394483ca => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:36:57.957882 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ecb4f-19fa-4550-9b06-4122954a9746 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:57.999401 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ee2a2-ef6a-47f1-b584-840fb3a96e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:58.000346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee2a2-ef6a-47f1-b584-840fb3a96e7c None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:58.000809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee2a2-ef6a-47f1-b584-840fb3a96e7c None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:58.001226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee2a2-ef6a-47f1-b584-840fb3a96e7c None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:58.002089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ee2a2-ef6a-47f1-b584-840fb3a96e7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:58.004135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ee2a2-ef6a-47f1-b584-840fb3a96e7c None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:58.012218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 511/1045] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 03:36:57 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:36:59.016927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742ca72-2511-4507-8f9c-2132c296d5da None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:59.017458 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742ca72-2511-4507-8f9c-2132c296d5da None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:59.017458 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742ca72-2511-4507-8f9c-2132c296d5da None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:59.022639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 535/1046] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:59.024800 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abd369-c9e0-4578-a26b-b26fe219c3ef None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:59.025271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abd369-c9e0-4578-a26b-b26fe219c3ef None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:59.025349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abd369-c9e0-4578-a26b-b26fe219c3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:59.043879 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-46abd369-c9e0-4578-a26b-b26fe219c3ef None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:59.045087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-46abd369-c9e0-4578-a26b-b26fe219c3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:59.118818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 512/1047] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:36:59.143098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742ca72-2511-4507-8f9c-2132c296d5da None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:59.245234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:59.250278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742ca72-2511-4507-8f9c-2132c296d5da None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:59.282940 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691c257-3904-478c-8589-5bb30ada64b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:59.283936 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691c257-3904-478c-8589-5bb30ada64b4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:59.284217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691c257-3904-478c-8589-5bb30ada64b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:59.284489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691c257-3904-478c-8589-5bb30ada64b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:59.295277 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691c257-3904-478c-8589-5bb30ada64b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-7691c257-3904-478c-8589-5bb30ada64b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:36:59.302994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:36:59.303935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:36:59.304790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:36:59.304790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:36:59.304790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:36:59.304790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:36:59.304790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:36:59.304790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:36:59.304790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:36:59.304790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:36:59.304790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:36:59.304790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:36:59.304790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:36:59.304790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:36:59.306852 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 536/1048] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:36:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:36:59.310502 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abd369-c9e0-4578-a26b-b26fe219c3ef None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:59.337487 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:59.413920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abd369-c9e0-4578-a26b-b26fe219c3ef None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:59.448814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3593a23-20d1-49cb-8f67-8ae15ce76d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:59.449491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3593a23-20d1-49cb-8f67-8ae15ce76d93 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:59.449809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3593a23-20d1-49cb-8f67-8ae15ce76d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:59.450102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3593a23-20d1-49cb-8f67-8ae15ce76d93 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:59.450879 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3593a23-20d1-49cb-8f67-8ae15ce76d93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:36:59.451185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3593a23-20d1-49cb-8f67-8ae15ce76d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:59.452564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3593a23-20d1-49cb-8f67-8ae15ce76d93 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:59.461436 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 513/1049] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:36:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:59.467109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691c257-3904-478c-8589-5bb30ada64b4 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:59.569955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691c257-3904-478c-8589-5bb30ada64b4 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:59.605929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd01e0-e6a6-490f-b23c-c1aa0c34728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:59.606845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd01e0-e6a6-490f-b23c-c1aa0c34728a None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:59.607126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd01e0-e6a6-490f-b23c-c1aa0c34728a None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:59.607400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd01e0-e6a6-490f-b23c-c1aa0c34728a None admin] PATH_INFO: `/v3/users/1e716d4e747b4842b5738b4ae49fdfbb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:59.621354 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd01e0-e6a6-490f-b23c-c1aa0c34728a None admin] RBAC: Authorizing `identity:get_user(user_id=1e716d4e747b4842b5738b4ae49fdfbb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:59.622834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd01e0-e6a6-490f-b23c-c1aa0c34728a None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:59.624707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 537/1050] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:36:59 2022] GET /identity/v3/users/1e716d4e747b4842b5738b4ae49fdfbb => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:36:59.630739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3593a23-20d1-49cb-8f67-8ae15ce76d93 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:59.718498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:59.732531 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3593a23-20d1-49cb-8f67-8ae15ce76d93 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:36:59.767123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddedb2-a05c-4bf5-964a-574340b4627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:36:59.767771 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddedb2-a05c-4bf5-964a-574340b4627f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:59.768092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddedb2-a05c-4bf5-964a-574340b4627f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:59.768370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddedb2-a05c-4bf5-964a-574340b4627f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:59.837486 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddedb2-a05c-4bf5-964a-574340b4627f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:36:59.839001 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddedb2-a05c-4bf5-964a-574340b4627f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:36:59.930459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:36:59.944785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 514/1051] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:36:59 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:36:59.948365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e55a7-61b8-49c3-bb8e-3d33aceb5a32 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:59.948651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e55a7-61b8-49c3-bb8e-3d33aceb5a32 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:59.948929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e55a7-61b8-49c3-bb8e-3d33aceb5a32 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:59.950403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 538/1052] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:36:59.950524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddedb2-a05c-4bf5-964a-574340b4627f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:36:59.955332 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ee57-1c46-4561-9a58-651b92dcbd68 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:36:59.955668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ee57-1c46-4561-9a58-651b92dcbd68 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:36:59.955955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ee57-1c46-4561-9a58-651b92dcbd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:36:59.972717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-0641ee57-1c46-4561-9a58-651b92dcbd68 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:36:59.973836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0641ee57-1c46-4561-9a58-651b92dcbd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:36:59.987683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:00.050203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 539/1053] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:36:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:37:00.055207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe24ece-b8dc-4d23-9a60-04a6f32aa51f None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:00.055496 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe24ece-b8dc-4d23-9a60-04a6f32aa51f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:00.055772 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe24ece-b8dc-4d23-9a60-04a6f32aa51f None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:00.058798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 540/1054] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:37:00.062027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c53060-47c3-4c8b-9e81-d9237a91d496 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:00.062322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c53060-47c3-4c8b-9e81-d9237a91d496 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:00.062597 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c53060-47c3-4c8b-9e81-d9237a91d496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:00.062880 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddedb2-a05c-4bf5-964a-574340b4627f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:00.082809 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-c9c53060-47c3-4c8b-9e81-d9237a91d496 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:00.084014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c9c53060-47c3-4c8b-9e81-d9237a91d496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:00.097260 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11616b3f-adaa-4e8a-a02c-06f757c9554a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:00.098134 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11616b3f-adaa-4e8a-a02c-06f757c9554a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:00.098416 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11616b3f-adaa-4e8a-a02c-06f757c9554a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:00.098677 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11616b3f-adaa-4e8a-a02c-06f757c9554a None admin] PATH_INFO: `/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:00.099888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11616b3f-adaa-4e8a-a02c-06f757c9554a None admin] RBAC: Authorizing `identity:get_project(project_id=a4b12f390d224ab28ab666ddbfb4b98d)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:00.101330 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11616b3f-adaa-4e8a-a02c-06f757c9554a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:00.103090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 515/1055] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:36:59 2022] GET /identity/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:37:00.103845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11616b3f-adaa-4e8a-a02c-06f757c9554a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:00.152918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 541/1056] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:37:00.153774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c53060-47c3-4c8b-9e81-d9237a91d496 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:00.167783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:00.212599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11616b3f-adaa-4e8a-a02c-06f757c9554a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:00.231019 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:00.246028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac818240-0b9f-4018-96fc-7482ec6a3202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:00.246878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac818240-0b9f-4018-96fc-7482ec6a3202 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:00.247156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac818240-0b9f-4018-96fc-7482ec6a3202 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:00.247426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac818240-0b9f-4018-96fc-7482ec6a3202 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:00.251967 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c53060-47c3-4c8b-9e81-d9237a91d496 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:00.257662 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac818240-0b9f-4018-96fc-7482ec6a3202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-ac818240-0b9f-4018-96fc-7482ec6a3202 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:37:00.265790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:00.266852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:00.267711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:00.267711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:00.267711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:00.267711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:00.267711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:37:00.267711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:37:00.267711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:37:00.267711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:37:00.267711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:37:00.267711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:37:00.267711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 03:37:00.267711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:37:00.267711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 516/1057] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 30 03:37:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:00.268541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac818240-0b9f-4018-96fc-7482ec6a3202 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:00.289252 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac7a7b-b1a0-4275-8d23-c9a3de596b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:00.289901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac7a7b-b1a0-4275-8d23-c9a3de596b36 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:00.290181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac7a7b-b1a0-4275-8d23-c9a3de596b36 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:00.290455 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac7a7b-b1a0-4275-8d23-c9a3de596b36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:00.291328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac7a7b-b1a0-4275-8d23-c9a3de596b36 None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=a4b12f390d224ab28ab666ddbfb4b98d, user.id=1e716d4e747b4842b5738b4ae49fdfbb) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:00.291640 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac7a7b-b1a0-4275-8d23-c9a3de596b36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:00.293045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac7a7b-b1a0-4275-8d23-c9a3de596b36 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:00.298378 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 542/1058] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:37:00 2022] GET /identity/v3/role_assignments?user.id=1e716d4e747b4842b5738b4ae49fdfbb&scope.project.id=a4b12f390d224ab28ab666ddbfb4b98d&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:00.299256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac7a7b-b1a0-4275-8d23-c9a3de596b36 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:00.385146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac818240-0b9f-4018-96fc-7482ec6a3202 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:00.404099 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:00.425160 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03788d-7ba7-4288-84fa-0580ad1a98ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:00.425631 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac7a7b-b1a0-4275-8d23-c9a3de596b36 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:00.425970 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03788d-7ba7-4288-84fa-0580ad1a98ed None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:00.426245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03788d-7ba7-4288-84fa-0580ad1a98ed None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:00.426508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03788d-7ba7-4288-84fa-0580ad1a98ed None admin] PATH_INFO: `/v3/services/image` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:00.427211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03788d-7ba7-4288-84fa-0580ad1a98ed None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:00.428605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03788d-7ba7-4288-84fa-0580ad1a98ed None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-ab03788d-7ba7-4288-84fa-0580ad1a98ed None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:00.441420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:00.442527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:37:00.443873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 517/1059] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Jun 30 03:37:00 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:00.448757 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03788d-7ba7-4288-84fa-0580ad1a98ed None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:00.468943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b65da9-9437-451b-9c81-35cd41706808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:00.469618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b65da9-9437-451b-9c81-35cd41706808 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:00.469896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b65da9-9437-451b-9c81-35cd41706808 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:00.470169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b65da9-9437-451b-9c81-35cd41706808 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:00.471359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b65da9-9437-451b-9c81-35cd41706808 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:00.471666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b65da9-9437-451b-9c81-35cd41706808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:00.473030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b65da9-9437-451b-9c81-35cd41706808 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:00.481577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 543/1060] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 30 03:37:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:00.487579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b65da9-9437-451b-9c81-35cd41706808 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:00.491986 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:00.569244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03788d-7ba7-4288-84fa-0580ad1a98ed None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:00.603911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b65da9-9437-451b-9c81-35cd41706808 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:00.607727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c2a56-49ad-4643-8cfb-d26632002d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:00.608494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c2a56-49ad-4643-8cfb-d26632002d41 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:00.608837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c2a56-49ad-4643-8cfb-d26632002d41 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:00.609172 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c2a56-49ad-4643-8cfb-d26632002d41 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:00.609952 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c2a56-49ad-4643-8cfb-d26632002d41 None admin] RBAC: Adding query filter params (name=image) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:00.610321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c2a56-49ad-4643-8cfb-d26632002d41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:00.611860 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c2a56-49ad-4643-8cfb-d26632002d41 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:00.617875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 518/1061] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:37:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:37:00.623494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c2a56-49ad-4643-8cfb-d26632002d41 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:00.643767 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871f490-62ea-4e5d-8434-7c0b704707a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:00.644604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871f490-62ea-4e5d-8434-7c0b704707a7 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:00.644899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871f490-62ea-4e5d-8434-7c0b704707a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:00.645158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871f490-62ea-4e5d-8434-7c0b704707a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:00.657747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871f490-62ea-4e5d-8434-7c0b704707a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:00.660138 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871f490-62ea-4e5d-8434-7c0b704707a7 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:00.672730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-3871f490-62ea-4e5d-8434-7c0b704707a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:37:00.678461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:00.679421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:00.680297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:37:00.680297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:37:00.680297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:37:00.680297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:00.680297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 544/1062] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:37:00.685601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871f490-62ea-4e5d-8434-7c0b704707a7 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:00.743412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c2a56-49ad-4643-8cfb-d26632002d41 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:00.745196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:00.780021 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b0220-0fdb-497b-b78c-34b802d41efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:00.780778 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b0220-0fdb-497b-b78c-34b802d41efc None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:00.781062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b0220-0fdb-497b-b78c-34b802d41efc None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:00.781340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b0220-0fdb-497b-b78c-34b802d41efc None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:00.782055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b0220-0fdb-497b-b78c-34b802d41efc None admin] RBAC: Adding query filter params (type=image) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:00.782366 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b0220-0fdb-497b-b78c-34b802d41efc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:00.784105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b0220-0fdb-497b-b78c-34b802d41efc None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:00.789580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 519/1063] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:37:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:00.795048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b0220-0fdb-497b-b78c-34b802d41efc None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:00.796772 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871f490-62ea-4e5d-8434-7c0b704707a7 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:00.831852 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6ab4e-84a2-4bbf-ac2d-fed668e099ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:00.832517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6ab4e-84a2-4bbf-ac2d-fed668e099ea None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:00.832796 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6ab4e-84a2-4bbf-ac2d-fed668e099ea None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:00.833068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6ab4e-84a2-4bbf-ac2d-fed668e099ea None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:00.833786 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6ab4e-84a2-4bbf-ac2d-fed668e099ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:00.834088 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6ab4e-84a2-4bbf-ac2d-fed668e099ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:00.835517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6ab4e-84a2-4bbf-ac2d-fed668e099ea None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:00.856109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 545/1064] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:37:00.857045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6ab4e-84a2-4bbf-ac2d-fed668e099ea None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:00.904888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b0220-0fdb-497b-b78c-34b802d41efc None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:00.914857 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:00.942714 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b511c8-8c30-417e-866d-bb4200aac4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:00.943405 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b511c8-8c30-417e-866d-bb4200aac4dc None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:00.943685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b511c8-8c30-417e-866d-bb4200aac4dc None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:00.943956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b511c8-8c30-417e-866d-bb4200aac4dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:00.944696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b511c8-8c30-417e-866d-bb4200aac4dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:00.946075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b511c8-8c30-417e-866d-bb4200aac4dc None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:00.970972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 520/1065] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 03:37:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:37:00.985388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6ab4e-84a2-4bbf-ac2d-fed668e099ea None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:01.007229 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:01.037382 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e53a8-61b0-43a0-afc8-8cd4a92ec07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:01.038240 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e53a8-61b0-43a0-afc8-8cd4a92ec07f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:01.038524 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e53a8-61b0-43a0-afc8-8cd4a92ec07f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:01.038850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e53a8-61b0-43a0-afc8-8cd4a92ec07f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:01.047239 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e53a8-61b0-43a0-afc8-8cd4a92ec07f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:01.048725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e53a8-61b0-43a0-afc8-8cd4a92ec07f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-ca8e53a8-61b0-43a0-afc8-8cd4a92ec07f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:37:01.066405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:01.073231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:01.074306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:01.074306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:01.074306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:37:01.074306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:37:01.074306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:37:01.074306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:37:01.074306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:37:01.074306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:37:01.074306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:37:01.074306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:01.074306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 546/1066] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 03:37:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:01.074943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b511c8-8c30-417e-866d-bb4200aac4dc None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:01.185760 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b511c8-8c30-417e-866d-bb4200aac4dc None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:01.218011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ffd53-4588-431f-9666-35a3c9cb44dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:01.218684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ffd53-4588-431f-9666-35a3c9cb44dc None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:01.218984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ffd53-4588-431f-9666-35a3c9cb44dc None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:01.219255 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ffd53-4588-431f-9666-35a3c9cb44dc None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:01.220087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ffd53-4588-431f-9666-35a3c9cb44dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:01.220730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ffd53-4588-431f-9666-35a3c9cb44dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:01.222229 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ffd53-4588-431f-9666-35a3c9cb44dc None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:01.240356 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 521/1067] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 03:37:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:01.246109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e53a8-61b0-43a0-afc8-8cd4a92ec07f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:01.348861 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e53a8-61b0-43a0-afc8-8cd4a92ec07f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:01.383353 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5627e6e-1d97-46ba-81fd-3f449802bbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:01.384178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5627e6e-1d97-46ba-81fd-3f449802bbfe None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:01.384455 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5627e6e-1d97-46ba-81fd-3f449802bbfe None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:01.384730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5627e6e-1d97-46ba-81fd-3f449802bbfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:01.396814 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5627e6e-1d97-46ba-81fd-3f449802bbfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:01.398297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5627e6e-1d97-46ba-81fd-3f449802bbfe None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-a5627e6e-1d97-46ba-81fd-3f449802bbfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:37:01.416978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:01.417922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:01.418848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:37:01.418848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:37:01.418848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:37:01.418848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:01.418848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 547/1068] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:01.424162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ffd53-4588-431f-9666-35a3c9cb44dc None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:01.449274 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:01.531950 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ffd53-4588-431f-9666-35a3c9cb44dc None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:01.568535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b301b4-a637-4ca4-b108-a8f288ac0ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:01.569208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b301b4-a637-4ca4-b108-a8f288ac0ad1 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:01.569489 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b301b4-a637-4ca4-b108-a8f288ac0ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:01.569764 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b301b4-a637-4ca4-b108-a8f288ac0ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:01.570498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b301b4-a637-4ca4-b108-a8f288ac0ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:01.570816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b301b4-a637-4ca4-b108-a8f288ac0ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:01.572245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b301b4-a637-4ca4-b108-a8f288ac0ad1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:01.584573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 522/1069] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:01.590228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5627e6e-1d97-46ba-81fd-3f449802bbfe None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:01.617542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:01.696641 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5627e6e-1d97-46ba-81fd-3f449802bbfe None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:01.733616 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e65f2-444f-4fd4-8e46-8bb25579fc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:01.734454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e65f2-444f-4fd4-8e46-8bb25579fc4b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:01.734740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e65f2-444f-4fd4-8e46-8bb25579fc4b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:01.735063 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e65f2-444f-4fd4-8e46-8bb25579fc4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:01.742844 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e65f2-444f-4fd4-8e46-8bb25579fc4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:01.744308 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e65f2-444f-4fd4-8e46-8bb25579fc4b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-e86e65f2-444f-4fd4-8e46-8bb25579fc4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:37:01.758705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:01.759774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:01.760669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:37:01.760669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:37:01.760669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:37:01.760669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:37:01.760669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:37:01.760669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:37:01.760669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:37:01.760669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:01.764770 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 548/1070] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:01.766194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b301b4-a637-4ca4-b108-a8f288ac0ad1 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:01.855312 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:01.874475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b301b4-a637-4ca4-b108-a8f288ac0ad1 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:01.913364 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d895f7c-669e-4ed1-88d2-1c4591a4bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:01.914032 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d895f7c-669e-4ed1-88d2-1c4591a4bf7e None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:01.914313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d895f7c-669e-4ed1-88d2-1c4591a4bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:01.914583 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d895f7c-669e-4ed1-88d2-1c4591a4bf7e None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:01.915404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d895f7c-669e-4ed1-88d2-1c4591a4bf7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:01.915709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d895f7c-669e-4ed1-88d2-1c4591a4bf7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:01.917147 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d895f7c-669e-4ed1-88d2-1c4591a4bf7e None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:01.934530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 523/1071] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:37:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:01.936220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e65f2-444f-4fd4-8e46-8bb25579fc4b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:02.029902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:02.047742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e65f2-444f-4fd4-8e46-8bb25579fc4b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:02.082149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b4260-bc32-4e66-942d-2e5f323453cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:02.083092 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b4260-bc32-4e66-942d-2e5f323453cc None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:02.083372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b4260-bc32-4e66-942d-2e5f323453cc None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:02.083650 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b4260-bc32-4e66-942d-2e5f323453cc None admin] PATH_INFO: `/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/758b152c320e4a94921bb96541cbea98/roles/b0a7381e3ca64076bf748e6c394483ca` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:02.085927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b4260-bc32-4e66-942d-2e5f323453cc None admin] RBAC: Authorizing `identity:create_grant(project_id=96e59c2ab83c477385e5a81b32a7c897, user_id=758b152c320e4a94921bb96541cbea98, role_id=b0a7381e3ca64076bf748e6c394483ca)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:02.087417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b4260-bc32-4e66-942d-2e5f323453cc None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:02.104859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 549/1072] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:37:01 2022] PUT /identity/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/758b152c320e4a94921bb96541cbea98/roles/b0a7381e3ca64076bf748e6c394483ca => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:37:02.316422 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5783-9115-42db-a4d9-ba7e1dcb5182 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:02.316931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5783-9115-42db-a4d9-ba7e1dcb5182 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:02.316931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5783-9115-42db-a4d9-ba7e1dcb5182 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:02.318466 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 524/1073] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:02.323869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcdd88-37dc-473b-9c0b-4645895ee369 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:02.324163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcdd88-37dc-473b-9c0b-4645895ee369 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:02.324401 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcdd88-37dc-473b-9c0b-4645895ee369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:02.341923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-2adcdd88-37dc-473b-9c0b-4645895ee369 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:02.343141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2adcdd88-37dc-473b-9c0b-4645895ee369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:02.411321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 550/1074] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:02.433820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba5783-9115-42db-a4d9-ba7e1dcb5182 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:02.542209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba5783-9115-42db-a4d9-ba7e1dcb5182 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:02.580866 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dba5b4-75a1-42d5-8a9c-cecea77d2c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:02.582028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dba5b4-75a1-42d5-8a9c-cecea77d2c14 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:02.582465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dba5b4-75a1-42d5-8a9c-cecea77d2c14 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:02.582910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dba5b4-75a1-42d5-8a9c-cecea77d2c14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:02.593642 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dba5b4-75a1-42d5-8a9c-cecea77d2c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-68dba5b4-75a1-42d5-8a9c-cecea77d2c14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:37:02.602115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:02.603221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:02.604055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:02.604055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:02.604055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:02.604055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:02.604055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:37:02.604055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:37:02.604055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:37:02.604055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:37:02.604055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:37:02.604055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:37:02.604055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:02.604055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:37:02.604701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 525/1075] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:37:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:02.610340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcdd88-37dc-473b-9c0b-4645895ee369 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:02.689558 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:02.717429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcdd88-37dc-473b-9c0b-4645895ee369 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:02.754305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6ef56-a43d-4fb8-a39a-6319150be8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:02.755013 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6ef56-a43d-4fb8-a39a-6319150be8c2 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:02.755298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6ef56-a43d-4fb8-a39a-6319150be8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:02.755571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6ef56-a43d-4fb8-a39a-6319150be8c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:02.756328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6ef56-a43d-4fb8-a39a-6319150be8c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:02.756636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6ef56-a43d-4fb8-a39a-6319150be8c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:02.758097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6ef56-a43d-4fb8-a39a-6319150be8c2 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:02.766716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 551/1076] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:37:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:02.772551 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dba5b4-75a1-42d5-8a9c-cecea77d2c14 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:02.775603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:02.882269 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dba5b4-75a1-42d5-8a9c-cecea77d2c14 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:02.917980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8a6c0-5e6c-418b-9612-6cf02185e28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:02.918908 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8a6c0-5e6c-418b-9612-6cf02185e28d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:02.919186 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8a6c0-5e6c-418b-9612-6cf02185e28d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:02.919452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8a6c0-5e6c-418b-9612-6cf02185e28d None admin] PATH_INFO: `/v3/users/1e716d4e747b4842b5738b4ae49fdfbb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:02.920652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8a6c0-5e6c-418b-9612-6cf02185e28d None admin] RBAC: Authorizing `identity:get_user(user_id=1e716d4e747b4842b5738b4ae49fdfbb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:02.922088 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8a6c0-5e6c-418b-9612-6cf02185e28d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:02.923935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 526/1077] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:37:02 2022] GET /identity/v3/users/1e716d4e747b4842b5738b4ae49fdfbb => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:02.929849 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6ef56-a43d-4fb8-a39a-6319150be8c2 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:03.033352 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6ef56-a43d-4fb8-a39a-6319150be8c2 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:03.043004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388d1af-8d98-4d2a-b402-edf7cbb34974 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:03.043306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388d1af-8d98-4d2a-b402-edf7cbb34974 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:03.043581 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388d1af-8d98-4d2a-b402-edf7cbb34974 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:03.045095 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 527/1078] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:03.049939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ffa3b-8e4f-44e1-908f-40b9d7954967 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:03.050202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ffa3b-8e4f-44e1-908f-40b9d7954967 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:03.050468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ffa3b-8e4f-44e1-908f-40b9d7954967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:03.066978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-098ffa3b-8e4f-44e1-908f-40b9d7954967 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:03.068154 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-098ffa3b-8e4f-44e1-908f-40b9d7954967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:03.069623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e10a51-55a6-452a-b15b-1eceabcf788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:03.070535 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e10a51-55a6-452a-b15b-1eceabcf788e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:03.070849 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e10a51-55a6-452a-b15b-1eceabcf788e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:03.071126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e10a51-55a6-452a-b15b-1eceabcf788e None admin] PATH_INFO: `/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:03.075498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e10a51-55a6-452a-b15b-1eceabcf788e None admin] RBAC: Authorizing `identity:get_project(project_id=a4b12f390d224ab28ab666ddbfb4b98d)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:03.077102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e10a51-55a6-452a-b15b-1eceabcf788e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:03.079003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 552/1079] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:37:02 2022] GET /identity/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:03.084700 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e10a51-55a6-452a-b15b-1eceabcf788e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:03.088410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:03.140107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:03.145540 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 528/1080] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:37:03.168251 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ffa3b-8e4f-44e1-908f-40b9d7954967 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:03.199960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e10a51-55a6-452a-b15b-1eceabcf788e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:03.239013 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fac260-8e75-4e4f-b750-ea08345dbde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:03.239915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fac260-8e75-4e4f-b750-ea08345dbde7 None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:03.240195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fac260-8e75-4e4f-b750-ea08345dbde7 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:03.240467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fac260-8e75-4e4f-b750-ea08345dbde7 None admin] PATH_INFO: `/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d/users/1e716d4e747b4842b5738b4ae49fdfbb/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:03.242490 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fac260-8e75-4e4f-b750-ea08345dbde7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4b12f390d224ab28ab666ddbfb4b98d, user_id=1e716d4e747b4842b5738b4ae49fdfbb, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:03.243992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fac260-8e75-4e4f-b750-ea08345dbde7 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:03.262134 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 553/1081] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:37:03 2022] PUT /identity/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d/users/1e716d4e747b4842b5738b4ae49fdfbb/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:37:03.296156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ffa3b-8e4f-44e1-908f-40b9d7954967 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:03.334730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ea22c-76bc-4158-b26c-56fc9909017b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:03.335494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ea22c-76bc-4158-b26c-56fc9909017b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:03.335754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ea22c-76bc-4158-b26c-56fc9909017b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:03.335963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ea22c-76bc-4158-b26c-56fc9909017b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:03.408031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:03.411068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ea22c-76bc-4158-b26c-56fc9909017b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:03.413549 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ea22c-76bc-4158-b26c-56fc9909017b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:03.516680 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 529/1082] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:37:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 03:37:03.523075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fac260-8e75-4e4f-b750-ea08345dbde7 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:03.590391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:03.632446 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fac260-8e75-4e4f-b750-ea08345dbde7 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:03.667573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0862b-aa48-4183-a762-4cd0437eff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:03.668295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0862b-aa48-4183-a762-4cd0437eff5d None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:03.668574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0862b-aa48-4183-a762-4cd0437eff5d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:03.668848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0862b-aa48-4183-a762-4cd0437eff5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:03.679931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0862b-aa48-4183-a762-4cd0437eff5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:03.681383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0862b-aa48-4183-a762-4cd0437eff5d None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-c1a0862b-aa48-4183-a762-4cd0437eff5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:37:03.698711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:03.699671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:03.700600 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:37:03.700600 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:37:03.700600 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:37:03.700600 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:03.702869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 554/1083] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:03.706100 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ea22c-76bc-4158-b26c-56fc9909017b None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:03.805719 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:03.809354 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ea22c-76bc-4158-b26c-56fc9909017b None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:03.848058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfffdc-0cc2-468e-9d66-7c4e3c3876d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:03.848824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfffdc-0cc2-468e-9d66-7c4e3c3876d2 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:03.849174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfffdc-0cc2-468e-9d66-7c4e3c3876d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:03.849543 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfffdc-0cc2-468e-9d66-7c4e3c3876d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:03.850342 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfffdc-0cc2-468e-9d66-7c4e3c3876d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:03.850721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfffdc-0cc2-468e-9d66-7c4e3c3876d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:03.852186 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfffdc-0cc2-468e-9d66-7c4e3c3876d2 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:03.864620 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 530/1084] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:04.141184 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf3040-67e3-491b-9278-549d43027d45 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:04.141769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf3040-67e3-491b-9278-549d43027d45 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:04.141769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf3040-67e3-491b-9278-549d43027d45 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:04.143366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 555/1085] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:04.148863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2560c-6a07-495d-865f-86ea5f734f12 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:04.149150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2560c-6a07-495d-865f-86ea5f734f12 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:04.149430 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2560c-6a07-495d-865f-86ea5f734f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:04.166413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-bfe2560c-6a07-495d-865f-86ea5f734f12 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:04.167627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-bfe2560c-6a07-495d-865f-86ea5f734f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:04.236010 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 531/1086] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:04.260719 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf3040-67e3-491b-9278-549d43027d45 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:04.366163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf3040-67e3-491b-9278-549d43027d45 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:04.383870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:04.404173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed2c6c-97f1-40f9-98f4-1d72fea1dda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:04.404908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed2c6c-97f1-40f9-98f4-1d72fea1dda9 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:04.405192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed2c6c-97f1-40f9-98f4-1d72fea1dda9 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:04.405464 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed2c6c-97f1-40f9-98f4-1d72fea1dda9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:04.417817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed2c6c-97f1-40f9-98f4-1d72fea1dda9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-e2ed2c6c-97f1-40f9-98f4-1d72fea1dda9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:37:04.426225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:04.427242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:04.428072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:04.428072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:04.428072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:04.428072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:04.428072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:37:04.428072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:37:04.428072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:37:04.428072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:37:04.428072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:37:04.428072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:37:04.428072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 03:37:04.428072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:04.428072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 556/1087] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 30 03:37:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:04.433666 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2560c-6a07-495d-865f-86ea5f734f12 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:04.524461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:04.536055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2560c-6a07-495d-865f-86ea5f734f12 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:04.574469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f156b35-4b52-46f3-885a-446bd7f3a7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:04.575170 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f156b35-4b52-46f3-885a-446bd7f3a7c2 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:04.575457 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f156b35-4b52-46f3-885a-446bd7f3a7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:04.575733 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f156b35-4b52-46f3-885a-446bd7f3a7c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:04.576485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f156b35-4b52-46f3-885a-446bd7f3a7c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:04.576797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f156b35-4b52-46f3-885a-446bd7f3a7c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:04.578179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f156b35-4b52-46f3-885a-446bd7f3a7c2 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:04.586503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 532/1088] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 30 03:37:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:04.592337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed2c6c-97f1-40f9-98f4-1d72fea1dda9 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:04.694993 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed2c6c-97f1-40f9-98f4-1d72fea1dda9 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:04.730050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892ea72-8dde-4f13-832a-f9352dcf0f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:04.730863 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892ea72-8dde-4f13-832a-f9352dcf0f58 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:04.731143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892ea72-8dde-4f13-832a-f9352dcf0f58 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:04.731417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892ea72-8dde-4f13-832a-f9352dcf0f58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:04.742141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892ea72-8dde-4f13-832a-f9352dcf0f58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:04.743615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892ea72-8dde-4f13-832a-f9352dcf0f58 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-2892ea72-8dde-4f13-832a-f9352dcf0f58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:37:04.761248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:04.762163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:04.763207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:37:04.763207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:37:04.763207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:37:04.763207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:04.763207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 557/1089] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:04.768466 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f156b35-4b52-46f3-885a-446bd7f3a7c2 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:04.872953 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f156b35-4b52-46f3-885a-446bd7f3a7c2 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:04.910547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2091a9-5b7c-4861-a627-b8b76274a610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:04.911236 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2091a9-5b7c-4861-a627-b8b76274a610 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:04.911516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2091a9-5b7c-4861-a627-b8b76274a610 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:04.911783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2091a9-5b7c-4861-a627-b8b76274a610 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:04.912502 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2091a9-5b7c-4861-a627-b8b76274a610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:04.912807 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2091a9-5b7c-4861-a627-b8b76274a610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:04.914183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2091a9-5b7c-4861-a627-b8b76274a610 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:04.926539 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 533/1090] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:04.932190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892ea72-8dde-4f13-832a-f9352dcf0f58 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:04.960958 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:05.033978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892ea72-8dde-4f13-832a-f9352dcf0f58 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:05.068294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad115e-bb1e-4996-8ea9-f745003d893a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:05.069108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad115e-bb1e-4996-8ea9-f745003d893a None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:05.069382 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad115e-bb1e-4996-8ea9-f745003d893a None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:05.069650 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad115e-bb1e-4996-8ea9-f745003d893a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:05.076992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad115e-bb1e-4996-8ea9-f745003d893a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:05.078445 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad115e-bb1e-4996-8ea9-f745003d893a None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-34ad115e-bb1e-4996-8ea9-f745003d893a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:37:05.092835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:05.093811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:05.094751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:05.094751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:05.094751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:37:05.094751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:37:05.094751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:37:05.094751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:37:05.094751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:37:05.094751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:37:05.094751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 03:37:05.094751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:05.094751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 558/1091] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 03:37:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:05.100858 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2091a9-5b7c-4861-a627-b8b76274a610 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:05.116838 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:05.210666 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2091a9-5b7c-4861-a627-b8b76274a610 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:05.246196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759fd19-bba5-4fe6-8382-2b0f4f81314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:05.246795 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759fd19-bba5-4fe6-8382-2b0f4f81314b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:05.247094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759fd19-bba5-4fe6-8382-2b0f4f81314b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:05.247369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759fd19-bba5-4fe6-8382-2b0f4f81314b None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:05.248204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759fd19-bba5-4fe6-8382-2b0f4f81314b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:05.248508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759fd19-bba5-4fe6-8382-2b0f4f81314b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:05.249938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759fd19-bba5-4fe6-8382-2b0f4f81314b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:05.267857 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 534/1092] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 03:37:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:05.273654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad115e-bb1e-4996-8ea9-f745003d893a None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:05.307482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30adfd-f664-4224-ba48-633a5bc77f65 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:05.307764 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30adfd-f664-4224-ba48-633a5bc77f65 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:05.308037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30adfd-f664-4224-ba48-633a5bc77f65 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:05.309508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 535/1093] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:05.314453 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287cbdf-0487-4a8a-9076-761ecd712b62 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:05.314734 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287cbdf-0487-4a8a-9076-761ecd712b62 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:05.315040 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287cbdf-0487-4a8a-9076-761ecd712b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:05.331946 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6287cbdf-0487-4a8a-9076-761ecd712b62 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:05.333135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6287cbdf-0487-4a8a-9076-761ecd712b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:05.362547 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:05.374773 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad115e-bb1e-4996-8ea9-f745003d893a None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:05.398137 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:05.405005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 536/1094] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:05.409044 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da6362-4bc9-44d7-99c8-1a4fe0a45bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:05.409844 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da6362-4bc9-44d7-99c8-1a4fe0a45bc3 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:05.410227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da6362-4bc9-44d7-99c8-1a4fe0a45bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:05.410607 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da6362-4bc9-44d7-99c8-1a4fe0a45bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:05.428370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287cbdf-0487-4a8a-9076-761ecd712b62 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:05.477701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da6362-4bc9-44d7-99c8-1a4fe0a45bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:05.479195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da6362-4bc9-44d7-99c8-1a4fe0a45bc3 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:05.524173 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287cbdf-0487-4a8a-9076-761ecd712b62 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:05.558281 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1b031-ce2c-4736-a7d1-de0355b2b24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:05.559386 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1b031-ce2c-4736-a7d1-de0355b2b24b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:05.559625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1b031-ce2c-4736-a7d1-de0355b2b24b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:05.559902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1b031-ce2c-4736-a7d1-de0355b2b24b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:05.565492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:05.571461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1b031-ce2c-4736-a7d1-de0355b2b24b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:37:05.578837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 559/1095] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:37:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-61e1b031-ce2c-4736-a7d1-de0355b2b24b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:37:05.579222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:05.585640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:05.586508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:05.586508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:05.586508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:05.586508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:05.586508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:37:05.586508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:37:05.586508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:37:05.586508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:37:05.586508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:37:05.586508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:37:05.586508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:05.586508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:37:05.586508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 537/1096] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:37:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:37:05.587369 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da6362-4bc9-44d7-99c8-1a4fe0a45bc3 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:05.587445 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1b031-ce2c-4736-a7d1-de0355b2b24b None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:05.644135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:05.681833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da6362-4bc9-44d7-99c8-1a4fe0a45bc3 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:05.684167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1b031-ce2c-4736-a7d1-de0355b2b24b None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:05.715258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f57757-55ec-4fe2-8a2a-66c5d605394c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:05.716040 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f57757-55ec-4fe2-8a2a-66c5d605394c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:05.716320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f57757-55ec-4fe2-8a2a-66c5d605394c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:05.716589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f57757-55ec-4fe2-8a2a-66c5d605394c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:05.718623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c5fb-ccfa-468f-9fb4-c9954a1ea714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:05.719317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c5fb-ccfa-468f-9fb4-c9954a1ea714 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:05.719595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c5fb-ccfa-468f-9fb4-c9954a1ea714 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:05.719871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c5fb-ccfa-468f-9fb4-c9954a1ea714 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:05.721162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10c5fb-ccfa-468f-9fb4-c9954a1ea714 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:05.721480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10c5fb-ccfa-468f-9fb4-c9954a1ea714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:05.722893 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10c5fb-ccfa-468f-9fb4-c9954a1ea714 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:05.726940 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f57757-55ec-4fe2-8a2a-66c5d605394c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:05.728365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f57757-55ec-4fe2-8a2a-66c5d605394c None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:05.732066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 538/1097] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:37:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:37:05.738065 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c5fb-ccfa-468f-9fb4-c9954a1ea714 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-d4f57757-55ec-4fe2-8a2a-66c5d605394c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:37:05.745582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:05.746562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:05.747510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:37:05.747510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:37:05.747510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:37:05.747510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:05.747510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 560/1098] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:37:05.752437 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f57757-55ec-4fe2-8a2a-66c5d605394c None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:05.794230 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:05.836685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c5fb-ccfa-468f-9fb4-c9954a1ea714 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:05.853373 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f57757-55ec-4fe2-8a2a-66c5d605394c None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:05.863172 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:05.875264 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9cc09-25d0-4edf-810e-e6a1554462ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:05.876221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9cc09-25d0-4edf-810e-e6a1554462ff None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:05.876503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9cc09-25d0-4edf-810e-e6a1554462ff None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:05.876895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9cc09-25d0-4edf-810e-e6a1554462ff None admin] PATH_INFO: `/v3/users/1e716d4e747b4842b5738b4ae49fdfbb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:05.878126 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9cc09-25d0-4edf-810e-e6a1554462ff None admin] RBAC: Authorizing `identity:get_user(user_id=1e716d4e747b4842b5738b4ae49fdfbb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:05.879615 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9cc09-25d0-4edf-810e-e6a1554462ff None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:05.881286 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 539/1099] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:37:05 2022] GET /identity/v3/users/1e716d4e747b4842b5738b4ae49fdfbb => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:37:05.886963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9cc09-25d0-4edf-810e-e6a1554462ff None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:05.894450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ec06e-52ad-490a-b1b8-b42c55ae16b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:05.895234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ec06e-52ad-490a-b1b8-b42c55ae16b3 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:05.895521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ec06e-52ad-490a-b1b8-b42c55ae16b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:05.895813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ec06e-52ad-490a-b1b8-b42c55ae16b3 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:05.896534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ec06e-52ad-490a-b1b8-b42c55ae16b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:05.896834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ec06e-52ad-490a-b1b8-b42c55ae16b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:05.898197 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ec06e-52ad-490a-b1b8-b42c55ae16b3 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:05.913878 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 561/1100] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:37:05.914882 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ec06e-52ad-490a-b1b8-b42c55ae16b3 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:05.989532 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9cc09-25d0-4edf-810e-e6a1554462ff None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:06.009514 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:06.012745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ec06e-52ad-490a-b1b8-b42c55ae16b3 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:06.026548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec141d4-af6f-43e6-bf8c-bd90efec2024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:06.027237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec141d4-af6f-43e6-bf8c-bd90efec2024 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:06.027538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec141d4-af6f-43e6-bf8c-bd90efec2024 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:06.027813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec141d4-af6f-43e6-bf8c-bd90efec2024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:06.046164 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb764a8-abea-44e1-a568-2e7ddb79e159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:06.046926 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb764a8-abea-44e1-a568-2e7ddb79e159 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:06.047192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb764a8-abea-44e1-a568-2e7ddb79e159 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:06.047466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb764a8-abea-44e1-a568-2e7ddb79e159 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:06.054232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb764a8-abea-44e1-a568-2e7ddb79e159 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:06.055702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb764a8-abea-44e1-a568-2e7ddb79e159 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-2eb764a8-abea-44e1-a568-2e7ddb79e159 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:37:06.069933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:06.071140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:06.072521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:37:06.072521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:37:06.072521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:37:06.072521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:37:06.072521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:37:06.072521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:37:06.072521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:37:06.072521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:06.072521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 562/1101] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:37:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:06.076900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb764a8-abea-44e1-a568-2e7ddb79e159 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:06.084213 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:06.096310 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec141d4-af6f-43e6-bf8c-bd90efec2024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:06.097787 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec141d4-af6f-43e6-bf8c-bd90efec2024 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:06.175868 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb764a8-abea-44e1-a568-2e7ddb79e159 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:06.195627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 540/1102] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:37:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 03:37:06.201558 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec141d4-af6f-43e6-bf8c-bd90efec2024 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:06.215726 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253dd3d-90ec-47b4-bad0-5a878557e5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:06.216396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253dd3d-90ec-47b4-bad0-5a878557e5f1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:06.216674 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253dd3d-90ec-47b4-bad0-5a878557e5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:06.216951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253dd3d-90ec-47b4-bad0-5a878557e5f1 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:06.217743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253dd3d-90ec-47b4-bad0-5a878557e5f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:06.218054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253dd3d-90ec-47b4-bad0-5a878557e5f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:06.219647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253dd3d-90ec-47b4-bad0-5a878557e5f1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:06.231785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 563/1103] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:37:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:37:06.237821 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253dd3d-90ec-47b4-bad0-5a878557e5f1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:06.262785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:06.294945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:06.305524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec141d4-af6f-43e6-bf8c-bd90efec2024 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:06.341280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d0fc9-9d1a-41bb-b41f-7c775f126225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:06.342143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d0fc9-9d1a-41bb-b41f-7c775f126225 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:06.342287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253dd3d-90ec-47b4-bad0-5a878557e5f1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:06.342725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d0fc9-9d1a-41bb-b41f-7c775f126225 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:06.342725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d0fc9-9d1a-41bb-b41f-7c775f126225 None admin] PATH_INFO: `/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:06.343877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d0fc9-9d1a-41bb-b41f-7c775f126225 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b12f390d224ab28ab666ddbfb4b98d)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:06.345844 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d0fc9-9d1a-41bb-b41f-7c775f126225 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:06.347690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 541/1104] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:37:06 2022] GET /identity/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:06.353593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d0fc9-9d1a-41bb-b41f-7c775f126225 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:06.376024 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37eaf78-73cf-49e2-8943-52563df1b023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:06.376736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eaf78-73cf-49e2-8943-52563df1b023 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:06.377071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eaf78-73cf-49e2-8943-52563df1b023 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:06.377329 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eaf78-73cf-49e2-8943-52563df1b023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:06.378166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37eaf78-73cf-49e2-8943-52563df1b023 None admin] RBAC: Adding query filter params (role.id=b0a7381e3ca64076bf748e6c394483ca, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=758b152c320e4a94921bb96541cbea98) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:06.378477 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37eaf78-73cf-49e2-8943-52563df1b023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:06.379942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37eaf78-73cf-49e2-8943-52563df1b023 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:06.385868 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 564/1105] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:37:06 2022] GET /identity/v3/role_assignments?user.id=758b152c320e4a94921bb96541cbea98&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b0a7381e3ca64076bf748e6c394483ca => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:06.458472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d0fc9-9d1a-41bb-b41f-7c775f126225 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:06.496698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb17eb8-d3ce-4dff-870c-42d89a39b195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:06.497376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb17eb8-d3ce-4dff-870c-42d89a39b195 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:06.497652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb17eb8-d3ce-4dff-870c-42d89a39b195 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:06.497922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb17eb8-d3ce-4dff-870c-42d89a39b195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:06.498753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb17eb8-d3ce-4dff-870c-42d89a39b195 None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=a4b12f390d224ab28ab666ddbfb4b98d, user.id=1e716d4e747b4842b5738b4ae49fdfbb) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:06.499108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb17eb8-d3ce-4dff-870c-42d89a39b195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:06.500559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb17eb8-d3ce-4dff-870c-42d89a39b195 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:06.507629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 542/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:37:06 2022] GET /identity/v3/role_assignments?user.id=1e716d4e747b4842b5738b4ae49fdfbb&scope.project.id=a4b12f390d224ab28ab666ddbfb4b98d&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:08.607257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1d46-5d36-4634-a6f5-dc02d2b45164 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:08.607848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1d46-5d36-4634-a6f5-dc02d2b45164 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:08.607848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1d46-5d36-4634-a6f5-dc02d2b45164 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:08.609198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 565/1107] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:08.616564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db005d6a-7a02-45ba-a1f5-d2453c2fe89c None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:08.617307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db005d6a-7a02-45ba-a1f5-d2453c2fe89c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:08.617480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db005d6a-7a02-45ba-a1f5-d2453c2fe89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:08.639837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-db005d6a-7a02-45ba-a1f5-d2453c2fe89c None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:08.641023 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-db005d6a-7a02-45ba-a1f5-d2453c2fe89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:08.660220 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:08.713081 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 543/1108] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:08.738443 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f1d46-5d36-4634-a6f5-dc02d2b45164 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:08.829058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:08.848640 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f1d46-5d36-4634-a6f5-dc02d2b45164 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:08.885866 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7cf35-4905-4ad8-991b-b9fc618a516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:08.886677 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7cf35-4905-4ad8-991b-b9fc618a516b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:08.886991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7cf35-4905-4ad8-991b-b9fc618a516b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:08.887268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7cf35-4905-4ad8-991b-b9fc618a516b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:08.888553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7cf35-4905-4ad8-991b-b9fc618a516b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:08.890005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7cf35-4905-4ad8-991b-b9fc618a516b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:08.891690 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 566/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:37:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:08.897868 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db005d6a-7a02-45ba-a1f5-d2453c2fe89c None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:09.001283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db005d6a-7a02-45ba-a1f5-d2453c2fe89c None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:09.036460 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1986032-5578-4bf0-a8a6-1461118c1f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:09.037124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1986032-5578-4bf0-a8a6-1461118c1f99 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:09.037403 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1986032-5578-4bf0-a8a6-1461118c1f99 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:09.037675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1986032-5578-4bf0-a8a6-1461118c1f99 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:09.038378 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1986032-5578-4bf0-a8a6-1461118c1f99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:09.039859 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1986032-5578-4bf0-a8a6-1461118c1f99 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:09.063021 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 544/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:37:08 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:37:11.122813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766e104-5dec-4130-8ae1-dafc4a6bbbc3 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:11.123643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766e104-5dec-4130-8ae1-dafc4a6bbbc3 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:11.123643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766e104-5dec-4130-8ae1-dafc4a6bbbc3 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:11.125879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 567/1111] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:11.133867 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3078f-3c51-4636-844f-49f92f63776d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:11.134256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3078f-3c51-4636-844f-49f92f63776d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:11.134371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3078f-3c51-4636-844f-49f92f63776d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:11.153290 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e5d3078f-3c51-4636-844f-49f92f63776d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:11.154535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e5d3078f-3c51-4636-844f-49f92f63776d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:11.156607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:11.228136 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 545/1112] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:11.252566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766e104-5dec-4130-8ae1-dafc4a6bbbc3 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:11.361461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766e104-5dec-4130-8ae1-dafc4a6bbbc3 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:11.396579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aecd1-3d08-4373-8978-f86ad0d9f891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:11.397369 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aecd1-3d08-4373-8978-f86ad0d9f891 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:11.397644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aecd1-3d08-4373-8978-f86ad0d9f891 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:11.397911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aecd1-3d08-4373-8978-f86ad0d9f891 None admin] PATH_INFO: `/v3/roles/4af08bea19b94c2c863a51b103f50b8b` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:11.399514 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402aecd1-3d08-4373-8978-f86ad0d9f891 None admin] RBAC: Authorizing `identity:get_role(role_id=4af08bea19b94c2c863a51b103f50b8b)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:11.400883 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402aecd1-3d08-4373-8978-f86ad0d9f891 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:11.402234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 568/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:37:11 2022] GET /identity/v3/roles/4af08bea19b94c2c863a51b103f50b8b => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:11.411467 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3078f-3c51-4636-844f-49f92f63776d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:11.544660 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3078f-3c51-4636-844f-49f92f63776d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:11.583383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe80078-a1ab-41b4-aa19-bd2cd34c7afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:11.584270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe80078-a1ab-41b4-aa19-bd2cd34c7afd None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:11.584569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe80078-a1ab-41b4-aa19-bd2cd34c7afd None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:11.584828 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe80078-a1ab-41b4-aa19-bd2cd34c7afd None admin] PATH_INFO: `/v3/users/b0eb4bd50dd74e18bc1bf4b57e4f6159` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:11.592536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:11.599949 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe80078-a1ab-41b4-aa19-bd2cd34c7afd None admin] RBAC: Authorizing `identity:get_user(user_id=b0eb4bd50dd74e18bc1bf4b57e4f6159)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:11.601414 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe80078-a1ab-41b4-aa19-bd2cd34c7afd None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:11.603149 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 546/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:37:11 2022] GET /identity/v3/users/b0eb4bd50dd74e18bc1bf4b57e4f6159 => generated 286 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:11.609663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aecd1-3d08-4373-8978-f86ad0d9f891 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:11.638800 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:11.721617 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aecd1-3d08-4373-8978-f86ad0d9f891 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:11.756467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68712e50-5cec-4f0f-a3d4-7693a81ca543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:11.757114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712e50-5cec-4f0f-a3d4-7693a81ca543 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:11.757398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712e50-5cec-4f0f-a3d4-7693a81ca543 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:11.757673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712e50-5cec-4f0f-a3d4-7693a81ca543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:11.830663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68712e50-5cec-4f0f-a3d4-7693a81ca543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:11.832146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68712e50-5cec-4f0f-a3d4-7693a81ca543 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:11.853915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:11.935459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 569/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:37:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 03:37:11.944671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe80078-a1ab-41b4-aa19-bd2cd34c7afd None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:12.051548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe80078-a1ab-41b4-aa19-bd2cd34c7afd None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:12.086789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d31c6-2b19-4731-bdff-9f1404cfbddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:12.087642 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d31c6-2b19-4731-bdff-9f1404cfbddd None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:12.087925 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d31c6-2b19-4731-bdff-9f1404cfbddd None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:12.088198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d31c6-2b19-4731-bdff-9f1404cfbddd None admin] PATH_INFO: `/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:12.089484 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d31c6-2b19-4731-bdff-9f1404cfbddd None admin] RBAC: Authorizing `identity:get_project(project_id=a4b12f390d224ab28ab666ddbfb4b98d)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:12.090963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d31c6-2b19-4731-bdff-9f1404cfbddd None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:12.092655 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 547/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:37:11 2022] GET /identity/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:12.102201 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68712e50-5cec-4f0f-a3d4-7693a81ca543 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:12.209189 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68712e50-5cec-4f0f-a3d4-7693a81ca543 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:12.230531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:12.245824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052a0bd-ee94-4095-ba3a-fff780579b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:12.246467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052a0bd-ee94-4095-ba3a-fff780579b87 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:12.246749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052a0bd-ee94-4095-ba3a-fff780579b87 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:12.247058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052a0bd-ee94-4095-ba3a-fff780579b87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:12.247889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052a0bd-ee94-4095-ba3a-fff780579b87 None admin] RBAC: Adding query filter params (role.id=4af08bea19b94c2c863a51b103f50b8b, scope.project.id=a4b12f390d224ab28ab666ddbfb4b98d, user.id=b0eb4bd50dd74e18bc1bf4b57e4f6159) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:12.248205 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052a0bd-ee94-4095-ba3a-fff780579b87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:12.249630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052a0bd-ee94-4095-ba3a-fff780579b87 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:12.255626 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 570/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:37:12 2022] GET /identity/v3/role_assignments?user.id=b0eb4bd50dd74e18bc1bf4b57e4f6159&scope.project.id=a4b12f390d224ab28ab666ddbfb4b98d&role.id=4af08bea19b94c2c863a51b103f50b8b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:37:14.240002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4aa4a-30ba-4b21-944e-17258ffd19a9 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:14.240877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4aa4a-30ba-4b21-944e-17258ffd19a9 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:14.240877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4aa4a-30ba-4b21-944e-17258ffd19a9 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:14.242950 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 548/1118] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:14.249216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fb176-cac8-4756-a321-4a605f9b38c0 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:14.249672 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fb176-cac8-4756-a321-4a605f9b38c0 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:14.249794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fb176-cac8-4756-a321-4a605f9b38c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:14.269874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-282fb176-cac8-4756-a321-4a605f9b38c0 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:14.271095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-282fb176-cac8-4756-a321-4a605f9b38c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:14.342193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 571/1119] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:14.366130 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4aa4a-30ba-4b21-944e-17258ffd19a9 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:14.436754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:14.477863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4aa4a-30ba-4b21-944e-17258ffd19a9 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:14.513726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98c953-a6d1-4e71-83f8-5c4db4c87505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:14.514519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98c953-a6d1-4e71-83f8-5c4db4c87505 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:14.514812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98c953-a6d1-4e71-83f8-5c4db4c87505 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:14.515104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98c953-a6d1-4e71-83f8-5c4db4c87505 None admin] PATH_INFO: `/v3/roles/4af08bea19b94c2c863a51b103f50b8b` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:14.516755 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98c953-a6d1-4e71-83f8-5c4db4c87505 None admin] RBAC: Authorizing `identity:get_role(role_id=4af08bea19b94c2c863a51b103f50b8b)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:14.518142 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98c953-a6d1-4e71-83f8-5c4db4c87505 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:14.519567 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 549/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:37:14 2022] GET /identity/v3/roles/4af08bea19b94c2c863a51b103f50b8b => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:14.525589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fb176-cac8-4756-a321-4a605f9b38c0 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:14.630558 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fb176-cac8-4756-a321-4a605f9b38c0 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:14.644944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:14.667378 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cbdb0-d607-4ce9-bf15-33b229ca7cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:14.668257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cbdb0-d607-4ce9-bf15-33b229ca7cae None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:14.668541 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cbdb0-d607-4ce9-bf15-33b229ca7cae None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:14.668816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cbdb0-d607-4ce9-bf15-33b229ca7cae None admin] PATH_INFO: `/v3/users/b0eb4bd50dd74e18bc1bf4b57e4f6159` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:14.670141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cbdb0-d607-4ce9-bf15-33b229ca7cae None admin] RBAC: Authorizing `identity:get_user(user_id=b0eb4bd50dd74e18bc1bf4b57e4f6159)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:14.671608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cbdb0-d607-4ce9-bf15-33b229ca7cae None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:14.673287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 572/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:37:14 2022] GET /identity/v3/users/b0eb4bd50dd74e18bc1bf4b57e4f6159 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:14.679362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98c953-a6d1-4e71-83f8-5c4db4c87505 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:14.790473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98c953-a6d1-4e71-83f8-5c4db4c87505 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:14.820768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:14.827274 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5574e-ce2c-4ec1-b69b-963bb68bf020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:14.828142 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5574e-ce2c-4ec1-b69b-963bb68bf020 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:14.828419 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5574e-ce2c-4ec1-b69b-963bb68bf020 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:14.828693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5574e-ce2c-4ec1-b69b-963bb68bf020 None admin] PATH_INFO: `/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:14.829921 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5574e-ce2c-4ec1-b69b-963bb68bf020 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b12f390d224ab28ab666ddbfb4b98d)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:14.831402 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5574e-ce2c-4ec1-b69b-963bb68bf020 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:14.833107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 550/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:37:14 2022] GET /identity/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:14.840195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cbdb0-d607-4ce9-bf15-33b229ca7cae None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:14.945709 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cbdb0-d607-4ce9-bf15-33b229ca7cae None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:14.980646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4d7d5-ffbf-4815-892c-ca8f32fbb46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:14.981525 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4d7d5-ffbf-4815-892c-ca8f32fbb46d None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:14.981797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4d7d5-ffbf-4815-892c-ca8f32fbb46d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:14.982067 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4d7d5-ffbf-4815-892c-ca8f32fbb46d None admin] PATH_INFO: `/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d/users/b0eb4bd50dd74e18bc1bf4b57e4f6159/roles/4af08bea19b94c2c863a51b103f50b8b` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:14.984639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4d7d5-ffbf-4815-892c-ca8f32fbb46d None admin] RBAC: Authorizing `identity:create_grant(project_id=a4b12f390d224ab28ab666ddbfb4b98d, user_id=b0eb4bd50dd74e18bc1bf4b57e4f6159, role_id=4af08bea19b94c2c863a51b103f50b8b)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:14.986192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4d7d5-ffbf-4815-892c-ca8f32fbb46d None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:15.001507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 573/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:37:14 2022] PUT /identity/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d/users/b0eb4bd50dd74e18bc1bf4b57e4f6159/roles/4af08bea19b94c2c863a51b103f50b8b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:37:16.992838 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9adae7-2be4-4b80-91a4-d86994da78c3 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:16.993397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9adae7-2be4-4b80-91a4-d86994da78c3 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:16.993397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9adae7-2be4-4b80-91a4-d86994da78c3 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:16.995727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 551/1124] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:17.003581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2120c5-a00b-4a8b-94a1-e826806ec192 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:17.003981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2120c5-a00b-4a8b-94a1-e826806ec192 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:17.004126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2120c5-a00b-4a8b-94a1-e826806ec192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:17.021795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-2e2120c5-a00b-4a8b-94a1-e826806ec192 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:17.023009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2e2120c5-a00b-4a8b-94a1-e826806ec192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:17.071751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:17.106509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 574/1125] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:17.130334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9adae7-2be4-4b80-91a4-d86994da78c3 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:17.238118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9adae7-2be4-4b80-91a4-d86994da78c3 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:17.273964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799045b8-801d-432f-b1d7-61ddd505b857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:17.274810 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799045b8-801d-432f-b1d7-61ddd505b857 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:17.275112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799045b8-801d-432f-b1d7-61ddd505b857 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:17.275376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799045b8-801d-432f-b1d7-61ddd505b857 None admin] PATH_INFO: `/v3/roles/4af08bea19b94c2c863a51b103f50b8b` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:17.276869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799045b8-801d-432f-b1d7-61ddd505b857 None admin] RBAC: Authorizing `identity:get_role(role_id=4af08bea19b94c2c863a51b103f50b8b)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:17.278245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799045b8-801d-432f-b1d7-61ddd505b857 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:17.279654 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 552/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:37:17 2022] GET /identity/v3/roles/4af08bea19b94c2c863a51b103f50b8b => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:17.286397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2120c5-a00b-4a8b-94a1-e826806ec192 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:17.402618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2120c5-a00b-4a8b-94a1-e826806ec192 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:17.441453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd4dd4-2fe6-4336-993b-4f7d707347ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:17.442326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd4dd4-2fe6-4336-993b-4f7d707347ae None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:17.442613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd4dd4-2fe6-4336-993b-4f7d707347ae None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:17.442922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd4dd4-2fe6-4336-993b-4f7d707347ae None admin] PATH_INFO: `/v3/users/b0eb4bd50dd74e18bc1bf4b57e4f6159` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:17.444232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd4dd4-2fe6-4336-993b-4f7d707347ae None admin] RBAC: Authorizing `identity:get_user(user_id=b0eb4bd50dd74e18bc1bf4b57e4f6159)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:17.445679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd4dd4-2fe6-4336-993b-4f7d707347ae None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:17.447347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 575/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:37:17 2022] GET /identity/v3/users/b0eb4bd50dd74e18bc1bf4b57e4f6159 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:17.455952 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799045b8-801d-432f-b1d7-61ddd505b857 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:17.531303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:17.574689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799045b8-801d-432f-b1d7-61ddd505b857 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:17.612225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9942fcd-246f-41a2-9641-ee505b1085ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:17.612866 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9942fcd-246f-41a2-9641-ee505b1085ee None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:17.613144 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9942fcd-246f-41a2-9641-ee505b1085ee None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:17.613415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9942fcd-246f-41a2-9641-ee505b1085ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:17.684655 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9942fcd-246f-41a2-9641-ee505b1085ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:17.686032 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9942fcd-246f-41a2-9641-ee505b1085ee None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:17.755121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:17.792739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 553/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:37:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:37:17.799180 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd4dd4-2fe6-4336-993b-4f7d707347ae None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:17.846325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:17.909118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd4dd4-2fe6-4336-993b-4f7d707347ae None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:17.944218 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd421e5-7865-4d10-aa29-0d8b6599e299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:17.945020 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd421e5-7865-4d10-aa29-0d8b6599e299 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:17.945297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd421e5-7865-4d10-aa29-0d8b6599e299 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:17.945572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd421e5-7865-4d10-aa29-0d8b6599e299 None admin] PATH_INFO: `/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:17.946811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd421e5-7865-4d10-aa29-0d8b6599e299 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b12f390d224ab28ab666ddbfb4b98d)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:17.948276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd421e5-7865-4d10-aa29-0d8b6599e299 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:17.950004 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 576/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:37:17 2022] GET /identity/v3/projects/a4b12f390d224ab28ab666ddbfb4b98d => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:17.957360 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9942fcd-246f-41a2-9641-ee505b1085ee None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:18.069335 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9942fcd-246f-41a2-9641-ee505b1085ee None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:18.104294 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0450e-d04b-4505-9cc3-30a73181d4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:18.104931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0450e-d04b-4505-9cc3-30a73181d4a6 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:18.105207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0450e-d04b-4505-9cc3-30a73181d4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:18.105480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0450e-d04b-4505-9cc3-30a73181d4a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:18.106306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0450e-d04b-4505-9cc3-30a73181d4a6 None admin] RBAC: Adding query filter params (role.id=4af08bea19b94c2c863a51b103f50b8b, scope.project.id=a4b12f390d224ab28ab666ddbfb4b98d, user.id=b0eb4bd50dd74e18bc1bf4b57e4f6159) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:18.106615 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0450e-d04b-4505-9cc3-30a73181d4a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:18.108085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0450e-d04b-4505-9cc3-30a73181d4a6 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:18.116305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 554/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:37:17 2022] GET /identity/v3/role_assignments?user.id=b0eb4bd50dd74e18bc1bf4b57e4f6159&scope.project.id=a4b12f390d224ab28ab666ddbfb4b98d&role.id=4af08bea19b94c2c863a51b103f50b8b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:20.177106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e520e-ad5d-4d49-8795-0c2233f5bdad None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:20.177652 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e520e-ad5d-4d49-8795-0c2233f5bdad None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:20.177652 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e520e-ad5d-4d49-8795-0c2233f5bdad None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:20.178976 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 577/1131] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:20.185280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ee6cf-fd86-43f7-ad79-c130a276446d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:20.186005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ee6cf-fd86-43f7-ad79-c130a276446d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:20.186148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ee6cf-fd86-43f7-ad79-c130a276446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:20.210855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ed0ee6cf-fd86-43f7-ad79-c130a276446d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:20.212039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ed0ee6cf-fd86-43f7-ad79-c130a276446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:20.240576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:20.286712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 555/1132] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:20.310310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e520e-ad5d-4d49-8795-0c2233f5bdad None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:20.426615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e520e-ad5d-4d49-8795-0c2233f5bdad None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:20.435892 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:20.462755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efab887-33d7-4acb-add2-dc635324daa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:20.463569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efab887-33d7-4acb-add2-dc635324daa8 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:20.463848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efab887-33d7-4acb-add2-dc635324daa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:20.464118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efab887-33d7-4acb-add2-dc635324daa8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:20.465402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efab887-33d7-4acb-add2-dc635324daa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:20.466877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efab887-33d7-4acb-add2-dc635324daa8 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:20.468476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 578/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:37:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:20.475028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ee6cf-fd86-43f7-ad79-c130a276446d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:20.577769 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ee6cf-fd86-43f7-ad79-c130a276446d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:20.621238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3baaa7-b406-4567-b99f-35ed0bd50255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:20.621896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3baaa7-b406-4567-b99f-35ed0bd50255 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:20.622175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3baaa7-b406-4567-b99f-35ed0bd50255 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:20.622444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3baaa7-b406-4567-b99f-35ed0bd50255 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:20.623192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3baaa7-b406-4567-b99f-35ed0bd50255 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:20.624634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3baaa7-b406-4567-b99f-35ed0bd50255 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:20.653007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 556/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 03:37:20 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:37:22.691233 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d374f-a5f5-44a0-81fa-4121fbccf5f1 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:22.692124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d374f-a5f5-44a0-81fa-4121fbccf5f1 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:22.692124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d374f-a5f5-44a0-81fa-4121fbccf5f1 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:22.694258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 579/1135] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:22.702194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38865d-6378-41a1-aa16-0a2f78a9b2ba None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:22.702652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38865d-6378-41a1-aa16-0a2f78a9b2ba None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:22.702745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38865d-6378-41a1-aa16-0a2f78a9b2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:22.720885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-be38865d-6378-41a1-aa16-0a2f78a9b2ba None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:22.722070 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-be38865d-6378-41a1-aa16-0a2f78a9b2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:22.731291 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:22.794672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 557/1136] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:37:22.827347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d374f-a5f5-44a0-81fa-4121fbccf5f1 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:22.934302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d374f-a5f5-44a0-81fa-4121fbccf5f1 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:22.969587 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f5bb5-5fea-4da4-a7ef-dba6949762a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:22.970308 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f5bb5-5fea-4da4-a7ef-dba6949762a2 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:22.970582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f5bb5-5fea-4da4-a7ef-dba6949762a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:22.970882 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f5bb5-5fea-4da4-a7ef-dba6949762a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:22.972172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f5bb5-5fea-4da4-a7ef-dba6949762a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:22.973595 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f5bb5-5fea-4da4-a7ef-dba6949762a2 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:22.975243 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 580/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:37:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:22.981451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38865d-6378-41a1-aa16-0a2f78a9b2ba None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:23.086813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38865d-6378-41a1-aa16-0a2f78a9b2ba None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:23.122630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7048f79-f12f-4adf-9c29-1e803216b9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:23.123323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7048f79-f12f-4adf-9c29-1e803216b9c6 None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:23.123599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7048f79-f12f-4adf-9c29-1e803216b9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:23.123870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7048f79-f12f-4adf-9c29-1e803216b9c6 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:23.124586 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7048f79-f12f-4adf-9c29-1e803216b9c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:23.126285 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7048f79-f12f-4adf-9c29-1e803216b9c6 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:23.145141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:23.150244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 558/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:37:22 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:37:25.217089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b38f7-db95-4def-9e6e-a801aabe26d4 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:25.217909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b38f7-db95-4def-9e6e-a801aabe26d4 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:25.217909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b38f7-db95-4def-9e6e-a801aabe26d4 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:25.220272 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 581/1139] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:25.225895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556fa3b-ee64-4dd9-8e3b-0d3dcca375c2 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:25.226331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556fa3b-ee64-4dd9-8e3b-0d3dcca375c2 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:25.226441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556fa3b-ee64-4dd9-8e3b-0d3dcca375c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:25.245017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-c556fa3b-ee64-4dd9-8e3b-0d3dcca375c2 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:25.246198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-c556fa3b-ee64-4dd9-8e3b-0d3dcca375c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:25.317183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 559/1140] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:37:25.341799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b38f7-db95-4def-9e6e-a801aabe26d4 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:25.394349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:25.454032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b38f7-db95-4def-9e6e-a801aabe26d4 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:25.489987 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2587c4b-be77-438d-acb2-c97531ef72d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:25.490744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2587c4b-be77-438d-acb2-c97531ef72d9 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:25.491052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2587c4b-be77-438d-acb2-c97531ef72d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:25.491309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2587c4b-be77-438d-acb2-c97531ef72d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:25.501640 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2587c4b-be77-438d-acb2-c97531ef72d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-a2587c4b-be77-438d-acb2-c97531ef72d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:37:25.509334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:25.510417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:25.511391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:25.511391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:25.511391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:25.511391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:25.511391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:37:25.511391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:37:25.511391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:37:25.511391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:37:25.511391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:37:25.511391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:37:25.511391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:25.511391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:25.511391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 582/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:37:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:25.519296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556fa3b-ee64-4dd9-8e3b-0d3dcca375c2 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:25.631709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556fa3b-ee64-4dd9-8e3b-0d3dcca375c2 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:25.663713 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:25.671508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bd8e9-b76a-4795-a21d-d72b79d81249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:25.672281 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bd8e9-b76a-4795-a21d-d72b79d81249 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:25.672566 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bd8e9-b76a-4795-a21d-d72b79d81249 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:25.672830 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bd8e9-b76a-4795-a21d-d72b79d81249 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:25.673574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bd8e9-b76a-4795-a21d-d72b79d81249 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:25.673875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bd8e9-b76a-4795-a21d-d72b79d81249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:25.675276 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bd8e9-b76a-4795-a21d-d72b79d81249 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:25.684086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 560/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:37:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:25.690088 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2587c4b-be77-438d-acb2-c97531ef72d9 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:25.805718 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2587c4b-be77-438d-acb2-c97531ef72d9 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:25.808014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:25.840250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e1f90-7412-42cc-ae51-80d99b164119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:25.841122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e1f90-7412-42cc-ae51-80d99b164119 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:25.841399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e1f90-7412-42cc-ae51-80d99b164119 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:25.841671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e1f90-7412-42cc-ae51-80d99b164119 None admin] PATH_INFO: `/v3/users/247a77a0b8614eed95103984ae215a0e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:25.857562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e1f90-7412-42cc-ae51-80d99b164119 None admin] RBAC: Authorizing `identity:get_user(user_id=247a77a0b8614eed95103984ae215a0e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:25.859985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e1f90-7412-42cc-ae51-80d99b164119 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:25.862666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 583/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:37:25 2022] GET /identity/v3/users/247a77a0b8614eed95103984ae215a0e => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:25.869200 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bd8e9-b76a-4795-a21d-d72b79d81249 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:25.977351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bd8e9-b76a-4795-a21d-d72b79d81249 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:26.015987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dbf1a-40de-48a6-b6de-a6f226f5cb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:26.016632 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dbf1a-40de-48a6-b6de-a6f226f5cb46 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:26.016917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dbf1a-40de-48a6-b6de-a6f226f5cb46 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:26.017185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dbf1a-40de-48a6-b6de-a6f226f5cb46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:26.081660 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:26.096861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8dbf1a-40de-48a6-b6de-a6f226f5cb46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:26.098313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8dbf1a-40de-48a6-b6de-a6f226f5cb46 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:26.201020 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 561/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:37:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:37:26.207905 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e1f90-7412-42cc-ae51-80d99b164119 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:26.327681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e1f90-7412-42cc-ae51-80d99b164119 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:26.368479 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f5a34-62da-4b10-91dc-507bb68b1a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:26.369348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f5a34-62da-4b10-91dc-507bb68b1a93 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:26.369636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f5a34-62da-4b10-91dc-507bb68b1a93 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:26.369911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f5a34-62da-4b10-91dc-507bb68b1a93 None admin] PATH_INFO: `/v3/projects/223d8cc82457430883e40f85ea85bd0c` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:26.371247 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f5a34-62da-4b10-91dc-507bb68b1a93 None admin] RBAC: Authorizing `identity:get_project(project_id=223d8cc82457430883e40f85ea85bd0c)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:26.372694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f5a34-62da-4b10-91dc-507bb68b1a93 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:26.374395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 584/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:37:26 2022] GET /identity/v3/projects/223d8cc82457430883e40f85ea85bd0c => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:26.384643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dbf1a-40de-48a6-b6de-a6f226f5cb46 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:26.484075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:26.499424 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dbf1a-40de-48a6-b6de-a6f226f5cb46 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:26.540117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e9f7a-a92b-4122-8a59-d64a56f115c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:26.540768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e9f7a-a92b-4122-8a59-d64a56f115c0 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:26.541048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e9f7a-a92b-4122-8a59-d64a56f115c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:26.541347 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e9f7a-a92b-4122-8a59-d64a56f115c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:26.542179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e9f7a-a92b-4122-8a59-d64a56f115c0 None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=223d8cc82457430883e40f85ea85bd0c, user.id=247a77a0b8614eed95103984ae215a0e) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:26.542491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e9f7a-a92b-4122-8a59-d64a56f115c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:26.543978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e9f7a-a92b-4122-8a59-d64a56f115c0 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:26.552309 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 562/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:37:26 2022] GET /identity/v3/role_assignments?user.id=247a77a0b8614eed95103984ae215a0e&scope.project.id=223d8cc82457430883e40f85ea85bd0c&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:28.541799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf967b-b5be-4d15-8e24-c89ca442bb19 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:28.542708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf967b-b5be-4d15-8e24-c89ca442bb19 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:28.542708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf967b-b5be-4d15-8e24-c89ca442bb19 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:28.544915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 585/1147] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:28.551539 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8735bda-638c-4a85-a8ca-068fcd4c1a9c None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:28.551994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8735bda-638c-4a85-a8ca-068fcd4c1a9c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:28.552085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8735bda-638c-4a85-a8ca-068fcd4c1a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:28.570207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-b8735bda-638c-4a85-a8ca-068fcd4c1a9c None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:28.571429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-b8735bda-638c-4a85-a8ca-068fcd4c1a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:28.651657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 563/1148] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:37:28.674462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf967b-b5be-4d15-8e24-c89ca442bb19 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:28.709985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:28.804286 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf967b-b5be-4d15-8e24-c89ca442bb19 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:28.841160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fdcbc-f4ea-4fa2-b123-d9daf20a2cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:28.841962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fdcbc-f4ea-4fa2-b123-d9daf20a2cee None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:28.842243 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fdcbc-f4ea-4fa2-b123-d9daf20a2cee None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:28.842522 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fdcbc-f4ea-4fa2-b123-d9daf20a2cee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:28.854455 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fdcbc-f4ea-4fa2-b123-d9daf20a2cee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-e79fdcbc-f4ea-4fa2-b123-d9daf20a2cee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:37:28.862314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:28.863424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:28.864491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:28.864491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:28.864491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:28.864491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:28.864491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:37:28.864491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:37:28.864491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:37:28.864491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:37:28.864491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:37:28.864491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:37:28.864491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:28.864491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:28.864491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 586/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:37:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:28.869989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8735bda-638c-4a85-a8ca-068fcd4c1a9c None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:28.958514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:28.975295 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8735bda-638c-4a85-a8ca-068fcd4c1a9c None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:29.020179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2139f62-1229-4f5b-9f5e-112d8e4636b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:29.021125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2139f62-1229-4f5b-9f5e-112d8e4636b1 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:29.021493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2139f62-1229-4f5b-9f5e-112d8e4636b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:29.021840 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2139f62-1229-4f5b-9f5e-112d8e4636b1 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:29.023029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2139f62-1229-4f5b-9f5e-112d8e4636b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:29.023461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2139f62-1229-4f5b-9f5e-112d8e4636b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:29.025588 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2139f62-1229-4f5b-9f5e-112d8e4636b1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:29.036007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 564/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:37:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:37:29.044678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fdcbc-f4ea-4fa2-b123-d9daf20a2cee None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:29.163740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:29.174526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fdcbc-f4ea-4fa2-b123-d9daf20a2cee None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:29.209444 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2063e-c446-4618-a9e9-eb309c830912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:29.210314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2063e-c446-4618-a9e9-eb309c830912 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:29.210599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2063e-c446-4618-a9e9-eb309c830912 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:29.210900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2063e-c446-4618-a9e9-eb309c830912 None admin] PATH_INFO: `/v3/users/247a77a0b8614eed95103984ae215a0e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:29.212215 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2063e-c446-4618-a9e9-eb309c830912 None admin] RBAC: Authorizing `identity:get_user(user_id=247a77a0b8614eed95103984ae215a0e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:29.213656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2063e-c446-4618-a9e9-eb309c830912 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:29.215326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 587/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:37:29 2022] GET /identity/v3/users/247a77a0b8614eed95103984ae215a0e => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:29.222396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2139f62-1229-4f5b-9f5e-112d8e4636b1 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:29.331708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2139f62-1229-4f5b-9f5e-112d8e4636b1 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:29.368028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d76ed-3e26-48da-9cd8-3a0ab86e07f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:29.368889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d76ed-3e26-48da-9cd8-3a0ab86e07f1 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:29.369167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d76ed-3e26-48da-9cd8-3a0ab86e07f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:29.369437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d76ed-3e26-48da-9cd8-3a0ab86e07f1 None admin] PATH_INFO: `/v3/projects/223d8cc82457430883e40f85ea85bd0c` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:29.370724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d76ed-3e26-48da-9cd8-3a0ab86e07f1 None admin] RBAC: Authorizing `identity:get_project(project_id=223d8cc82457430883e40f85ea85bd0c)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:29.372203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d76ed-3e26-48da-9cd8-3a0ab86e07f1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:29.373917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 565/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:37:29 2022] GET /identity/v3/projects/223d8cc82457430883e40f85ea85bd0c => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:29.380658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2063e-c446-4618-a9e9-eb309c830912 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:29.500709 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2063e-c446-4618-a9e9-eb309c830912 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:29.535510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cbb0b-ffd8-4288-bd0d-61421d7598a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:29.536393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cbb0b-ffd8-4288-bd0d-61421d7598a8 None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:29.536669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cbb0b-ffd8-4288-bd0d-61421d7598a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:29.536942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cbb0b-ffd8-4288-bd0d-61421d7598a8 None admin] PATH_INFO: `/v3/projects/223d8cc82457430883e40f85ea85bd0c/users/247a77a0b8614eed95103984ae215a0e/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:29.539156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cbb0b-ffd8-4288-bd0d-61421d7598a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=223d8cc82457430883e40f85ea85bd0c, user_id=247a77a0b8614eed95103984ae215a0e, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:29.540594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cbb0b-ffd8-4288-bd0d-61421d7598a8 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:29.560161 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 588/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:37:29 2022] PUT /identity/v3/projects/223d8cc82457430883e40f85ea85bd0c/users/247a77a0b8614eed95103984ae215a0e/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:37:31.584963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5b688-d55f-4392-bd99-38cb9c2841b6 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:31.585504 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5b688-d55f-4392-bd99-38cb9c2841b6 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:31.585504 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5b688-d55f-4392-bd99-38cb9c2841b6 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:31.586940 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 566/1154] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:31.593739 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d81f7-ad00-4514-a9e4-2040ddb153ef None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:31.594472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d81f7-ad00-4514-a9e4-2040ddb153ef None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:31.594654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d81f7-ad00-4514-a9e4-2040ddb153ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:31.618166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-879d81f7-ad00-4514-a9e4-2040ddb153ef None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:31.620323 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-879d81f7-ad00-4514-a9e4-2040ddb153ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:31.640010 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:31.716189 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 589/1155] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:31.741259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5b688-d55f-4392-bd99-38cb9c2841b6 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:31.765082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:31.860932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5b688-d55f-4392-bd99-38cb9c2841b6 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:31.899107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62933d57-ac50-47fd-8f49-4bc5f6db383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:31.899849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62933d57-ac50-47fd-8f49-4bc5f6db383e None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:31.900125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62933d57-ac50-47fd-8f49-4bc5f6db383e None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:31.900389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62933d57-ac50-47fd-8f49-4bc5f6db383e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:31.912497 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62933d57-ac50-47fd-8f49-4bc5f6db383e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-62933d57-ac50-47fd-8f49-4bc5f6db383e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:37:31.920024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:31.921075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:31.922075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:31.922075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:31.922075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:31.922075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:31.922075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:37:31.922075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:37:31.922075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:37:31.922075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:37:31.922075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:37:31.922075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:37:31.922075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:31.922075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:37:31.922075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 567/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:37:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:31.930442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d81f7-ad00-4514-a9e4-2040ddb153ef None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:32.062545 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d81f7-ad00-4514-a9e4-2040ddb153ef None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:32.105140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386420bf-bcc6-4c3a-aca8-9d76d112241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:32.105816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386420bf-bcc6-4c3a-aca8-9d76d112241a None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:32.106100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386420bf-bcc6-4c3a-aca8-9d76d112241a None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:32.106375 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386420bf-bcc6-4c3a-aca8-9d76d112241a None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:32.107267 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386420bf-bcc6-4c3a-aca8-9d76d112241a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:32.107577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386420bf-bcc6-4c3a-aca8-9d76d112241a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:32.109356 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386420bf-bcc6-4c3a-aca8-9d76d112241a None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:32.118985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 590/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:37:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:32.126672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62933d57-ac50-47fd-8f49-4bc5f6db383e None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:32.230308 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:32.261870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62933d57-ac50-47fd-8f49-4bc5f6db383e None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:32.307873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3c11e-d20c-4e85-b421-f9bec7d757df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:32.308756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3c11e-d20c-4e85-b421-f9bec7d757df None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:32.309017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3c11e-d20c-4e85-b421-f9bec7d757df None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:32.309279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3c11e-d20c-4e85-b421-f9bec7d757df None admin] PATH_INFO: `/v3/users/247a77a0b8614eed95103984ae215a0e` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:32.310646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3c11e-d20c-4e85-b421-f9bec7d757df None admin] RBAC: Authorizing `identity:get_user(user_id=247a77a0b8614eed95103984ae215a0e)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:32.312876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3c11e-d20c-4e85-b421-f9bec7d757df None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:32.315970 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 568/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:37:32 2022] GET /identity/v3/users/247a77a0b8614eed95103984ae215a0e => generated 286 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:32.327065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386420bf-bcc6-4c3a-aca8-9d76d112241a None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:32.340888 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:32.437307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386420bf-bcc6-4c3a-aca8-9d76d112241a None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:32.474091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee85e0-0582-4156-a789-3dfa93485b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:32.474729 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee85e0-0582-4156-a789-3dfa93485b0d None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:32.475037 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee85e0-0582-4156-a789-3dfa93485b0d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:32.475294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee85e0-0582-4156-a789-3dfa93485b0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:32.543583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee85e0-0582-4156-a789-3dfa93485b0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:32.545032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee85e0-0582-4156-a789-3dfa93485b0d None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:32.556609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:32.651219 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 591/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:37:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:37:32.660615 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3c11e-d20c-4e85-b421-f9bec7d757df None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:32.765768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3c11e-d20c-4e85-b421-f9bec7d757df None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:32.802596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e6b9e-69d4-4876-8e41-bb86a7596960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:32.803486 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6b9e-69d4-4876-8e41-bb86a7596960 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:32.803768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6b9e-69d4-4876-8e41-bb86a7596960 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:32.804038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6b9e-69d4-4876-8e41-bb86a7596960 None admin] PATH_INFO: `/v3/projects/223d8cc82457430883e40f85ea85bd0c` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:32.805211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e6b9e-69d4-4876-8e41-bb86a7596960 None admin] RBAC: Authorizing `identity:get_project(project_id=223d8cc82457430883e40f85ea85bd0c)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:32.806667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e6b9e-69d4-4876-8e41-bb86a7596960 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:32.808403 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 569/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:37:32 2022] GET /identity/v3/projects/223d8cc82457430883e40f85ea85bd0c => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:32.814651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee85e0-0582-4156-a789-3dfa93485b0d None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:32.924505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee85e0-0582-4156-a789-3dfa93485b0d None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:32.935191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:32.963268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8c6ce-d17d-4af2-a995-fabf22d0432a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:32.963918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8c6ce-d17d-4af2-a995-fabf22d0432a None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:32.964204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8c6ce-d17d-4af2-a995-fabf22d0432a None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:32.964478 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8c6ce-d17d-4af2-a995-fabf22d0432a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:32.965320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8c6ce-d17d-4af2-a995-fabf22d0432a None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=223d8cc82457430883e40f85ea85bd0c, user.id=247a77a0b8614eed95103984ae215a0e) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:32.965631 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8c6ce-d17d-4af2-a995-fabf22d0432a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:32.967095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8c6ce-d17d-4af2-a995-fabf22d0432a None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:32.973941 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 592/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:37:32 2022] GET /identity/v3/role_assignments?user.id=247a77a0b8614eed95103984ae215a0e&scope.project.id=223d8cc82457430883e40f85ea85bd0c&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:35.002126 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191638-1f3e-4c1b-9907-2205e7719b60 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:35.003028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191638-1f3e-4c1b-9907-2205e7719b60 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:35.003028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191638-1f3e-4c1b-9907-2205e7719b60 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:35.005260 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 570/1162] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:35.011677 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0736237-280f-47dd-9452-56f512e45718 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:35.012380 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0736237-280f-47dd-9452-56f512e45718 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:35.012519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0736237-280f-47dd-9452-56f512e45718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:35.036386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-d0736237-280f-47dd-9452-56f512e45718 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:35.037595 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d0736237-280f-47dd-9452-56f512e45718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:35.109254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 593/1163] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:35.139274 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0191638-1f3e-4c1b-9907-2205e7719b60 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:35.160887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:35.257434 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0191638-1f3e-4c1b-9907-2205e7719b60 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:35.293618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a3f81-8e90-413a-94ca-0672827ff489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:35.294259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a3f81-8e90-413a-94ca-0672827ff489 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:35.294519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a3f81-8e90-413a-94ca-0672827ff489 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:35.294813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a3f81-8e90-413a-94ca-0672827ff489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:35.367312 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a3f81-8e90-413a-94ca-0672827ff489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:35.368759 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a3f81-8e90-413a-94ca-0672827ff489 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:35.383222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:35.474234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 571/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:37:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:37:35.481780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0736237-280f-47dd-9452-56f512e45718 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:35.603171 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0736237-280f-47dd-9452-56f512e45718 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:35.605525 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:35.641801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b262a-f737-4e6f-8163-ed3613998cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:35.642622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b262a-f737-4e6f-8163-ed3613998cd6 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:35.642936 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b262a-f737-4e6f-8163-ed3613998cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:35.643210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b262a-f737-4e6f-8163-ed3613998cd6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:35.650279 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b262a-f737-4e6f-8163-ed3613998cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:35.651765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b262a-f737-4e6f-8163-ed3613998cd6 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-fc1b262a-f737-4e6f-8163-ed3613998cd6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:35.666291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:35.667466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:35.668325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 594/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 03:37:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:35.675430 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a3f81-8e90-413a-94ca-0672827ff489 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:35.792961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a3f81-8e90-413a-94ca-0672827ff489 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:35.806403 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:35.829492 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abbaee-9996-4d0a-a974-ffdb9726d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:35.830140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abbaee-9996-4d0a-a974-ffdb9726d66d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:35.830415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abbaee-9996-4d0a-a974-ffdb9726d66d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:35.830686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abbaee-9996-4d0a-a974-ffdb9726d66d None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:35.831444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abbaee-9996-4d0a-a974-ffdb9726d66d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:35.831745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abbaee-9996-4d0a-a974-ffdb9726d66d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:35.833128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abbaee-9996-4d0a-a974-ffdb9726d66d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:35.840345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 572/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 30 03:37:35 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:37.842816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db99fe1-3843-40ff-9831-cb1cf4999762 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:37.843827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db99fe1-3843-40ff-9831-cb1cf4999762 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:37.843949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db99fe1-3843-40ff-9831-cb1cf4999762 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:37.845997 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 595/1167] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:37.852451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35038b3-3931-4a49-9061-cb2e31d5d4b8 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:37.852886 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35038b3-3931-4a49-9061-cb2e31d5d4b8 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:37.853007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35038b3-3931-4a49-9061-cb2e31d5d4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:37.872281 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e35038b3-3931-4a49-9061-cb2e31d5d4b8 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:37.873468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e35038b3-3931-4a49-9061-cb2e31d5d4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:37.941806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 573/1168] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:37.965924 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db99fe1-3843-40ff-9831-cb1cf4999762 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:38.075124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db99fe1-3843-40ff-9831-cb1cf4999762 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:38.110421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f2a0f-2a98-48e0-b296-b51c1c933871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:38.111023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f2a0f-2a98-48e0-b296-b51c1c933871 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:38.111306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f2a0f-2a98-48e0-b296-b51c1c933871 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:38.111577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f2a0f-2a98-48e0-b296-b51c1c933871 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:38.112303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f2a0f-2a98-48e0-b296-b51c1c933871 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:38.113672 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f2a0f-2a98-48e0-b296-b51c1c933871 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:38.132070 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 596/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Thu Jun 30 03:37:37 2022] POST /identity/v3/domains => generated 267 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:37:40.199997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c23e48-2faa-4f70-bcf3-e39924a4d579 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:40.200538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c23e48-2faa-4f70-bcf3-e39924a4d579 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:40.200538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c23e48-2faa-4f70-bcf3-e39924a4d579 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:40.201825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 574/1170] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:40.208216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bab66-1fb2-4145-b9c6-e924481f2fa8 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:40.208923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bab66-1fb2-4145-b9c6-e924481f2fa8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:40.209063 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bab66-1fb2-4145-b9c6-e924481f2fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:40.236679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-d59bab66-1fb2-4145-b9c6-e924481f2fa8 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:40.237886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d59bab66-1fb2-4145-b9c6-e924481f2fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:40.256634 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:40.308564 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 597/1171] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:40.332975 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c23e48-2faa-4f70-bcf3-e39924a4d579 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:40.446702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c23e48-2faa-4f70-bcf3-e39924a4d579 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:40.454719 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:40.484141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92980ae7-296d-438a-b9b2-972e34afc1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:40.484995 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92980ae7-296d-438a-b9b2-972e34afc1c9 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:40.485270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92980ae7-296d-438a-b9b2-972e34afc1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:40.485542 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92980ae7-296d-438a-b9b2-972e34afc1c9 None admin] PATH_INFO: `/v3/domains/aee92edbcd3c422b9ddb7c6cccb98b8b` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:40.496269 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92980ae7-296d-438a-b9b2-972e34afc1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=aee92edbcd3c422b9ddb7c6cccb98b8b)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:40.497735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92980ae7-296d-438a-b9b2-972e34afc1c9 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:40.499504 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 575/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Thu Jun 30 03:37:40 2022] GET /identity/v3/domains/aee92edbcd3c422b9ddb7c6cccb98b8b => generated 267 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:40.508880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bab66-1fb2-4145-b9c6-e924481f2fa8 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:40.618719 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bab66-1fb2-4145-b9c6-e924481f2fa8 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:40.653615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339659a-0bdc-48bd-8834-a44706121f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:40.654263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339659a-0bdc-48bd-8834-a44706121f94 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:40.654539 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339659a-0bdc-48bd-8834-a44706121f94 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:40.654808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339659a-0bdc-48bd-8834-a44706121f94 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:40.655747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339659a-0bdc-48bd-8834-a44706121f94 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:40.657166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339659a-0bdc-48bd-8834-a44706121f94 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:40.689538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 598/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 03:37:40 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:37:42.737475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1a40-ae81-4475-b5cb-1fc027b94605 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:42.738362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1a40-ae81-4475-b5cb-1fc027b94605 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:42.738362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1a40-ae81-4475-b5cb-1fc027b94605 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:42.740653 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 576/1174] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:42.748603 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128b400-41fc-4619-acef-98978d0ad517 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:42.749132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128b400-41fc-4619-acef-98978d0ad517 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:42.749365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128b400-41fc-4619-acef-98978d0ad517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:42.762789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:42.768784 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-4128b400-41fc-4619-acef-98978d0ad517 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:42.770781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4128b400-41fc-4619-acef-98978d0ad517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:42.848370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 599/1175] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 03:37:42.874302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd1a40-ae81-4475-b5cb-1fc027b94605 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:42.997082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd1a40-ae81-4475-b5cb-1fc027b94605 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:43.032374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161fa77-64e0-41ea-a41b-e9430f7182d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:43.033279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161fa77-64e0-41ea-a41b-e9430f7182d5 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:43.033560 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161fa77-64e0-41ea-a41b-e9430f7182d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:43.033827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161fa77-64e0-41ea-a41b-e9430f7182d5 None admin] PATH_INFO: `/v3/domains/aee92edbcd3c422b9ddb7c6cccb98b8b` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:43.035133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161fa77-64e0-41ea-a41b-e9430f7182d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=aee92edbcd3c422b9ddb7c6cccb98b8b)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:43.036574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161fa77-64e0-41ea-a41b-e9430f7182d5 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:43.038212 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 577/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Thu Jun 30 03:37:42 2022] GET /identity/v3/domains/aee92edbcd3c422b9ddb7c6cccb98b8b => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:43.044597 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128b400-41fc-4619-acef-98978d0ad517 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:43.154342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128b400-41fc-4619-acef-98978d0ad517 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:43.190874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340547e-a7e0-48f3-97b2-242dd0cd4e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:43.191532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340547e-a7e0-48f3-97b2-242dd0cd4e09 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:43.191819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340547e-a7e0-48f3-97b2-242dd0cd4e09 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:43.192095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340547e-a7e0-48f3-97b2-242dd0cd4e09 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:43.192800 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340547e-a7e0-48f3-97b2-242dd0cd4e09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:43.194240 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340547e-a7e0-48f3-97b2-242dd0cd4e09 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:43.201899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:43.221460 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 600/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:37:43 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:37:45.312291 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7855e-d525-450d-8122-68c39f9394bf None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:45.312862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7855e-d525-450d-8122-68c39f9394bf None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:45.312862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7855e-d525-450d-8122-68c39f9394bf None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:45.314145 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 578/1178] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:45.320527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da4b98-7fca-47b7-8214-2e8bc96fe3e8 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:45.321255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da4b98-7fca-47b7-8214-2e8bc96fe3e8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:45.321406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da4b98-7fca-47b7-8214-2e8bc96fe3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:45.343186 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-15da4b98-7fca-47b7-8214-2e8bc96fe3e8 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:45.344364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-15da4b98-7fca-47b7-8214-2e8bc96fe3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:45.414087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 601/1179] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:45.446382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7855e-d525-450d-8122-68c39f9394bf None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:45.485787 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:45.556445 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7855e-d525-450d-8122-68c39f9394bf None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:45.599049 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48ef97-e0a5-4f9c-a0f2-0624872fb270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:45.599839 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48ef97-e0a5-4f9c-a0f2-0624872fb270 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:45.600115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48ef97-e0a5-4f9c-a0f2-0624872fb270 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:45.600388 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48ef97-e0a5-4f9c-a0f2-0624872fb270 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:45.611933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48ef97-e0a5-4f9c-a0f2-0624872fb270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-9b48ef97-e0a5-4f9c-a0f2-0624872fb270 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:37:45.619559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:45.620753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:45.621796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:45.621796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:45.621796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:45.621796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:45.621796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:37:45.621796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:37:45.621796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:37:45.621796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:37:45.621796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:37:45.621796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:37:45.621796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:45.621796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:37:45.621796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 579/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:45.627302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da4b98-7fca-47b7-8214-2e8bc96fe3e8 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:45.734825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da4b98-7fca-47b7-8214-2e8bc96fe3e8 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:45.757841 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:45.772131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f2107-1318-409c-a21f-234f0c7d16d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:45.772804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f2107-1318-409c-a21f-234f0c7d16d6 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:45.773082 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f2107-1318-409c-a21f-234f0c7d16d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:45.773350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f2107-1318-409c-a21f-234f0c7d16d6 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:45.774099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f2107-1318-409c-a21f-234f0c7d16d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:45.774401 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f2107-1318-409c-a21f-234f0c7d16d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:45.775797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f2107-1318-409c-a21f-234f0c7d16d6 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:45.784728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 602/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:45.791508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48ef97-e0a5-4f9c-a0f2-0624872fb270 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:45.898476 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:45.906905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48ef97-e0a5-4f9c-a0f2-0624872fb270 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:45.944692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d40e76-2cef-4b88-aa66-367ec2513a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:45.945573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d40e76-2cef-4b88-aa66-367ec2513a98 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:45.945852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d40e76-2cef-4b88-aa66-367ec2513a98 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:45.946126 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d40e76-2cef-4b88-aa66-367ec2513a98 None admin] PATH_INFO: `/v3/users/04b06caf6c5f4477994da631b0382dd3` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:45.960178 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d40e76-2cef-4b88-aa66-367ec2513a98 None admin] RBAC: Authorizing `identity:get_user(user_id=04b06caf6c5f4477994da631b0382dd3)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:45.961641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d40e76-2cef-4b88-aa66-367ec2513a98 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:45.963349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 580/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:37:45 2022] GET /identity/v3/users/04b06caf6c5f4477994da631b0382dd3 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:45.973009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f2107-1318-409c-a21f-234f0c7d16d6 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:46.088744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f2107-1318-409c-a21f-234f0c7d16d6 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:46.128087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f13e2-86db-4f64-a796-9400d44f7033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:46.128725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f13e2-86db-4f64-a796-9400d44f7033 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:46.129004 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f13e2-86db-4f64-a796-9400d44f7033 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:46.129272 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f13e2-86db-4f64-a796-9400d44f7033 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:46.180884 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:46.199059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f13e2-86db-4f64-a796-9400d44f7033 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:46.200509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f13e2-86db-4f64-a796-9400d44f7033 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:46.303173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 603/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:37:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:37:46.312211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d40e76-2cef-4b88-aa66-367ec2513a98 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:46.415812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d40e76-2cef-4b88-aa66-367ec2513a98 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:46.450016 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d368a-5804-4518-8d87-2bca67142cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:46.450802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d368a-5804-4518-8d87-2bca67142cbc None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:46.451102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d368a-5804-4518-8d87-2bca67142cbc None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:46.451372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d368a-5804-4518-8d87-2bca67142cbc None admin] PATH_INFO: `/v3/projects/c78142d9851045c7a368edc163e281c0` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:46.452601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d368a-5804-4518-8d87-2bca67142cbc None admin] RBAC: Authorizing `identity:get_project(project_id=c78142d9851045c7a368edc163e281c0)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:46.454038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d368a-5804-4518-8d87-2bca67142cbc None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:46.455745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 581/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:37:46 2022] GET /identity/v3/projects/c78142d9851045c7a368edc163e281c0 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:46.462092 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f13e2-86db-4f64-a796-9400d44f7033 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:46.550481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:46.567491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f13e2-86db-4f64-a796-9400d44f7033 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:46.603547 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf440542-8c2d-4929-9f5f-8936ac9ba368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:46.604204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf440542-8c2d-4929-9f5f-8936ac9ba368 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:46.604487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf440542-8c2d-4929-9f5f-8936ac9ba368 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:46.604758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf440542-8c2d-4929-9f5f-8936ac9ba368 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:46.605593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf440542-8c2d-4929-9f5f-8936ac9ba368 None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=c78142d9851045c7a368edc163e281c0, user.id=04b06caf6c5f4477994da631b0382dd3) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:46.605904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf440542-8c2d-4929-9f5f-8936ac9ba368 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:46.607371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf440542-8c2d-4929-9f5f-8936ac9ba368 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:46.613228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 604/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:37:46 2022] GET /identity/v3/role_assignments?user.id=04b06caf6c5f4477994da631b0382dd3&scope.project.id=c78142d9851045c7a368edc163e281c0&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:48.604815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2241304-e0b5-4a6c-b9d2-7d803d611268 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:48.605408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2241304-e0b5-4a6c-b9d2-7d803d611268 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:48.605408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2241304-e0b5-4a6c-b9d2-7d803d611268 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:48.606739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 582/1186] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:48.612564 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69add76-f66a-45ae-a202-938458a99071 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:48.612995 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69add76-f66a-45ae-a202-938458a99071 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:48.613097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69add76-f66a-45ae-a202-938458a99071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:48.631088 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-a69add76-f66a-45ae-a202-938458a99071 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:48.632259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a69add76-f66a-45ae-a202-938458a99071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:48.701320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 605/1187] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:48.725416 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2241304-e0b5-4a6c-b9d2-7d803d611268 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:48.756702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:48.846523 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2241304-e0b5-4a6c-b9d2-7d803d611268 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:48.883132 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fb438-36ab-41e1-96e9-8fede7306e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:48.883948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb438-36ab-41e1-96e9-8fede7306e0f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:48.884233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb438-36ab-41e1-96e9-8fede7306e0f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:48.884509 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb438-36ab-41e1-96e9-8fede7306e0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:48.896583 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fb438-36ab-41e1-96e9-8fede7306e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-be9fb438-36ab-41e1-96e9-8fede7306e0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:37:48.904313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:48.905446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:48.906361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:48.906361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:48.906361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:48.906361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:48.906361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:37:48.906361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:37:48.906361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:37:48.906361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:37:48.906361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:37:48.906361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:37:48.906361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:48.906361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:37:48.906361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 583/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:48.912078 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69add76-f66a-45ae-a202-938458a99071 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:48.998827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:49.021380 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69add76-f66a-45ae-a202-938458a99071 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:49.055920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4071f-fff3-485e-9b91-cf6ecf2e5ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:49.056573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4071f-fff3-485e-9b91-cf6ecf2e5ce3 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:49.056851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4071f-fff3-485e-9b91-cf6ecf2e5ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:49.057119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4071f-fff3-485e-9b91-cf6ecf2e5ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:49.057862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4071f-fff3-485e-9b91-cf6ecf2e5ce3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:49.058171 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4071f-fff3-485e-9b91-cf6ecf2e5ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:49.059563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4071f-fff3-485e-9b91-cf6ecf2e5ce3 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:49.067710 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 606/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:49.077256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fb438-36ab-41e1-96e9-8fede7306e0f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:49.172014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:49.198479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fb438-36ab-41e1-96e9-8fede7306e0f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:49.234757 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eb54c-4998-4a19-a8a2-ed4e2b7a290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:49.235652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb54c-4998-4a19-a8a2-ed4e2b7a290d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:49.235934 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb54c-4998-4a19-a8a2-ed4e2b7a290d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:49.236211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb54c-4998-4a19-a8a2-ed4e2b7a290d None admin] PATH_INFO: `/v3/users/04b06caf6c5f4477994da631b0382dd3` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:49.237461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186eb54c-4998-4a19-a8a2-ed4e2b7a290d None admin] RBAC: Authorizing `identity:get_user(user_id=04b06caf6c5f4477994da631b0382dd3)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:49.238954 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186eb54c-4998-4a19-a8a2-ed4e2b7a290d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:49.240573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 584/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:37:49 2022] GET /identity/v3/users/04b06caf6c5f4477994da631b0382dd3 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:49.246673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4071f-fff3-485e-9b91-cf6ecf2e5ce3 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:49.348489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4071f-fff3-485e-9b91-cf6ecf2e5ce3 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:49.383054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86545218-eefa-4ab9-bfb0-e139324081cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:49.383912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86545218-eefa-4ab9-bfb0-e139324081cc None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:49.384196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86545218-eefa-4ab9-bfb0-e139324081cc None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:49.384470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86545218-eefa-4ab9-bfb0-e139324081cc None admin] PATH_INFO: `/v3/projects/c78142d9851045c7a368edc163e281c0` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:49.385766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86545218-eefa-4ab9-bfb0-e139324081cc None admin] RBAC: Authorizing `identity:get_project(project_id=c78142d9851045c7a368edc163e281c0)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:49.387222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86545218-eefa-4ab9-bfb0-e139324081cc None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:49.388919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 607/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:37:49 2022] GET /identity/v3/projects/c78142d9851045c7a368edc163e281c0 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:49.395975 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eb54c-4998-4a19-a8a2-ed4e2b7a290d None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:49.507475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eb54c-4998-4a19-a8a2-ed4e2b7a290d None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:49.546289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f8629-c408-4766-a3fd-3a4ea5166b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:49.547204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f8629-c408-4766-a3fd-3a4ea5166b30 None admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:49.547486 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f8629-c408-4766-a3fd-3a4ea5166b30 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:49.547761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f8629-c408-4766-a3fd-3a4ea5166b30 None admin] PATH_INFO: `/v3/projects/c78142d9851045c7a368edc163e281c0/users/04b06caf6c5f4477994da631b0382dd3/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:49.549982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f8629-c408-4766-a3fd-3a4ea5166b30 None admin] RBAC: Authorizing `identity:create_grant(project_id=c78142d9851045c7a368edc163e281c0, user_id=04b06caf6c5f4477994da631b0382dd3, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:49.551466 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f8629-c408-4766-a3fd-3a4ea5166b30 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:49.570620 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 585/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:37:49 2022] PUT /identity/v3/projects/c78142d9851045c7a368edc163e281c0/users/04b06caf6c5f4477994da631b0382dd3/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:37:51.568470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94c109-6fa9-41ce-9304-6754bb1350e6 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:51.569062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94c109-6fa9-41ce-9304-6754bb1350e6 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:51.569062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94c109-6fa9-41ce-9304-6754bb1350e6 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:51.570396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 608/1193] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:37:51.576951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ea921-1b1b-4fbf-aaca-ddce4244fa08 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:51.577654 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ea921-1b1b-4fbf-aaca-ddce4244fa08 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:51.577807 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ea921-1b1b-4fbf-aaca-ddce4244fa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:51.601242 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e44ea921-1b1b-4fbf-aaca-ddce4244fa08 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:37:51.602424 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e44ea921-1b1b-4fbf-aaca-ddce4244fa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:37:51.604457 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:51.682638 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 586/1194] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:37:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:37:51.707422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94c109-6fa9-41ce-9304-6754bb1350e6 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:51.720997 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:51.820151 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94c109-6fa9-41ce-9304-6754bb1350e6 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:51.855654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c4a1a-cfba-4929-afde-758ad50dc792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:51.856457 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4a1a-cfba-4929-afde-758ad50dc792 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:51.856738 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4a1a-cfba-4929-afde-758ad50dc792 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:51.857013 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4a1a-cfba-4929-afde-758ad50dc792 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:51.869520 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c4a1a-cfba-4929-afde-758ad50dc792 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-5b6c4a1a-cfba-4929-afde-758ad50dc792 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:37:51.877309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:37:51.878278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:37:51.879260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:37:51.879260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:37:51.879260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:37:51.879260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:37:51.879260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:37:51.879260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:37:51.879260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:37:51.879260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:37:51.879260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:37:51.879260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:37:51.879260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:37:51.879260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:37:51.879260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 609/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:37:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:37:51.884790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ea921-1b1b-4fbf-aaca-ddce4244fa08 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:51.992219 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ea921-1b1b-4fbf-aaca-ddce4244fa08 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:52.027535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6501f-3750-4ef4-93cc-a4c27f54a935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:52.028188 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6501f-3750-4ef4-93cc-a4c27f54a935 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:52.028470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6501f-3750-4ef4-93cc-a4c27f54a935 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:52.028742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6501f-3750-4ef4-93cc-a4c27f54a935 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:52.029565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6501f-3750-4ef4-93cc-a4c27f54a935 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:52.029844 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6501f-3750-4ef4-93cc-a4c27f54a935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:52.031267 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6501f-3750-4ef4-93cc-a4c27f54a935 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:52.036281 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:52.040136 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 587/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:37:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:52.046067 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c4a1a-cfba-4929-afde-758ad50dc792 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:52.115555 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:52.151745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c4a1a-cfba-4929-afde-758ad50dc792 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:52.189925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d87c9-9ebc-41af-87eb-92448aa9e863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:52.190801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d87c9-9ebc-41af-87eb-92448aa9e863 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:52.191087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d87c9-9ebc-41af-87eb-92448aa9e863 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:52.191366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d87c9-9ebc-41af-87eb-92448aa9e863 None admin] PATH_INFO: `/v3/users/04b06caf6c5f4477994da631b0382dd3` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:52.192681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d87c9-9ebc-41af-87eb-92448aa9e863 None admin] RBAC: Authorizing `identity:get_user(user_id=04b06caf6c5f4477994da631b0382dd3)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:52.194120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d87c9-9ebc-41af-87eb-92448aa9e863 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:52.195780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 610/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 03:37:52 2022] GET /identity/v3/users/04b06caf6c5f4477994da631b0382dd3 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:37:52.202217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6501f-3750-4ef4-93cc-a4c27f54a935 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:52.316841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6501f-3750-4ef4-93cc-a4c27f54a935 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:52.355305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6fea1-c79e-4be8-8cd7-1349942211da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:52.355933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6fea1-c79e-4be8-8cd7-1349942211da None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:52.356206 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6fea1-c79e-4be8-8cd7-1349942211da None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:52.356472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6fea1-c79e-4be8-8cd7-1349942211da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:52.422080 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:52.424982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6fea1-c79e-4be8-8cd7-1349942211da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:52.427034 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6fea1-c79e-4be8-8cd7-1349942211da None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:52.524883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 588/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:37:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:37:52.531244 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d87c9-9ebc-41af-87eb-92448aa9e863 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:52.640500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d87c9-9ebc-41af-87eb-92448aa9e863 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:52.677304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb87fc1-807f-4c19-8e20-a1405ffcdd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:52.678092 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb87fc1-807f-4c19-8e20-a1405ffcdd98 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:52.678373 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb87fc1-807f-4c19-8e20-a1405ffcdd98 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:52.678644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb87fc1-807f-4c19-8e20-a1405ffcdd98 None admin] PATH_INFO: `/v3/projects/c78142d9851045c7a368edc163e281c0` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:52.679979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb87fc1-807f-4c19-8e20-a1405ffcdd98 None admin] RBAC: Authorizing `identity:get_project(project_id=c78142d9851045c7a368edc163e281c0)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:52.681418 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb87fc1-807f-4c19-8e20-a1405ffcdd98 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:52.683174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 611/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 03:37:52 2022] GET /identity/v3/projects/c78142d9851045c7a368edc163e281c0 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:37:52.690231 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6fea1-c79e-4be8-8cd7-1349942211da None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:37:52.801003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:37:52.804361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6fea1-c79e-4be8-8cd7-1349942211da None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:37:52.839983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862cd90-5137-4afe-870f-f99cdd2b6173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:37:52.840631 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862cd90-5137-4afe-870f-f99cdd2b6173 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:37:52.840909 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862cd90-5137-4afe-870f-f99cdd2b6173 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:37:52.841190 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862cd90-5137-4afe-870f-f99cdd2b6173 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:37:52.842447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862cd90-5137-4afe-870f-f99cdd2b6173 None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=c78142d9851045c7a368edc163e281c0, user.id=04b06caf6c5f4477994da631b0382dd3) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:37:52.842797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862cd90-5137-4afe-870f-f99cdd2b6173 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:37:52.844274 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862cd90-5137-4afe-870f-f99cdd2b6173 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:37:52.850749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 589/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:37:52 2022] GET /identity/v3/role_assignments?user.id=04b06caf6c5f4477994da631b0382dd3&scope.project.id=c78142d9851045c7a368edc163e281c0&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:38:02.672043 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=98 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:02.847857 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=18 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:48.721602 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a2a8d-256b-4a47-8c63-dd101989be5a None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:48.722210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a2a8d-256b-4a47-8c63-dd101989be5a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:48.722210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a2a8d-256b-4a47-8c63-dd101989be5a None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:48.723792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 612/1201] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:38:48.729252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfeb21-6b39-425f-977f-522726d53454 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:48.729758 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfeb21-6b39-425f-977f-522726d53454 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:48.729846 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfeb21-6b39-425f-977f-522726d53454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:48.755357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-90cfeb21-6b39-425f-977f-522726d53454 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:38:48.756887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-90cfeb21-6b39-425f-977f-522726d53454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:38:48.862111 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 590/1202] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:38:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:38:48.902898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a2a8d-256b-4a47-8c63-dd101989be5a None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:49.048230 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a2a8d-256b-4a47-8c63-dd101989be5a None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:49.092258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bb63f-1b6a-4bcd-a755-0a0de9d2b4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:49.093075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bb63f-1b6a-4bcd-a755-0a0de9d2b4a9 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:49.093354 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bb63f-1b6a-4bcd-a755-0a0de9d2b4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:49.093649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bb63f-1b6a-4bcd-a755-0a0de9d2b4a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:49.108258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bb63f-1b6a-4bcd-a755-0a0de9d2b4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:49.109920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bb63f-1b6a-4bcd-a755-0a0de9d2b4a9 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-ac4bb63f-1b6a-4bcd-a755-0a0de9d2b4a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:38:49.146388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:38:49.147680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:38:49.148736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:38:49.148736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:38:49.148736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:38:49.148736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:38:49.148736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 613/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:38:49.155648 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfeb21-6b39-425f-977f-522726d53454 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:49.297546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfeb21-6b39-425f-977f-522726d53454 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:49.338031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:49.345733 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679922e-5822-4c1f-a255-e9f75192efa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:49.346435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679922e-5822-4c1f-a255-e9f75192efa6 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:49.346692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679922e-5822-4c1f-a255-e9f75192efa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:49.346996 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679922e-5822-4c1f-a255-e9f75192efa6 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:49.347726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679922e-5822-4c1f-a255-e9f75192efa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:38:49.348034 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679922e-5822-4c1f-a255-e9f75192efa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:49.349448 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679922e-5822-4c1f-a255-e9f75192efa6 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:49.366797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 591/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:38:49.368871 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bb63f-1b6a-4bcd-a755-0a0de9d2b4a9 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:49.432293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:49.495246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bb63f-1b6a-4bcd-a755-0a0de9d2b4a9 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:49.541515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d44b5c-8490-4370-a991-a68995a63cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:49.542426 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d44b5c-8490-4370-a991-a68995a63cd6 None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:49.543018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d44b5c-8490-4370-a991-a68995a63cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:49.543457 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d44b5c-8490-4370-a991-a68995a63cd6 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:49.544348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d44b5c-8490-4370-a991-a68995a63cd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:49.545975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d44b5c-8490-4370-a991-a68995a63cd6 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:49.578789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 614/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 03:38:49 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:38:51.870061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6773a-f489-4202-b810-2fb9f502565c None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:51.870672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6773a-f489-4202-b810-2fb9f502565c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:51.870806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6773a-f489-4202-b810-2fb9f502565c None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:51.872425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 592/1206] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:38:51.879986 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3096-0de2-4d97-aed3-d52cd8556328 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:51.879986 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3096-0de2-4d97-aed3-d52cd8556328 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:51.879986 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3096-0de2-4d97-aed3-d52cd8556328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:51.899780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e2cf3096-0de2-4d97-aed3-d52cd8556328 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:38:51.901168 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e2cf3096-0de2-4d97-aed3-d52cd8556328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:38:51.979295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 615/1207] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:38:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:38:52.003639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6773a-f489-4202-b810-2fb9f502565c None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:52.121726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6773a-f489-4202-b810-2fb9f502565c None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:52.158608 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8668fad-4110-43e7-8c98-e1c476d3489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:52.159498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8668fad-4110-43e7-8c98-e1c476d3489d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:52.159779 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8668fad-4110-43e7-8c98-e1c476d3489d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:52.160095 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8668fad-4110-43e7-8c98-e1c476d3489d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:52.173929 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8668fad-4110-43e7-8c98-e1c476d3489d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-e8668fad-4110-43e7-8c98-e1c476d3489d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:38:52.182004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:38:52.183102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:38:52.183982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:38:52.183982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:38:52.183982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:38:52.183982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:38:52.183982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:38:52.183982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:38:52.183982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:38:52.183982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:38:52.183982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:38:52.183982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:38:52.183982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:38:52.183982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:38:52.191724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 593/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:38:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:38:52.191900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf3096-0de2-4d97-aed3-d52cd8556328 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:52.234463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:52.315878 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf3096-0de2-4d97-aed3-d52cd8556328 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:52.354863 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc551601-c28c-494f-9977-afdfd2570726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:52.356021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc551601-c28c-494f-9977-afdfd2570726 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:52.356021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc551601-c28c-494f-9977-afdfd2570726 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:52.356446 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc551601-c28c-494f-9977-afdfd2570726 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:52.357280 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc551601-c28c-494f-9977-afdfd2570726 None admin] RBAC: Adding query filter params (name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:38:52.357651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc551601-c28c-494f-9977-afdfd2570726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:52.359081 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc551601-c28c-494f-9977-afdfd2570726 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:52.370790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 616/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:38:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:38:52.374593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8668fad-4110-43e7-8c98-e1c476d3489d None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:52.436244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:52.493690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8668fad-4110-43e7-8c98-e1c476d3489d None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:52.530724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7bf37-5c9f-4680-b8b4-92960367d1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:52.531647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7bf37-5c9f-4680-b8b4-92960367d1fe None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:52.531920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7bf37-5c9f-4680-b8b4-92960367d1fe None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:52.532270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7bf37-5c9f-4680-b8b4-92960367d1fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:52.543015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7bf37-5c9f-4680-b8b4-92960367d1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:52.544529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7bf37-5c9f-4680-b8b4-92960367d1fe None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-e6c7bf37-5c9f-4680-b8b4-92960367d1fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:38:52.564069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:38:52.565066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:38:52.565964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:38:52.565964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:38:52.565964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:38:52.565964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:38:52.571142 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 594/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:38:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:38:52.573013 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc551601-c28c-494f-9977-afdfd2570726 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:52.693252 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:52.695550 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc551601-c28c-494f-9977-afdfd2570726 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:52.736817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d124dc1-e32b-48a7-afa2-b4fcf6e8c457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:52.737854 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d124dc1-e32b-48a7-afa2-b4fcf6e8c457 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:52.738279 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d124dc1-e32b-48a7-afa2-b4fcf6e8c457 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:52.738489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d124dc1-e32b-48a7-afa2-b4fcf6e8c457 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:52.739341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d124dc1-e32b-48a7-afa2-b4fcf6e8c457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:38:52.740597 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d124dc1-e32b-48a7-afa2-b4fcf6e8c457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:52.741301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d124dc1-e32b-48a7-afa2-b4fcf6e8c457 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:52.757613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 617/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:38:52.764159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7bf37-5c9f-4680-b8b4-92960367d1fe None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:52.899368 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7bf37-5c9f-4680-b8b4-92960367d1fe None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:52.900345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:52.935438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123c050-5b1c-472f-bf48-9d0bb3c139f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:52.936256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123c050-5b1c-472f-bf48-9d0bb3c139f4 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:52.936504 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123c050-5b1c-472f-bf48-9d0bb3c139f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:52.936827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123c050-5b1c-472f-bf48-9d0bb3c139f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:52.946329 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123c050-5b1c-472f-bf48-9d0bb3c139f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:52.948008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123c050-5b1c-472f-bf48-9d0bb3c139f4 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-7123c050-5b1c-472f-bf48-9d0bb3c139f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:38:52.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:38:52.966389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:38:52.967400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:38:52.967400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:38:52.967400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:38:52.967400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:38:52.967400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:38:52.967400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:38:52.967400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:38:52.967400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:38:52.967400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 03:38:52.967400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:38:52.967400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 595/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:38:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:38:52.972464 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d124dc1-e32b-48a7-afa2-b4fcf6e8c457 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:53.090708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d124dc1-e32b-48a7-afa2-b4fcf6e8c457 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:53.136056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884288d-9ff8-4633-bcb5-73bee7a7af0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:53.136840 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884288d-9ff8-4633-bcb5-73bee7a7af0e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:53.137148 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884288d-9ff8-4633-bcb5-73bee7a7af0e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:53.137439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884288d-9ff8-4633-bcb5-73bee7a7af0e None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:53.138281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884288d-9ff8-4633-bcb5-73bee7a7af0e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:38:53.138593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884288d-9ff8-4633-bcb5-73bee7a7af0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:53.140196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884288d-9ff8-4633-bcb5-73bee7a7af0e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:53.158311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 618/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 30 03:38:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:38:53.164741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123c050-5b1c-472f-bf48-9d0bb3c139f4 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:53.286843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123c050-5b1c-472f-bf48-9d0bb3c139f4 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:53.334816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fb6a4-bedd-4bbd-a5dc-1a083781813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:53.335510 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fb6a4-bedd-4bbd-a5dc-1a083781813b None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:53.335790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fb6a4-bedd-4bbd-a5dc-1a083781813b None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:53.336068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fb6a4-bedd-4bbd-a5dc-1a083781813b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:53.378991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:53.425045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fb6a4-bedd-4bbd-a5dc-1a083781813b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:53.426665 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fb6a4-bedd-4bbd-a5dc-1a083781813b None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:53.553061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 596/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:38:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 03:38:53.559697 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884288d-9ff8-4633-bcb5-73bee7a7af0e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:53.581378 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:53.680186 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884288d-9ff8-4633-bcb5-73bee7a7af0e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:53.720039 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab7082-675e-4a92-b914-c400a45bfb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:53.720850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab7082-675e-4a92-b914-c400a45bfb47 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:53.721318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab7082-675e-4a92-b914-c400a45bfb47 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:53.721571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab7082-675e-4a92-b914-c400a45bfb47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:53.735642 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab7082-675e-4a92-b914-c400a45bfb47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:53.737679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab7082-675e-4a92-b914-c400a45bfb47 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-e0ab7082-675e-4a92-b914-c400a45bfb47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:38:53.757906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:38:53.759157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:38:53.760071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:38:53.760071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:38:53.760071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:38:53.760071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:38:53.764686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 619/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:38:53.766003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fb6a4-bedd-4bbd-a5dc-1a083781813b None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:53.878482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:53.934895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fb6a4-bedd-4bbd-a5dc-1a083781813b None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:53.977570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd476480-2449-4614-a216-90a1af541486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:53.980959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd476480-2449-4614-a216-90a1af541486 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:53.980959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd476480-2449-4614-a216-90a1af541486 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:53.980959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd476480-2449-4614-a216-90a1af541486 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:53.980959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd476480-2449-4614-a216-90a1af541486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:38:53.980959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd476480-2449-4614-a216-90a1af541486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:53.982258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd476480-2449-4614-a216-90a1af541486 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:53.995707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 597/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:38:54.002150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab7082-675e-4a92-b914-c400a45bfb47 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:54.102161 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:54.138797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab7082-675e-4a92-b914-c400a45bfb47 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:54.177872 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0b850-2671-498e-b782-1108b4ce8a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:54.178744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0b850-2671-498e-b782-1108b4ce8a1e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:54.179121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0b850-2671-498e-b782-1108b4ce8a1e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:54.179442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0b850-2671-498e-b782-1108b4ce8a1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:54.187641 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0b850-2671-498e-b782-1108b4ce8a1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:54.189394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0b850-2671-498e-b782-1108b4ce8a1e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-71e0b850-2671-498e-b782-1108b4ce8a1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:38:54.204117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:38:54.205633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:38:54.206716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:38:54.206716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:38:54.206716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:38:54.206716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:38:54.206716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:38:54.206716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:38:54.206716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:38:54.206716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:38:54.206716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 620/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:38:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:38:54.211576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd476480-2449-4614-a216-90a1af541486 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:54.350308 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd476480-2449-4614-a216-90a1af541486 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:54.381722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:54.400359 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434c5d6-46df-4d2c-ad8b-ad00862e0234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:54.400984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434c5d6-46df-4d2c-ad8b-ad00862e0234 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:54.401481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434c5d6-46df-4d2c-ad8b-ad00862e0234 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:54.402416 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434c5d6-46df-4d2c-ad8b-ad00862e0234 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:54.403443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434c5d6-46df-4d2c-ad8b-ad00862e0234 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:38:54.403810 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434c5d6-46df-4d2c-ad8b-ad00862e0234 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:54.405514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434c5d6-46df-4d2c-ad8b-ad00862e0234 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:54.423518 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 598/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:38:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:38:54.424791 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0b850-2671-498e-b782-1108b4ce8a1e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:54.533368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0b850-2671-498e-b782-1108b4ce8a1e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:54.563269 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:54.570284 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d18b71-d3c1-4526-97bf-23b84cddbd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:54.571192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d18b71-d3c1-4526-97bf-23b84cddbd45 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:54.571584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d18b71-d3c1-4526-97bf-23b84cddbd45 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:54.571973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d18b71-d3c1-4526-97bf-23b84cddbd45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:54.572911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d18b71-d3c1-4526-97bf-23b84cddbd45 None admin] RBAC: Adding query filter params (role.id=b9998a2301454764ae06a0f743463c5d, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=13562e65139b44ab931fb8fdb41a61b9) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:38:54.573319 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d18b71-d3c1-4526-97bf-23b84cddbd45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:54.575320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d18b71-d3c1-4526-97bf-23b84cddbd45 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:54.590799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 621/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:38:54 2022] GET /identity/v3/role_assignments?user.id=13562e65139b44ab931fb8fdb41a61b9&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b9998a2301454764ae06a0f743463c5d => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:38:56.742674 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b0b64-48fb-4428-8ac4-98ac79f0b3b7 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:56.743285 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b0b64-48fb-4428-8ac4-98ac79f0b3b7 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:56.743385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b0b64-48fb-4428-8ac4-98ac79f0b3b7 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:56.744717 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 599/1220] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:38:56.750390 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c06825-2000-4e3b-8229-e6ba4be4e6c2 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:56.750837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c06825-2000-4e3b-8229-e6ba4be4e6c2 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:56.751011 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c06825-2000-4e3b-8229-e6ba4be4e6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:56.769196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-77c06825-2000-4e3b-8229-e6ba4be4e6c2 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:38:56.770501 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-77c06825-2000-4e3b-8229-e6ba4be4e6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:38:56.843014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 622/1221] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:38:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:38:56.867547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b0b64-48fb-4428-8ac4-98ac79f0b3b7 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:56.986630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b0b64-48fb-4428-8ac4-98ac79f0b3b7 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:57.027360 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672e47d-2e77-4def-ba12-b5c4ad37097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:57.028270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e47d-2e77-4def-ba12-b5c4ad37097a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:57.028551 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e47d-2e77-4def-ba12-b5c4ad37097a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:57.028823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e47d-2e77-4def-ba12-b5c4ad37097a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:57.040096 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672e47d-2e77-4def-ba12-b5c4ad37097a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-8672e47d-2e77-4def-ba12-b5c4ad37097a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:38:57.048671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:38:57.049809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:38:57.050673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:38:57.050673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:38:57.050673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:38:57.050673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:38:57.050673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:38:57.050673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:38:57.050673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:38:57.050673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:38:57.050673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:38:57.050673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:38:57.050673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:38:57.050673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:38:57.050673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 600/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:38:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:38:57.056317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c06825-2000-4e3b-8229-e6ba4be4e6c2 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:57.163296 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c06825-2000-4e3b-8229-e6ba4be4e6c2 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:57.190704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:57.202529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e840b-aa04-491d-aab5-fb0e920503b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:57.203903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e840b-aa04-491d-aab5-fb0e920503b4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:57.203903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e840b-aa04-491d-aab5-fb0e920503b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:57.203903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e840b-aa04-491d-aab5-fb0e920503b4 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:57.204523 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e840b-aa04-491d-aab5-fb0e920503b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:38:57.204835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e840b-aa04-491d-aab5-fb0e920503b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:57.206214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e840b-aa04-491d-aab5-fb0e920503b4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:57.215498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 623/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:38:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:38:57.221501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672e47d-2e77-4def-ba12-b5c4ad37097a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:57.272181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:57.338929 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672e47d-2e77-4def-ba12-b5c4ad37097a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:57.377173 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2635c7c-274d-4a15-b375-ec3ef45ef342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:57.378065 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2635c7c-274d-4a15-b375-ec3ef45ef342 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:57.378349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2635c7c-274d-4a15-b375-ec3ef45ef342 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:57.378641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2635c7c-274d-4a15-b375-ec3ef45ef342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:57.391041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2635c7c-274d-4a15-b375-ec3ef45ef342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:57.392614 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2635c7c-274d-4a15-b375-ec3ef45ef342 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-c2635c7c-274d-4a15-b375-ec3ef45ef342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:38:57.410148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:38:57.411461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:38:57.412672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:38:57.412672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:38:57.412672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:38:57.412672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:38:57.413384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 601/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:38:57.419516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e840b-aa04-491d-aab5-fb0e920503b4 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:57.526398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e840b-aa04-491d-aab5-fb0e920503b4 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:57.563989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813d806-c704-45bf-8deb-29b3933bf9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:57.564657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813d806-c704-45bf-8deb-29b3933bf9b2 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:57.564956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813d806-c704-45bf-8deb-29b3933bf9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:57.565212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813d806-c704-45bf-8deb-29b3933bf9b2 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:57.565938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813d806-c704-45bf-8deb-29b3933bf9b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:38:57.566246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813d806-c704-45bf-8deb-29b3933bf9b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:57.567663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813d806-c704-45bf-8deb-29b3933bf9b2 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:57.580108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 624/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:38:57.586074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2635c7c-274d-4a15-b375-ec3ef45ef342 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:57.688127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:57.695824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2635c7c-274d-4a15-b375-ec3ef45ef342 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:57.731518 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a681-95f7-406e-8b48-db354f8b50b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:57.732338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a681-95f7-406e-8b48-db354f8b50b9 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:57.732617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a681-95f7-406e-8b48-db354f8b50b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:57.732898 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a681-95f7-406e-8b48-db354f8b50b9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:57.740864 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7a681-95f7-406e-8b48-db354f8b50b9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:57.742385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7a681-95f7-406e-8b48-db354f8b50b9 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-a9e7a681-95f7-406e-8b48-db354f8b50b9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:38:57.757014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:38:57.758538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:38:57.759529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:38:57.759529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:38:57.759529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:38:57.759529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:38:57.759529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:38:57.759529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:38:57.759529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:38:57.759529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:38:57.759529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 03:38:57.759529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:38:57.759529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 602/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:38:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:38:57.764270 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813d806-c704-45bf-8deb-29b3933bf9b2 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:57.816153 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:57.874455 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813d806-c704-45bf-8deb-29b3933bf9b2 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:57.913037 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f23cc-5e1b-4020-89c7-94a6189b3f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:57.913919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f23cc-5e1b-4020-89c7-94a6189b3f70 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:57.914300 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f23cc-5e1b-4020-89c7-94a6189b3f70 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:57.914743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f23cc-5e1b-4020-89c7-94a6189b3f70 None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:57.915712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f23cc-5e1b-4020-89c7-94a6189b3f70 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:38:57.916206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f23cc-5e1b-4020-89c7-94a6189b3f70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:57.917803 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f23cc-5e1b-4020-89c7-94a6189b3f70 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:57.937334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 625/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 30 03:38:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:38:57.943470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a681-95f7-406e-8b48-db354f8b50b9 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:58.052580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a681-95f7-406e-8b48-db354f8b50b9 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:58.088553 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19906e3-278e-43b5-89fe-fe6c53277e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:58.089798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19906e3-278e-43b5-89fe-fe6c53277e78 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:58.090351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19906e3-278e-43b5-89fe-fe6c53277e78 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:58.090351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19906e3-278e-43b5-89fe-fe6c53277e78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:58.101563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19906e3-278e-43b5-89fe-fe6c53277e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:58.103077 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19906e3-278e-43b5-89fe-fe6c53277e78 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-c19906e3-278e-43b5-89fe-fe6c53277e78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:38:58.122067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:38:58.123253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:38:58.124508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:38:58.124508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:38:58.124508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:38:58.124508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:38:58.124508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 603/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:38:58.129364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f23cc-5e1b-4020-89c7-94a6189b3f70 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:58.245915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f23cc-5e1b-4020-89c7-94a6189b3f70 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:58.248442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:58.293850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae5f1d-b26e-49ab-9c7b-ef901676d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:58.294527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae5f1d-b26e-49ab-9c7b-ef901676d272 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:58.294841 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae5f1d-b26e-49ab-9c7b-ef901676d272 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:58.295126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae5f1d-b26e-49ab-9c7b-ef901676d272 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:58.295888 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae5f1d-b26e-49ab-9c7b-ef901676d272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:38:58.296197 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae5f1d-b26e-49ab-9c7b-ef901676d272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:58.297623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae5f1d-b26e-49ab-9c7b-ef901676d272 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:58.309638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 626/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:38:58.315901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19906e3-278e-43b5-89fe-fe6c53277e78 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:58.332416 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:58.455353 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19906e3-278e-43b5-89fe-fe6c53277e78 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:58.496063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de428176-426d-484a-8640-4adff50d1e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:58.496837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de428176-426d-484a-8640-4adff50d1e56 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:58.497147 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de428176-426d-484a-8640-4adff50d1e56 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:58.497428 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de428176-426d-484a-8640-4adff50d1e56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:58.506261 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de428176-426d-484a-8640-4adff50d1e56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:58.508185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de428176-426d-484a-8640-4adff50d1e56 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-de428176-426d-484a-8640-4adff50d1e56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:38:58.526048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:38:58.527266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:38:58.528363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:38:58.528363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:38:58.528363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:38:58.528363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:38:58.528363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:38:58.528363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:38:58.528363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:38:58.528363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:38:58.528363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 604/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:38:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:38:58.534308 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae5f1d-b26e-49ab-9c7b-ef901676d272 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:58.659699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae5f1d-b26e-49ab-9c7b-ef901676d272 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:58.697669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11509844-37a3-40b2-a89e-faccd76e87ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:58.698340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509844-37a3-40b2-a89e-faccd76e87ff None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:58.698626 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509844-37a3-40b2-a89e-faccd76e87ff None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:58.699064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509844-37a3-40b2-a89e-faccd76e87ff None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:58.699879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11509844-37a3-40b2-a89e-faccd76e87ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:38:58.700193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11509844-37a3-40b2-a89e-faccd76e87ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:58.701643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11509844-37a3-40b2-a89e-faccd76e87ff None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:58.715849 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 627/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:38:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:38:58.722997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de428176-426d-484a-8640-4adff50d1e56 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:38:58.818087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:38:58.856816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de428176-426d-484a-8640-4adff50d1e56 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:38:58.902272 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c773eec-b0f1-45e5-91f8-4b94bad4345f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:38:58.903808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c773eec-b0f1-45e5-91f8-4b94bad4345f None admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:38:58.904098 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c773eec-b0f1-45e5-91f8-4b94bad4345f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:38:58.904412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c773eec-b0f1-45e5-91f8-4b94bad4345f None admin] PATH_INFO: `/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/13562e65139b44ab931fb8fdb41a61b9/roles/b9998a2301454764ae06a0f743463c5d` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:38:58.925243 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c773eec-b0f1-45e5-91f8-4b94bad4345f None admin] RBAC: Authorizing `identity:create_grant(project_id=96e59c2ab83c477385e5a81b32a7c897, user_id=13562e65139b44ab931fb8fdb41a61b9, role_id=b9998a2301454764ae06a0f743463c5d)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:38:58.927467 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c773eec-b0f1-45e5-91f8-4b94bad4345f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:38:58.944066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 605/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:38:58 2022] PUT /identity/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/13562e65139b44ab931fb8fdb41a61b9/roles/b9998a2301454764ae06a0f743463c5d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:39:01.046711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b19b6-ddab-415d-bbe2-26e06a70784f None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:01.047377 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b19b6-ddab-415d-bbe2-26e06a70784f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:01.047377 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b19b6-ddab-415d-bbe2-26e06a70784f None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:01.048833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 628/1233] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:39:01.054639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec555a2d-0c41-47a7-908c-a87ebdc870ef None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:01.055153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec555a2d-0c41-47a7-908c-a87ebdc870ef None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:01.055241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec555a2d-0c41-47a7-908c-a87ebdc870ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:01.075097 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ec555a2d-0c41-47a7-908c-a87ebdc870ef None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:39:01.076331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ec555a2d-0c41-47a7-908c-a87ebdc870ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:39:01.153475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 606/1234] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:39:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:39:01.177672 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b19b6-ddab-415d-bbe2-26e06a70784f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:01.203832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:01.284613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b19b6-ddab-415d-bbe2-26e06a70784f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:01.326329 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3cbb7-85ff-456b-ac4c-d781064ad095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:01.327207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3cbb7-85ff-456b-ac4c-d781064ad095 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:01.327441 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3cbb7-85ff-456b-ac4c-d781064ad095 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:01.327711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3cbb7-85ff-456b-ac4c-d781064ad095 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:01.342109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3cbb7-85ff-456b-ac4c-d781064ad095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-9bd3cbb7-85ff-456b-ac4c-d781064ad095 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:39:01.351080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:01.352259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:01.353139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:01.353139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:01.353139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:01.353139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:01.353139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:39:01.353139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:39:01.353139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:39:01.353139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:39:01.353139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:39:01.353139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:39:01.353139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 03:39:01.353139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:39:01.353139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 629/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 03:39:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:01.360063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec555a2d-0c41-47a7-908c-a87ebdc870ef None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:01.415842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:01.475751 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec555a2d-0c41-47a7-908c-a87ebdc870ef None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:01.512097 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3abc26-6af2-404e-8d08-8add3a26054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:01.512865 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3abc26-6af2-404e-8d08-8add3a26054a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:01.513164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3abc26-6af2-404e-8d08-8add3a26054a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:01.513485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3abc26-6af2-404e-8d08-8add3a26054a None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:01.514367 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3abc26-6af2-404e-8d08-8add3a26054a None admin] RBAC: Adding query filter params (name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:01.514678 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3abc26-6af2-404e-8d08-8add3a26054a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:01.516371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3abc26-6af2-404e-8d08-8add3a26054a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:01.525549 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 607/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 03:39:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:01.531944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3cbb7-85ff-456b-ac4c-d781064ad095 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:01.630517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:01.652076 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3cbb7-85ff-456b-ac4c-d781064ad095 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:01.688150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce75ef-b3f3-4ee6-ac60-1e7fc433c27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:01.688876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce75ef-b3f3-4ee6-ac60-1e7fc433c27b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:01.689155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce75ef-b3f3-4ee6-ac60-1e7fc433c27b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:01.689432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce75ef-b3f3-4ee6-ac60-1e7fc433c27b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:01.700539 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce75ef-b3f3-4ee6-ac60-1e7fc433c27b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:01.702130 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce75ef-b3f3-4ee6-ac60-1e7fc433c27b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-44ce75ef-b3f3-4ee6-ac60-1e7fc433c27b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:39:01.720454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:01.721531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:01.722448 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:39:01.722448 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:39:01.722448 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:01.722448 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:39:01.722448 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 630/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:39:01.727793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3abc26-6af2-404e-8d08-8add3a26054a None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:01.835616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3abc26-6af2-404e-8d08-8add3a26054a None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:01.846494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:01.875398 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357477-df12-4433-ba22-e2f0942b6a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:01.876088 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357477-df12-4433-ba22-e2f0942b6a49 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:01.876372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357477-df12-4433-ba22-e2f0942b6a49 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:01.876655 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357477-df12-4433-ba22-e2f0942b6a49 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:01.878172 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f357477-df12-4433-ba22-e2f0942b6a49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:01.878485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f357477-df12-4433-ba22-e2f0942b6a49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:01.880164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f357477-df12-4433-ba22-e2f0942b6a49 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:01.892946 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 608/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:01.898828 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce75ef-b3f3-4ee6-ac60-1e7fc433c27b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:02.006217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce75ef-b3f3-4ee6-ac60-1e7fc433c27b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:02.044363 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a915e-bf2c-4149-bb0d-fa49ca6e5720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:02.045331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a915e-bf2c-4149-bb0d-fa49ca6e5720 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:02.045615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a915e-bf2c-4149-bb0d-fa49ca6e5720 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:02.045891 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a915e-bf2c-4149-bb0d-fa49ca6e5720 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:02.049496 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:02.056050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a915e-bf2c-4149-bb0d-fa49ca6e5720 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:02.057781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a915e-bf2c-4149-bb0d-fa49ca6e5720 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-7e7a915e-bf2c-4149-bb0d-fa49ca6e5720 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:39:02.074307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:02.075505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:02.076500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:02.076500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:02.076500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:39:02.076500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:39:02.076500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:39:02.076500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:39:02.076500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:39:02.076500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:39:02.076500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 03:39:02.076500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:39:02.076500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 631/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:39:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 03:39:02.081991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357477-df12-4433-ba22-e2f0942b6a49 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:02.196768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357477-df12-4433-ba22-e2f0942b6a49 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:02.234034 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3e9d1-d971-4918-986b-34afa897f49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:02.234702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3e9d1-d971-4918-986b-34afa897f49d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:02.235056 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3e9d1-d971-4918-986b-34afa897f49d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:02.235302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3e9d1-d971-4918-986b-34afa897f49d None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:02.236156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3e9d1-d971-4918-986b-34afa897f49d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:02.236467 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3e9d1-d971-4918-986b-34afa897f49d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:02.237913 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3e9d1-d971-4918-986b-34afa897f49d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:02.256058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 609/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 30 03:39:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:02.262666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a915e-bf2c-4149-bb0d-fa49ca6e5720 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:02.371769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a915e-bf2c-4149-bb0d-fa49ca6e5720 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:02.410489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac8c63-89e6-44e2-b273-6462ec47bd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:02.411232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac8c63-89e6-44e2-b273-6462ec47bd6d None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:02.411594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac8c63-89e6-44e2-b273-6462ec47bd6d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:02.411889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac8c63-89e6-44e2-b273-6462ec47bd6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:02.479790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:02.488330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac8c63-89e6-44e2-b273-6462ec47bd6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:02.489801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac8c63-89e6-44e2-b273-6462ec47bd6d None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:02.597056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 632/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:39:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 03:39:02.598378 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3e9d1-d971-4918-986b-34afa897f49d None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:02.630793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:02.709238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3e9d1-d971-4918-986b-34afa897f49d None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:02.746591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9068cd-8ee3-440b-b576-d3ae377b03bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:02.747435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9068cd-8ee3-440b-b576-d3ae377b03bd None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:02.747746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9068cd-8ee3-440b-b576-d3ae377b03bd None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:02.748074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9068cd-8ee3-440b-b576-d3ae377b03bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:02.758319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9068cd-8ee3-440b-b576-d3ae377b03bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:02.759862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9068cd-8ee3-440b-b576-d3ae377b03bd None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-df9068cd-8ee3-440b-b576-d3ae377b03bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:39:02.780166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:02.781328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:02.782336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:39:02.782336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:39:02.782336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:02.782336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:02.782336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 610/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:02.787778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac8c63-89e6-44e2-b273-6462ec47bd6d None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:02.896570 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:02.903907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac8c63-89e6-44e2-b273-6462ec47bd6d None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:02.946465 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc75c3b-5439-4b40-87b1-0ed60184f7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:02.947256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc75c3b-5439-4b40-87b1-0ed60184f7c5 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:02.947539 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc75c3b-5439-4b40-87b1-0ed60184f7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:02.947815 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc75c3b-5439-4b40-87b1-0ed60184f7c5 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:02.948545 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc75c3b-5439-4b40-87b1-0ed60184f7c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:02.948899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc75c3b-5439-4b40-87b1-0ed60184f7c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:02.950347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc75c3b-5439-4b40-87b1-0ed60184f7c5 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:02.963022 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 633/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:39:02.970152 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9068cd-8ee3-440b-b576-d3ae377b03bd None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:03.055796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:03.083244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9068cd-8ee3-440b-b576-d3ae377b03bd None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:03.124045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85e545-6e48-484a-a183-0ac00114b9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:03.125266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85e545-6e48-484a-a183-0ac00114b9e1 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:03.125520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85e545-6e48-484a-a183-0ac00114b9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:03.125817 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85e545-6e48-484a-a183-0ac00114b9e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:03.133701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85e545-6e48-484a-a183-0ac00114b9e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:03.135235 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85e545-6e48-484a-a183-0ac00114b9e1 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-5f85e545-6e48-484a-a183-0ac00114b9e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:39:03.150140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:03.151348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:03.152761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:39:03.152761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:39:03.152761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:39:03.152761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:39:03.152761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:39:03.152761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:39:03.152761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:39:03.152761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:03.152761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 611/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:39:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:03.157590 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc75c3b-5439-4b40-87b1-0ed60184f7c5 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:03.267140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc75c3b-5439-4b40-87b1-0ed60184f7c5 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:03.306683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1494e-10de-4428-9ba0-bbfdaeefcca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:03.307390 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1494e-10de-4428-9ba0-bbfdaeefcca9 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:03.307669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1494e-10de-4428-9ba0-bbfdaeefcca9 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:03.307945 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1494e-10de-4428-9ba0-bbfdaeefcca9 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:03.308794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1494e-10de-4428-9ba0-bbfdaeefcca9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:03.309207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1494e-10de-4428-9ba0-bbfdaeefcca9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:03.310857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1494e-10de-4428-9ba0-bbfdaeefcca9 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:03.323795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 634/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:39:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:03.330172 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85e545-6e48-484a-a183-0ac00114b9e1 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:03.442626 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85e545-6e48-484a-a183-0ac00114b9e1 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:03.479922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ab2fc-ff3c-4485-bc76-0415e13d2557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:03.480665 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ab2fc-ff3c-4485-bc76-0415e13d2557 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:03.480962 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ab2fc-ff3c-4485-bc76-0415e13d2557 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:03.481219 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ab2fc-ff3c-4485-bc76-0415e13d2557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:03.482184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ab2fc-ff3c-4485-bc76-0415e13d2557 None admin] RBAC: Adding query filter params (role.id=b9998a2301454764ae06a0f743463c5d, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=13562e65139b44ab931fb8fdb41a61b9) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:03.482619 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ab2fc-ff3c-4485-bc76-0415e13d2557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:03.484263 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ab2fc-ff3c-4485-bc76-0415e13d2557 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:03.490785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 612/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:39:03 2022] GET /identity/v3/role_assignments?user.id=13562e65139b44ab931fb8fdb41a61b9&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=b9998a2301454764ae06a0f743463c5d => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:05.605688 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd342821-3c97-409f-a562-4d3c9c55023c None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:05.606347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd342821-3c97-409f-a562-4d3c9c55023c None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:05.606504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd342821-3c97-409f-a562-4d3c9c55023c None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:05.610794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 635/1247] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:39:05.614091 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464fa4-49f9-45b8-b197-d8ebc0c9ed95 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:05.614621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464fa4-49f9-45b8-b197-d8ebc0c9ed95 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:05.614718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464fa4-49f9-45b8-b197-d8ebc0c9ed95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:05.621429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:05.634656 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-36464fa4-49f9-45b8-b197-d8ebc0c9ed95 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:39:05.635897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-36464fa4-49f9-45b8-b197-d8ebc0c9ed95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:39:05.706261 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 613/1248] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:39:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:39:05.730157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd342821-3c97-409f-a562-4d3c9c55023c None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:05.749925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:05.853326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd342821-3c97-409f-a562-4d3c9c55023c None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:05.894627 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72392f8-88ac-46ed-babd-aa97f5e39b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:05.895510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72392f8-88ac-46ed-babd-aa97f5e39b53 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:05.895768 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72392f8-88ac-46ed-babd-aa97f5e39b53 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:05.896046 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72392f8-88ac-46ed-babd-aa97f5e39b53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:05.907512 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72392f8-88ac-46ed-babd-aa97f5e39b53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-a72392f8-88ac-46ed-babd-aa97f5e39b53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:39:05.915678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:05.916825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:05.917695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:05.917695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:05.917695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:05.917695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:05.917695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:39:05.917695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:39:05.917695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:39:05.917695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:39:05.917695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:39:05.917695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:39:05.917695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:39:05.917695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:39:05.917695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 636/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:39:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:05.923516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36464fa4-49f9-45b8-b197-d8ebc0c9ed95 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:06.034438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36464fa4-49f9-45b8-b197-d8ebc0c9ed95 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:06.067565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:06.073202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1532d-03d8-4a89-b9d7-88afd4c0def3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:06.073987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1532d-03d8-4a89-b9d7-88afd4c0def3 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:06.074310 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1532d-03d8-4a89-b9d7-88afd4c0def3 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:06.074623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1532d-03d8-4a89-b9d7-88afd4c0def3 None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:06.075413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1532d-03d8-4a89-b9d7-88afd4c0def3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:06.075749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1532d-03d8-4a89-b9d7-88afd4c0def3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:06.077208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1532d-03d8-4a89-b9d7-88afd4c0def3 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:06.092048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 614/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:39:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:06.093459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72392f8-88ac-46ed-babd-aa97f5e39b53 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:06.179412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:06.208033 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72392f8-88ac-46ed-babd-aa97f5e39b53 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:06.248387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd850b14-e4d2-43a3-9b8b-7c8c2479fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:06.249198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd850b14-e4d2-43a3-9b8b-7c8c2479fbb6 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:06.249475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd850b14-e4d2-43a3-9b8b-7c8c2479fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:06.249748 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd850b14-e4d2-43a3-9b8b-7c8c2479fbb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:06.261545 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd850b14-e4d2-43a3-9b8b-7c8c2479fbb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:06.263574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd850b14-e4d2-43a3-9b8b-7c8c2479fbb6 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-fd850b14-e4d2-43a3-9b8b-7c8c2479fbb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:39:06.283126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:06.284406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:06.285484 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:39:06.285484 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:39:06.285484 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:06.285484 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:39:06.289483 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 637/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:06.291017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1532d-03d8-4a89-b9d7-88afd4c0def3 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:06.409567 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1532d-03d8-4a89-b9d7-88afd4c0def3 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:06.449767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a75035-b077-42e9-a09c-4ff42c24ec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:06.450309 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a75035-b077-42e9-a09c-4ff42c24ec79 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:06.450594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a75035-b077-42e9-a09c-4ff42c24ec79 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:06.450947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a75035-b077-42e9-a09c-4ff42c24ec79 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:06.451828 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a75035-b077-42e9-a09c-4ff42c24ec79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:06.452145 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a75035-b077-42e9-a09c-4ff42c24ec79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:06.453603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a75035-b077-42e9-a09c-4ff42c24ec79 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:06.470598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 615/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:06.476407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd850b14-e4d2-43a3-9b8b-7c8c2479fbb6 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:06.595108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd850b14-e4d2-43a3-9b8b-7c8c2479fbb6 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:06.629108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:06.640057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac35499-de42-49f9-b300-ded82b7584e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:06.640982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac35499-de42-49f9-b300-ded82b7584e1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:06.641235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac35499-de42-49f9-b300-ded82b7584e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:06.641664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac35499-de42-49f9-b300-ded82b7584e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:06.650320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac35499-de42-49f9-b300-ded82b7584e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:06.651987 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac35499-de42-49f9-b300-ded82b7584e1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-4ac35499-de42-49f9-b300-ded82b7584e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:39:06.669264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:06.670461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:06.671619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:06.671619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:06.671619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:39:06.671619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:39:06.671619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:39:06.671619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:39:06.671619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:39:06.671619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:39:06.671619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 03:39:06.671619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:39:06.671619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 638/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:39:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:06.676864 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a75035-b077-42e9-a09c-4ff42c24ec79 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:06.739379 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:06.790834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a75035-b077-42e9-a09c-4ff42c24ec79 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:06.830127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cea3a-4002-4529-83b8-5fa9c7362635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:06.831170 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cea3a-4002-4529-83b8-5fa9c7362635 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:06.831465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cea3a-4002-4529-83b8-5fa9c7362635 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:06.831777 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cea3a-4002-4529-83b8-5fa9c7362635 None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:06.832722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cea3a-4002-4529-83b8-5fa9c7362635 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:06.833055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cea3a-4002-4529-83b8-5fa9c7362635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:06.834792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cea3a-4002-4529-83b8-5fa9c7362635 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:06.855948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 616/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 30 03:39:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:06.862051 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac35499-de42-49f9-b300-ded82b7584e1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:06.986743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac35499-de42-49f9-b300-ded82b7584e1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:07.027065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11efebe-f1b7-4207-a5c9-77d4aae40308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:07.027948 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11efebe-f1b7-4207-a5c9-77d4aae40308 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:07.028227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11efebe-f1b7-4207-a5c9-77d4aae40308 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:07.028498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11efebe-f1b7-4207-a5c9-77d4aae40308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:07.093207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:07.109642 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11efebe-f1b7-4207-a5c9-77d4aae40308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:07.111136 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11efebe-f1b7-4207-a5c9-77d4aae40308 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:07.223749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 639/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:39:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:39:07.230064 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cea3a-4002-4529-83b8-5fa9c7362635 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:07.340588 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cea3a-4002-4529-83b8-5fa9c7362635 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:07.354847 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:07.376978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5927f6-3edc-4fae-9ec4-3968d0d8642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:07.377862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5927f6-3edc-4fae-9ec4-3968d0d8642d None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:07.378147 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5927f6-3edc-4fae-9ec4-3968d0d8642d None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:07.378422 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5927f6-3edc-4fae-9ec4-3968d0d8642d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:07.389535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5927f6-3edc-4fae-9ec4-3968d0d8642d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:07.391277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5927f6-3edc-4fae-9ec4-3968d0d8642d None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-6c5927f6-3edc-4fae-9ec4-3968d0d8642d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:39:07.411971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:07.413171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:07.414283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:39:07.414283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:39:07.414283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:07.414283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:07.414283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 617/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:07.420179 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11efebe-f1b7-4207-a5c9-77d4aae40308 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:07.519810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:07.532440 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11efebe-f1b7-4207-a5c9-77d4aae40308 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:07.567689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dffa9c-ac8d-497c-ad5e-8745bd11d29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:07.568360 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffa9c-ac8d-497c-ad5e-8745bd11d29f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:07.568635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffa9c-ac8d-497c-ad5e-8745bd11d29f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:07.568908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffa9c-ac8d-497c-ad5e-8745bd11d29f None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:07.569634 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dffa9c-ac8d-497c-ad5e-8745bd11d29f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:07.569935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dffa9c-ac8d-497c-ad5e-8745bd11d29f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:07.571382 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dffa9c-ac8d-497c-ad5e-8745bd11d29f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:07.584608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 640/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:07.592872 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5927f6-3edc-4fae-9ec4-3968d0d8642d None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:07.707045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5927f6-3edc-4fae-9ec4-3968d0d8642d None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:07.743974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94843a9-57c5-4df9-98bd-6dc7a5a5fe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:07.744783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94843a9-57c5-4df9-98bd-6dc7a5a5fe47 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:07.745059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94843a9-57c5-4df9-98bd-6dc7a5a5fe47 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:07.745331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94843a9-57c5-4df9-98bd-6dc7a5a5fe47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:07.752589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94843a9-57c5-4df9-98bd-6dc7a5a5fe47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:07.754094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94843a9-57c5-4df9-98bd-6dc7a5a5fe47 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-c94843a9-57c5-4df9-98bd-6dc7a5a5fe47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:39:07.769326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:07.770413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:07.771374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:39:07.771374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:39:07.771374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:39:07.771374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:39:07.771374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:39:07.771374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:39:07.771374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:39:07.771374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:07.771374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 618/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:39:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:07.777556 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dffa9c-ac8d-497c-ad5e-8745bd11d29f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:07.887258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dffa9c-ac8d-497c-ad5e-8745bd11d29f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:07.923191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66edfbc-74c5-4427-83f8-6d2d397b66f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:07.923925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66edfbc-74c5-4427-83f8-6d2d397b66f1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:07.924207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66edfbc-74c5-4427-83f8-6d2d397b66f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:07.924571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66edfbc-74c5-4427-83f8-6d2d397b66f1 None admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:07.925314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66edfbc-74c5-4427-83f8-6d2d397b66f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:07.925633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66edfbc-74c5-4427-83f8-6d2d397b66f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:07.927276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66edfbc-74c5-4427-83f8-6d2d397b66f1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:07.940498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 641/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:39:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:07.946857 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94843a9-57c5-4df9-98bd-6dc7a5a5fe47 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:07.976263 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:08.064545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94843a9-57c5-4df9-98bd-6dc7a5a5fe47 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:08.106307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758657a-86b1-450d-b730-d8ca87ffc71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:08.107000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758657a-86b1-450d-b730-d8ca87ffc71a None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:08.107509 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758657a-86b1-450d-b730-d8ca87ffc71a None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:08.107801 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758657a-86b1-450d-b730-d8ca87ffc71a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:08.108658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758657a-86b1-450d-b730-d8ca87ffc71a None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=13562e65139b44ab931fb8fdb41a61b9) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:08.109040 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758657a-86b1-450d-b730-d8ca87ffc71a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:08.111103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758657a-86b1-450d-b730-d8ca87ffc71a None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:08.119199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 619/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:39:07 2022] GET /identity/v3/role_assignments?user.id=13562e65139b44ab931fb8fdb41a61b9&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:10.208349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ebb9-bbdf-4096-b01b-664446029990 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:10.209152 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ebb9-bbdf-4096-b01b-664446029990 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:10.209152 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ebb9-bbdf-4096-b01b-664446029990 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:10.211240 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 642/1261] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:39:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:39:10.220418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977e9a3-cb1a-47b6-b186-939757e4b530 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:10.220827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977e9a3-cb1a-47b6-b186-939757e4b530 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:10.221078 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977e9a3-cb1a-47b6-b186-939757e4b530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:10.243092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e977e9a3-cb1a-47b6-b186-939757e4b530 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:39:10.244279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e977e9a3-cb1a-47b6-b186-939757e4b530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:39:10.322532 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 620/1262] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:39:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:39:10.345501 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174ebb9-bbdf-4096-b01b-664446029990 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:10.357975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:10.457754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174ebb9-bbdf-4096-b01b-664446029990 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:10.500769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75e8d9-fbce-44b4-9ba4-c5b56f2ced52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:10.501488 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75e8d9-fbce-44b4-9ba4-c5b56f2ced52 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:10.501773 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75e8d9-fbce-44b4-9ba4-c5b56f2ced52 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:10.502014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75e8d9-fbce-44b4-9ba4-c5b56f2ced52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:10.512934 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75e8d9-fbce-44b4-9ba4-c5b56f2ced52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-4f75e8d9-fbce-44b4-9ba4-c5b56f2ced52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:39:10.520588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:10.521682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:10.522716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:10.522716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:10.522716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:10.522716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:10.522716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:39:10.522716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:39:10.522716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:39:10.522716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:39:10.522716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:39:10.522716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:39:10.522716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:39:10.522716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:39:10.522716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 643/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:39:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:10.529061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977e9a3-cb1a-47b6-b186-939757e4b530 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:10.548742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:10.646976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977e9a3-cb1a-47b6-b186-939757e4b530 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:10.684180 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc533d-3fca-4cd3-bc3d-dbf5d5c521fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:10.684845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc533d-3fca-4cd3-bc3d-dbf5d5c521fc None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:10.685120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc533d-3fca-4cd3-bc3d-dbf5d5c521fc None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:10.685391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc533d-3fca-4cd3-bc3d-dbf5d5c521fc None admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:10.686137 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc533d-3fca-4cd3-bc3d-dbf5d5c521fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:10.686441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc533d-3fca-4cd3-bc3d-dbf5d5c521fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:10.687852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc533d-3fca-4cd3-bc3d-dbf5d5c521fc None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:10.696121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 621/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:39:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:10.702642 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75e8d9-fbce-44b4-9ba4-c5b56f2ced52 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:10.777094 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:10.811458 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75e8d9-fbce-44b4-9ba4-c5b56f2ced52 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:10.843680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7a9e6-b1f7-4f14-976d-97d16dbad19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:10.844456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7a9e6-b1f7-4f14-976d-97d16dbad19e None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:10.844736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7a9e6-b1f7-4f14-976d-97d16dbad19e None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:10.845003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7a9e6-b1f7-4f14-976d-97d16dbad19e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:10.856334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7a9e6-b1f7-4f14-976d-97d16dbad19e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:10.857772 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7a9e6-b1f7-4f14-976d-97d16dbad19e None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-ffa7a9e6-b1f7-4f14-976d-97d16dbad19e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:39:10.874795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:10.875832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:10.876839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:39:10.876839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:39:10.876839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:10.876839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:39:10.876839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 644/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:10.882013 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc533d-3fca-4cd3-bc3d-dbf5d5c521fc None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:10.968847 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:10.993690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc533d-3fca-4cd3-bc3d-dbf5d5c521fc None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:11.028984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5db05f-7ce7-4388-b5cf-556d731e7ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:11.029759 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db05f-7ce7-4388-b5cf-556d731e7ed8 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:11.030041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db05f-7ce7-4388-b5cf-556d731e7ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:11.030311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db05f-7ce7-4388-b5cf-556d731e7ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:11.031056 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5db05f-7ce7-4388-b5cf-556d731e7ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:11.031363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5db05f-7ce7-4388-b5cf-556d731e7ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:11.032748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5db05f-7ce7-4388-b5cf-556d731e7ed8 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:11.045729 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 622/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:11.052311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7a9e6-b1f7-4f14-976d-97d16dbad19e None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:11.168738 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7a9e6-b1f7-4f14-976d-97d16dbad19e None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:11.188380 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:11.205050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a25d98-783a-4d4d-adda-63334adffc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:11.205844 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a25d98-783a-4d4d-adda-63334adffc15 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:11.206131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a25d98-783a-4d4d-adda-63334adffc15 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:11.206403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a25d98-783a-4d4d-adda-63334adffc15 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:11.215912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a25d98-783a-4d4d-adda-63334adffc15 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:11.217374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a25d98-783a-4d4d-adda-63334adffc15 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-01a25d98-783a-4d4d-adda-63334adffc15 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:39:11.231585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:11.232662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:11.233657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:11.233657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:11.233657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:39:11.233657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:39:11.233657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:39:11.233657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:39:11.233657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:39:11.233657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:39:11.233657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 03:39:11.233657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:39:11.233657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 645/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:39:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:11.239031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5db05f-7ce7-4388-b5cf-556d731e7ed8 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:11.344102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5db05f-7ce7-4388-b5cf-556d731e7ed8 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:11.380997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145ba39-bae4-482f-b906-5f20bd8554ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:11.381667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145ba39-bae4-482f-b906-5f20bd8554ac None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:11.381946 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145ba39-bae4-482f-b906-5f20bd8554ac None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:11.382221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145ba39-bae4-482f-b906-5f20bd8554ac None admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:11.383084 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145ba39-bae4-482f-b906-5f20bd8554ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:11.383391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145ba39-bae4-482f-b906-5f20bd8554ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:11.384827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145ba39-bae4-482f-b906-5f20bd8554ac None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:11.393852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:11.404578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 623/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 30 03:39:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:11.413668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a25d98-783a-4d4d-adda-63334adffc15 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:11.527325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a25d98-783a-4d4d-adda-63334adffc15 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:11.563238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3898205-c1f8-4bb9-88e5-b6c5eafbb94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:11.564034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3898205-c1f8-4bb9-88e5-b6c5eafbb94f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:11.564310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3898205-c1f8-4bb9-88e5-b6c5eafbb94f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:11.564581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3898205-c1f8-4bb9-88e5-b6c5eafbb94f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:11.576543 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3898205-c1f8-4bb9-88e5-b6c5eafbb94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:11.577987 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3898205-c1f8-4bb9-88e5-b6c5eafbb94f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-a3898205-c1f8-4bb9-88e5-b6c5eafbb94f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:39:11.596141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:11.597276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:11.598350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:39:11.598350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:39:11.598350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:11.598350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:39:11.598350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 646/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:11.603607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145ba39-bae4-482f-b906-5f20bd8554ac None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:11.708095 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145ba39-bae4-482f-b906-5f20bd8554ac None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:11.744501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcbb8c-44af-4b38-8aa5-3a524e86eaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:11.745161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcbb8c-44af-4b38-8aa5-3a524e86eaa8 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:11.745436 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcbb8c-44af-4b38-8aa5-3a524e86eaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:11.745707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcbb8c-44af-4b38-8aa5-3a524e86eaa8 None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:11.746470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcbb8c-44af-4b38-8aa5-3a524e86eaa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:11.746796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcbb8c-44af-4b38-8aa5-3a524e86eaa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:11.748166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcbb8c-44af-4b38-8aa5-3a524e86eaa8 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:11.759523 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 624/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:39:11.768122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3898205-c1f8-4bb9-88e5-b6c5eafbb94f None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:11.804872 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:11.879560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3898205-c1f8-4bb9-88e5-b6c5eafbb94f None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:11.924782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa5ae1-e27f-4019-a105-ec20f34c5f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:11.925583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa5ae1-e27f-4019-a105-ec20f34c5f77 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:11.925860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa5ae1-e27f-4019-a105-ec20f34c5f77 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:11.926128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa5ae1-e27f-4019-a105-ec20f34c5f77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:11.933700 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa5ae1-e27f-4019-a105-ec20f34c5f77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:11.935423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa5ae1-e27f-4019-a105-ec20f34c5f77 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-c1aa5ae1-e27f-4019-a105-ec20f34c5f77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:39:11.949502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:11.950516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:11.951656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:39:11.951656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:39:11.951656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:39:11.951656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:39:11.951656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:39:11.951656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:39:11.951656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:39:11.951656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:39:11.951656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 647/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:39:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:11.957393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcbb8c-44af-4b38-8aa5-3a524e86eaa8 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:12.032334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:12.079153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcbb8c-44af-4b38-8aa5-3a524e86eaa8 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:12.115253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953006e7-fc0b-4500-858e-d3347796ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:12.115910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953006e7-fc0b-4500-858e-d3347796ef48 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:12.116198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953006e7-fc0b-4500-858e-d3347796ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:12.116461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953006e7-fc0b-4500-858e-d3347796ef48 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:12.117251 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953006e7-fc0b-4500-858e-d3347796ef48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:12.117559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953006e7-fc0b-4500-858e-d3347796ef48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:12.119029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953006e7-fc0b-4500-858e-d3347796ef48 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:12.131889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 625/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:12.138324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa5ae1-e27f-4019-a105-ec20f34c5f77 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:12.243179 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:12.253237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa5ae1-e27f-4019-a105-ec20f34c5f77 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:12.287966 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9f588-d018-485d-a4f7-11b880350333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:12.288854 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9f588-d018-485d-a4f7-11b880350333 None admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:12.289126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9f588-d018-485d-a4f7-11b880350333 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:12.289392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9f588-d018-485d-a4f7-11b880350333 None admin] PATH_INFO: `/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/13562e65139b44ab931fb8fdb41a61b9/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:12.291582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9f588-d018-485d-a4f7-11b880350333 None admin] RBAC: Authorizing `identity:create_grant(project_id=96e59c2ab83c477385e5a81b32a7c897, user_id=13562e65139b44ab931fb8fdb41a61b9, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:12.293014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9f588-d018-485d-a4f7-11b880350333 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:12.308734 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 648/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 03:39:12 2022] PUT /identity/v3/projects/96e59c2ab83c477385e5a81b32a7c897/users/13562e65139b44ab931fb8fdb41a61b9/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:39:14.355707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318321ef-5616-463b-bdd8-0631e51ed19f None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:14.356729 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318321ef-5616-463b-bdd8-0631e51ed19f None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:14.356729 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318321ef-5616-463b-bdd8-0631e51ed19f None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:14.358930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 626/1274] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:39:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:39:14.367513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89256dc1-e2c3-4eb9-998c-02b31b54a403 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:14.367917 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89256dc1-e2c3-4eb9-998c-02b31b54a403 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:14.368123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89256dc1-e2c3-4eb9-998c-02b31b54a403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:14.387580 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-89256dc1-e2c3-4eb9-998c-02b31b54a403 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:39:14.388781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-89256dc1-e2c3-4eb9-998c-02b31b54a403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:39:14.462460 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 649/1275] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:39:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:39:14.486950 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318321ef-5616-463b-bdd8-0631e51ed19f None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:14.606327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318321ef-5616-463b-bdd8-0631e51ed19f None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:14.625505 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:14.644313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46a573-1109-4ed1-9fc5-ed8551f79430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:14.645114 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46a573-1109-4ed1-9fc5-ed8551f79430 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:14.645393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46a573-1109-4ed1-9fc5-ed8551f79430 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:14.645669 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46a573-1109-4ed1-9fc5-ed8551f79430 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:14.657815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46a573-1109-4ed1-9fc5-ed8551f79430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-1b46a573-1109-4ed1-9fc5-ed8551f79430 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 03:39:14.665559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:14.666647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:14.667548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:14.667548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:14.667548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:14.667548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:14.667548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 03:39:14.667548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 03:39:14.667548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 03:39:14.667548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 03:39:14.667548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 03:39:14.667548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 03:39:14.667548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 03:39:14.667548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:14.667548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 627/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 03:39:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:14.673178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89256dc1-e2c3-4eb9-998c-02b31b54a403 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:14.759813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:14.779329 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89256dc1-e2c3-4eb9-998c-02b31b54a403 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:14.818376 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c7b69-cf0d-4f4c-98c8-c933741118a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:14.819057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c7b69-cf0d-4f4c-98c8-c933741118a1 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:14.819338 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c7b69-cf0d-4f4c-98c8-c933741118a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:14.819607 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c7b69-cf0d-4f4c-98c8-c933741118a1 None admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:14.820354 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c7b69-cf0d-4f4c-98c8-c933741118a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:14.820657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c7b69-cf0d-4f4c-98c8-c933741118a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:14.822015 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c7b69-cf0d-4f4c-98c8-c933741118a1 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:14.830712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 650/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 03:39:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:14.836637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46a573-1109-4ed1-9fc5-ed8551f79430 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:14.952850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46a573-1109-4ed1-9fc5-ed8551f79430 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:15.000532 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f41b06-8feb-45bb-8a12-412306d03283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:15.001323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f41b06-8feb-45bb-8a12-412306d03283 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:15.001598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f41b06-8feb-45bb-8a12-412306d03283 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:15.001863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f41b06-8feb-45bb-8a12-412306d03283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:15.012673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f41b06-8feb-45bb-8a12-412306d03283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:15.014305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f41b06-8feb-45bb-8a12-412306d03283 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-39f41b06-8feb-45bb-8a12-412306d03283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:39:15.031605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:15.032606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:15.033520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:39:15.033520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:39:15.033520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:15.033520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:15.033520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 628/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:15.039068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c7b69-cf0d-4f4c-98c8-c933741118a1 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:15.162072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c7b69-cf0d-4f4c-98c8-c933741118a1 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:15.201097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4247c1f-035d-4d82-8188-94cf66be09f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:15.201771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4247c1f-035d-4d82-8188-94cf66be09f4 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:15.202047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4247c1f-035d-4d82-8188-94cf66be09f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:15.202327 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4247c1f-035d-4d82-8188-94cf66be09f4 None admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:15.203080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4247c1f-035d-4d82-8188-94cf66be09f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:15.203385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4247c1f-035d-4d82-8188-94cf66be09f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:15.204760 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4247c1f-035d-4d82-8188-94cf66be09f4 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:15.218383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 651/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:15.224493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f41b06-8feb-45bb-8a12-412306d03283 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:15.258811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:15.341384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f41b06-8feb-45bb-8a12-412306d03283 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:15.378728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fa2ad-d08b-4fbd-aae5-ef79157b3d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:15.379568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fa2ad-d08b-4fbd-aae5-ef79157b3d0f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:15.379849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fa2ad-d08b-4fbd-aae5-ef79157b3d0f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:15.380124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fa2ad-d08b-4fbd-aae5-ef79157b3d0f None admin] PATH_INFO: `/v3/users/placement` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:15.387533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fa2ad-d08b-4fbd-aae5-ef79157b3d0f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:15.389595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fa2ad-d08b-4fbd-aae5-ef79157b3d0f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-7f1fa2ad-d08b-4fbd-aae5-ef79157b3d0f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 03:39:15.404443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:15.405550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:15.406789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:15.406789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:15.406789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 03:39:15.406789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 03:39:15.406789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 03:39:15.406789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 03:39:15.406789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 03:39:15.406789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 03:39:15.406789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 03:39:15.406789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:15.406789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 629/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:39:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:15.411723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4247c1f-035d-4d82-8188-94cf66be09f4 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:15.415952 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:15.514510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4247c1f-035d-4d82-8188-94cf66be09f4 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:15.550217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86971459-a401-4576-81be-27dcc64c7a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:15.550901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86971459-a401-4576-81be-27dcc64c7a2b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:15.551183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86971459-a401-4576-81be-27dcc64c7a2b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:15.551455 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86971459-a401-4576-81be-27dcc64c7a2b None admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:15.552281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86971459-a401-4576-81be-27dcc64c7a2b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:15.552593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86971459-a401-4576-81be-27dcc64c7a2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:15.554001 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86971459-a401-4576-81be-27dcc64c7a2b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:15.571621 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 652/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 30 03:39:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:15.579271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fa2ad-d08b-4fbd-aae5-ef79157b3d0f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:15.690869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:15.701694 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fa2ad-d08b-4fbd-aae5-ef79157b3d0f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:15.741099 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f38f4-7537-4f10-82bb-13719a76f126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:15.742018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f38f4-7537-4f10-82bb-13719a76f126 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:15.742391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f38f4-7537-4f10-82bb-13719a76f126 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:15.742736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f38f4-7537-4f10-82bb-13719a76f126 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:15.816026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f38f4-7537-4f10-82bb-13719a76f126 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:15.817469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f38f4-7537-4f10-82bb-13719a76f126 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:15.923934 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:15.936963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 630/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 03:39:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 03:39:15.943125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86971459-a401-4576-81be-27dcc64c7a2b None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:16.005645 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:16.054471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86971459-a401-4576-81be-27dcc64c7a2b None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:16.090257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c07eb-df47-4207-87cc-cd1790cedd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:16.091126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c07eb-df47-4207-87cc-cd1790cedd14 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:16.091406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c07eb-df47-4207-87cc-cd1790cedd14 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:16.091683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c07eb-df47-4207-87cc-cd1790cedd14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:16.102407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c07eb-df47-4207-87cc-cd1790cedd14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:16.103890 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c07eb-df47-4207-87cc-cd1790cedd14 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-7e2c07eb-df47-4207-87cc-cd1790cedd14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 03:39:16.121929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:16.122975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:16.123981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 03:39:16.123981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 03:39:16.123981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 03:39:16.123981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:39:16.123981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 653/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:16.129651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f38f4-7537-4f10-82bb-13719a76f126 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:16.252453 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f38f4-7537-4f10-82bb-13719a76f126 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:16.290802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98f58f-f5e1-4c77-aae7-e39130d6e08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:16.291476 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98f58f-f5e1-4c77-aae7-e39130d6e08f None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:16.291746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98f58f-f5e1-4c77-aae7-e39130d6e08f None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:16.292020 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98f58f-f5e1-4c77-aae7-e39130d6e08f None admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:16.292736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98f58f-f5e1-4c77-aae7-e39130d6e08f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:16.293036 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98f58f-f5e1-4c77-aae7-e39130d6e08f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:16.294493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98f58f-f5e1-4c77-aae7-e39130d6e08f None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:16.305638 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 631/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 03:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:16.312187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c07eb-df47-4207-87cc-cd1790cedd14 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:16.418740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c07eb-df47-4207-87cc-cd1790cedd14 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:16.434164 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:16.466721 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ad035-53e0-4696-8ba8-0af889d8ee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:16.467542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ad035-53e0-4696-8ba8-0af889d8ee7d None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:16.467823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ad035-53e0-4696-8ba8-0af889d8ee7d None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:16.468097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ad035-53e0-4696-8ba8-0af889d8ee7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:16.475126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ad035-53e0-4696-8ba8-0af889d8ee7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:16.476591 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ad035-53e0-4696-8ba8-0af889d8ee7d None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application [None req-fd8ad035-53e0-4696-8ba8-0af889d8ee7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 03:39:16.492007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:16.493034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:16.493949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 03:39:16.493949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 03:39:16.493949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 03:39:16.493949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 03:39:16.493949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 03:39:16.493949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 03:39:16.493949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 03:39:16.493949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: ERROR keystone.server.flask.application Jun 30 03:39:16.493949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 654/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 03:39:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:16.500296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98f58f-f5e1-4c77-aae7-e39130d6e08f None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:16.560362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:16.618688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98f58f-f5e1-4c77-aae7-e39130d6e08f None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:16.655589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13903c-daf4-4a81-8bdd-62aca5461192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:16.656690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13903c-daf4-4a81-8bdd-62aca5461192 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:16.657091 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13903c-daf4-4a81-8bdd-62aca5461192 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:16.657485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13903c-daf4-4a81-8bdd-62aca5461192 None admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:16.658722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13903c-daf4-4a81-8bdd-62aca5461192 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:16.659225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13903c-daf4-4a81-8bdd-62aca5461192 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:16.661540 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13903c-daf4-4a81-8bdd-62aca5461192 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:16.681667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 632/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 03:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:16.689729 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ad035-53e0-4696-8ba8-0af889d8ee7d None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:16.801763 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ad035-53e0-4696-8ba8-0af889d8ee7d None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:16.837021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946dbdc-8d61-4d19-a8e1-8a962f2ad37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:16.837595 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946dbdc-8d61-4d19-a8e1-8a962f2ad37f None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:16.837873 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946dbdc-8d61-4d19-a8e1-8a962f2ad37f None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:16.838146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946dbdc-8d61-4d19-a8e1-8a962f2ad37f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:16.839014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946dbdc-8d61-4d19-a8e1-8a962f2ad37f None admin] RBAC: Adding query filter params (role.id=debd6ade74ee428b812886f0ca9f5930, scope.project.id=96e59c2ab83c477385e5a81b32a7c897, user.id=13562e65139b44ab931fb8fdb41a61b9) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:16.839327 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946dbdc-8d61-4d19-a8e1-8a962f2ad37f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:16.841306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946dbdc-8d61-4d19-a8e1-8a962f2ad37f None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:16.847768 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 655/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 03:39:16 2022] GET /identity/v3/role_assignments?user.id=13562e65139b44ab931fb8fdb41a61b9&scope.project.id=96e59c2ab83c477385e5a81b32a7c897&role.id=debd6ade74ee428b812886f0ca9f5930 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:18.886320 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227856a-5532-4ff1-b868-dcd37010696f None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:18.886825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227856a-5532-4ff1-b868-dcd37010696f None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:18.886930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227856a-5532-4ff1-b868-dcd37010696f None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:18.889127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 633/1288] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:39:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:39:18.896563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbffe3e-711d-48f8-a3c7-21a1dfac2797 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:18.896959 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbffe3e-711d-48f8-a3c7-21a1dfac2797 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:18.897112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbffe3e-711d-48f8-a3c7-21a1dfac2797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:18.915770 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-8cbffe3e-711d-48f8-a3c7-21a1dfac2797 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:39:18.916960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8cbffe3e-711d-48f8-a3c7-21a1dfac2797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:39:18.949126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:18.990942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 656/1289] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:39:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:39:19.016046 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227856a-5532-4ff1-b868-dcd37010696f None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:19.131912 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227856a-5532-4ff1-b868-dcd37010696f None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:19.142833 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:19.177914 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c115155-3c8d-4fc6-92bd-3b749a705430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:19.178716 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c115155-3c8d-4fc6-92bd-3b749a705430 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:19.179032 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c115155-3c8d-4fc6-92bd-3b749a705430 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:19.179304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c115155-3c8d-4fc6-92bd-3b749a705430 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:19.179960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c115155-3c8d-4fc6-92bd-3b749a705430 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:19.181346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c115155-3c8d-4fc6-92bd-3b749a705430 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-8c115155-3c8d-4fc6-92bd-3b749a705430 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:19.193761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:19.194951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:19.195825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 634/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 03:39:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:19.201200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbffe3e-711d-48f8-a3c7-21a1dfac2797 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:19.303262 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbffe3e-711d-48f8-a3c7-21a1dfac2797 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:19.338884 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b90bb-fb11-4735-a878-f1aabdfb735c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:19.339542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b90bb-fb11-4735-a878-f1aabdfb735c None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:19.339823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b90bb-fb11-4735-a878-f1aabdfb735c None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:19.340096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b90bb-fb11-4735-a878-f1aabdfb735c None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:19.341168 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b90bb-fb11-4735-a878-f1aabdfb735c None admin] RBAC: Adding query filter params (name=placement) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:19.341473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b90bb-fb11-4735-a878-f1aabdfb735c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:19.342875 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b90bb-fb11-4735-a878-f1aabdfb735c None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:19.347860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 657/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jun 30 03:39:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:19.354650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c115155-3c8d-4fc6-92bd-3b749a705430 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:19.460332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c115155-3c8d-4fc6-92bd-3b749a705430 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:19.500035 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15149cad-14fd-45ae-856c-75cf68a5f928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:19.500690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15149cad-14fd-45ae-856c-75cf68a5f928 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:19.500972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15149cad-14fd-45ae-856c-75cf68a5f928 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:19.501248 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15149cad-14fd-45ae-856c-75cf68a5f928 None admin] PATH_INFO: `/v3/services` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:19.501958 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15149cad-14fd-45ae-856c-75cf68a5f928 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:19.502268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15149cad-14fd-45ae-856c-75cf68a5f928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:19.503669 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15149cad-14fd-45ae-856c-75cf68a5f928 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:19.508449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 635/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jun 30 03:39:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:21.522353 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e0820-4cdf-4ab0-ab04-04da385c56bc None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:21.523309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e0820-4cdf-4ab0-ab04-04da385c56bc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:21.523309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e0820-4cdf-4ab0-ab04-04da385c56bc None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:21.525515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 658/1293] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:39:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:39:21.531856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd161f-ca97-4bd2-b3b1-62aa03dd505d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:21.532566 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd161f-ca97-4bd2-b3b1-62aa03dd505d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:21.532840 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd161f-ca97-4bd2-b3b1-62aa03dd505d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:21.554130 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-bddd161f-ca97-4bd2-b3b1-62aa03dd505d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:39:21.555348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-bddd161f-ca97-4bd2-b3b1-62aa03dd505d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:39:21.589150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:21.643450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 636/1294] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:39:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:39:21.668287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e0820-4cdf-4ab0-ab04-04da385c56bc None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:21.703250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:21.783312 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e0820-4cdf-4ab0-ab04-04da385c56bc None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:21.824089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1085d1c-9e95-4893-b6b5-a047aa38231b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:21.824755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1085d1c-9e95-4893-b6b5-a047aa38231b None admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:21.825036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1085d1c-9e95-4893-b6b5-a047aa38231b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:21.825314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1085d1c-9e95-4893-b6b5-a047aa38231b None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:21.826124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1085d1c-9e95-4893-b6b5-a047aa38231b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:21.827537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1085d1c-9e95-4893-b6b5-a047aa38231b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:21.845235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 659/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 03:39:21 2022] POST /identity/v3/services => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:39:23.841869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d2b6e-3eb8-4c21-8539-37613ecc4139 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:23.842461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d2b6e-3eb8-4c21-8539-37613ecc4139 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:23.842461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d2b6e-3eb8-4c21-8539-37613ecc4139 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:23.843852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 637/1296] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:39:23.849264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e78a4-3ce5-42ef-80f1-1dfea759883f None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:23.849692 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e78a4-3ce5-42ef-80f1-1dfea759883f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:23.849798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e78a4-3ce5-42ef-80f1-1dfea759883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:23.868353 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-a44e78a4-3ce5-42ef-80f1-1dfea759883f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:39:23.869517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a44e78a4-3ce5-42ef-80f1-1dfea759883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:39:23.945884 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 660/1297] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:39:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:39:23.969579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d2b6e-3eb8-4c21-8539-37613ecc4139 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:24.088277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d2b6e-3eb8-4c21-8539-37613ecc4139 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:24.137251 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2feed0-b5f0-4de5-9ea3-2b0e81897e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:24.137984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2feed0-b5f0-4de5-9ea3-2b0e81897e60 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:24.138393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2feed0-b5f0-4de5-9ea3-2b0e81897e60 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:24.138678 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2feed0-b5f0-4de5-9ea3-2b0e81897e60 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:24.139361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2feed0-b5f0-4de5-9ea3-2b0e81897e60 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:24.140743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2feed0-b5f0-4de5-9ea3-2b0e81897e60 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-7b2feed0-b5f0-4de5-9ea3-2b0e81897e60 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:24.152991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:24.154221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:24.155128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 638/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 03:39:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:24.160529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e78a4-3ce5-42ef-80f1-1dfea759883f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:24.180240 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:24.274582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e78a4-3ce5-42ef-80f1-1dfea759883f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:24.310034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bf3fc-06b1-4c82-925c-9ba3ff23f257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:24.310708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf3fc-06b1-4c82-925c-9ba3ff23f257 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:24.311016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf3fc-06b1-4c82-925c-9ba3ff23f257 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:24.311289 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf3fc-06b1-4c82-925c-9ba3ff23f257 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:24.312004 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bf3fc-06b1-4c82-925c-9ba3ff23f257 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:24.312310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bf3fc-06b1-4c82-925c-9ba3ff23f257 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:24.313691 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bf3fc-06b1-4c82-925c-9ba3ff23f257 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:24.319036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 661/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jun 30 03:39:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:24.325880 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2feed0-b5f0-4de5-9ea3-2b0e81897e60 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:24.360650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:24.440223 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2feed0-b5f0-4de5-9ea3-2b0e81897e60 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:24.475460 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e21bc-a566-4844-91f3-0b187140e3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:24.476114 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e21bc-a566-4844-91f3-0b187140e3d2 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:24.476391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e21bc-a566-4844-91f3-0b187140e3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:24.476668 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e21bc-a566-4844-91f3-0b187140e3d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:24.477461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e21bc-a566-4844-91f3-0b187140e3d2 None admin] RBAC: Adding query filter params (interface=public, service_id=9eae4c91c0074f498b8bcd1e0a2b8cde, region_id=RegionOne) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:24.477769 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e21bc-a566-4844-91f3-0b187140e3d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:24.479188 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e21bc-a566-4844-91f3-0b187140e3d2 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:24.484713 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 639/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 03:39:24 2022] GET /identity/v3/endpoints?service_id=9eae4c91c0074f498b8bcd1e0a2b8cde&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:24.490660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bf3fc-06b1-4c82-925c-9ba3ff23f257 None admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:24.584421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:24.606739 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bf3fc-06b1-4c82-925c-9ba3ff23f257 None admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:24.646345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799b760-7ca8-4db9-bdf3-9298af507d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:24.647035 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799b760-7ca8-4db9-bdf3-9298af507d0b None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:24.647316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799b760-7ca8-4db9-bdf3-9298af507d0b None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:24.647589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799b760-7ca8-4db9-bdf3-9298af507d0b None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:24.648280 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799b760-7ca8-4db9-bdf3-9298af507d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:24.649691 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799b760-7ca8-4db9-bdf3-9298af507d0b None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:24.658669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 662/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 03:39:24 2022] GET /identity/v3/services => generated 2191 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:39:26.653725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47867a-1196-4515-b9fe-1ca27cc5a2ea None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:26.654681 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47867a-1196-4515-b9fe-1ca27cc5a2ea None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:26.655079 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47867a-1196-4515-b9fe-1ca27cc5a2ea None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:26.657566 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 640/1302] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:39:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:39:26.667074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c817-5f3c-4418-bc4a-d2dbe64533a1 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:26.667774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c817-5f3c-4418-bc4a-d2dbe64533a1 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:26.667923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c817-5f3c-4418-bc4a-d2dbe64533a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:26.687980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-d908c817-5f3c-4418-bc4a-d2dbe64533a1 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:39:26.689175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d908c817-5f3c-4418-bc4a-d2dbe64533a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:39:26.759764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 663/1303] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:39:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 03:39:26.783293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47867a-1196-4515-b9fe-1ca27cc5a2ea None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:26.888880 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:26.896393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47867a-1196-4515-b9fe-1ca27cc5a2ea None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:26.930907 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53509f51-5411-4f97-8a2d-a2725f385db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:26.931648 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53509f51-5411-4f97-8a2d-a2725f385db4 None admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:26.931930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53509f51-5411-4f97-8a2d-a2725f385db4 None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:26.932196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53509f51-5411-4f97-8a2d-a2725f385db4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:26.932850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53509f51-5411-4f97-8a2d-a2725f385db4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:26.934229 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53509f51-5411-4f97-8a2d-a2725f385db4 None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application [None req-53509f51-5411-4f97-8a2d-a2725f385db4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 03:39:26.946194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 03:39:26.947391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application with Lock( Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self._enter() Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application return self.creator() Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application created_value = creator( Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: ERROR keystone.server.flask.application Jun 30 03:39:26.948319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 641/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 03:39:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 03:39:26.954006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908c817-5f3c-4418-bc4a-d2dbe64533a1 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:27.039245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:27.064623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908c817-5f3c-4418-bc4a-d2dbe64533a1 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:27.103911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46392c45-6816-417b-b127-ee1b57c8c809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:27.104570 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392c45-6816-417b-b127-ee1b57c8c809 None admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:27.104855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392c45-6816-417b-b127-ee1b57c8c809 None admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:27.105126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392c45-6816-417b-b127-ee1b57c8c809 None admin] PATH_INFO: `/v3/services` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:27.105846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46392c45-6816-417b-b127-ee1b57c8c809 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:39:27.106156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46392c45-6816-417b-b127-ee1b57c8c809 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:27.107755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46392c45-6816-417b-b127-ee1b57c8c809 None admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:27.113543 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 664/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jun 30 03:39:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:39:27.119849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53509f51-5411-4f97-8a2d-a2725f385db4 None admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:39:27.229931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53509f51-5411-4f97-8a2d-a2725f385db4 None admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:39:27.265419 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8632c-8755-4703-9bf7-9f5f972db40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:39:27.266067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8632c-8755-4703-9bf7-9f5f972db40e None admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:39:27.266348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8632c-8755-4703-9bf7-9f5f972db40e None admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:39:27.266606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8632c-8755-4703-9bf7-9f5f972db40e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:39:27.267380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8632c-8755-4703-9bf7-9f5f972db40e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:39:27.268772 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8632c-8755-4703-9bf7-9f5f972db40e None admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:39:27.295534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 642/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 03:39:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:39:37.109946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=30 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:39:37.287974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:30.753869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e075d15-cbe8-457c-91b0-4fd7eb658942 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:30.754952 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e075d15-cbe8-457c-91b0-4fd7eb658942 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:30.755457 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e075d15-cbe8-457c-91b0-4fd7eb658942 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:30.760942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 665/1307] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:40:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:40:30.762414 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa98b20-2ec6-404b-9781-fb67dce8b7c9 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:30.762866 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa98b20-2ec6-404b-9781-fb67dce8b7c9 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:30.763079 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa98b20-2ec6-404b-9781-fb67dce8b7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:30.847948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-baa98b20-2ec6-404b-9781-fb67dce8b7c9 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:40:30.849162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-baa98b20-2ec6-404b-9781-fb67dce8b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:31.020075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 643/1308] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:40:31.056774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a135-eec2-4cd7-be0c-69a2216aea3f None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:31.057202 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a135-eec2-4cd7-be0c-69a2216aea3f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:31.057587 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a135-eec2-4cd7-be0c-69a2216aea3f None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:31.059737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 666/1309] 10.222.0.26 () {54 vars in 964 bytes} [Thu Jun 30 03:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:40:31.067770 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957c38-0a0e-4c79-9bf5-c6dcc40be6c1 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:31.068112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957c38-0a0e-4c79-9bf5-c6dcc40be6c1 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:31.068398 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957c38-0a0e-4c79-9bf5-c6dcc40be6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:31.184435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-44957c38-0a0e-4c79-9bf5-c6dcc40be6c1 None None] MFA Rules not processed for user `b3aa7416101948aba0b45129174cd988`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:40:31.185664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-44957c38-0a0e-4c79-9bf5-c6dcc40be6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:31.211660 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:31.274590 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 644/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Thu Jun 30 03:40:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:40:31.283317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62a135-eec2-4cd7-be0c-69a2216aea3f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:40:31.285127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9f62a135-eec2-4cd7-be0c-69a2216aea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:31.404935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62a135-eec2-4cd7-be0c-69a2216aea3f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:40:31.488317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06e6fa-60a8-44eb-9d77-b78eea88c278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:40:31.488967 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06e6fa-60a8-44eb-9d77-b78eea88c278 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:31.489244 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06e6fa-60a8-44eb-9d77-b78eea88c278 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:31.489507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06e6fa-60a8-44eb-9d77-b78eea88c278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:31.491159 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-cc06e6fa-60a8-44eb-9d77-b78eea88c278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:31.547704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:31.607635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06e6fa-60a8-44eb-9d77-b78eea88c278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:40:31.609132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06e6fa-60a8-44eb-9d77-b78eea88c278 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:40:31.629311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 667/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:40:33.925358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ed27-810a-45c1-9540-48a4e11b947d None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:33.925916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ed27-810a-45c1-9540-48a4e11b947d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:33.925916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ed27-810a-45c1-9540-48a4e11b947d None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:33.927486 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 645/1312] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:40:33.932746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09653219-d9a0-4cbe-935c-4497c201e7bc None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:33.933214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09653219-d9a0-4cbe-935c-4497c201e7bc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:33.933292 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09653219-d9a0-4cbe-935c-4497c201e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:34.024054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-09653219-d9a0-4cbe-935c-4497c201e7bc None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:40:34.025330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-09653219-d9a0-4cbe-935c-4497c201e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:34.147492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 668/1313] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:40:34.187259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ed27-810a-45c1-9540-48a4e11b947d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:40:34.188822 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7422ed27-810a-45c1-9540-48a4e11b947d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:34.316442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ed27-810a-45c1-9540-48a4e11b947d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:40:34.400233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:34.403230 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a3a9c-5a3b-4444-9f51-620d13a55be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:40:34.404055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a3a9c-5a3b-4444-9f51-620d13a55be7 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:34.404435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a3a9c-5a3b-4444-9f51-620d13a55be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:34.405005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a3a9c-5a3b-4444-9f51-620d13a55be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:34.407438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-639a3a9c-5a3b-4444-9f51-620d13a55be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:34.526022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a3a9c-5a3b-4444-9f51-620d13a55be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:40:34.527515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a3a9c-5a3b-4444-9f51-620d13a55be7 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:40:34.547958 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 646/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:40:36.968788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84c510-5454-4c9c-a6f6-3f89e23f44ba None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:36.969725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84c510-5454-4c9c-a6f6-3f89e23f44ba None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:36.969725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84c510-5454-4c9c-a6f6-3f89e23f44ba None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:36.971193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 669/1315] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:40:36.976903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57923a8-903a-474e-89ea-e032b4b5da7c None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:36.977344 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57923a8-903a-474e-89ea-e032b4b5da7c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:36.977477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57923a8-903a-474e-89ea-e032b4b5da7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:37.064732 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e57923a8-903a-474e-89ea-e032b4b5da7c None None] MFA Rules not processed for user `010c431b36384d8087a2e654e92b481d`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:40:37.066034 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e57923a8-903a-474e-89ea-e032b4b5da7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:37.140291 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:37.196659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 647/1316] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:40:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:40:37.251508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae3fd9-f686-4d84-af1b-3230892aa8cd None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:37.251785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae3fd9-f686-4d84-af1b-3230892aa8cd None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:37.252097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae3fd9-f686-4d84-af1b-3230892aa8cd None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:37.253508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 670/1317] 10.222.0.26 () {54 vars in 964 bytes} [Thu Jun 30 03:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:40:37.261129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473789a2-20a6-4056-bb62-345fbf444b19 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:37.261411 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473789a2-20a6-4056-bb62-345fbf444b19 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:37.261685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473789a2-20a6-4056-bb62-345fbf444b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:37.356202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-473789a2-20a6-4056-bb62-345fbf444b19 None None] MFA Rules not processed for user `b3aa7416101948aba0b45129174cd988`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:40:37.357430 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-473789a2-20a6-4056-bb62-345fbf444b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:37.443302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 648/1318] 10.222.0.26 () {58 vars in 1061 bytes} [Thu Jun 30 03:40:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:40:37.457450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae3fd9-f686-4d84-af1b-3230892aa8cd None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:40:37.459882 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-beae3fd9-f686-4d84-af1b-3230892aa8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:37.474335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:37.589996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae3fd9-f686-4d84-af1b-3230892aa8cd None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:40:37.671121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd627df6-1b6c-428b-86a4-f5fcf11b45c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:40:37.671779 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd627df6-1b6c-428b-86a4-f5fcf11b45c9 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:37.672059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd627df6-1b6c-428b-86a4-f5fcf11b45c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:37.672376 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd627df6-1b6c-428b-86a4-f5fcf11b45c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:37.675413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-dd627df6-1b6c-428b-86a4-f5fcf11b45c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:37.751943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:37.803620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd627df6-1b6c-428b-86a4-f5fcf11b45c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:40:37.805072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd627df6-1b6c-428b-86a4-f5fcf11b45c9 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:40:37.823827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 671/1319] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:40:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:40:40.780993 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5caff9-7ba5-4a40-8431-f1b70ddba2c3 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:40.781526 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5caff9-7ba5-4a40-8431-f1b70ddba2c3 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:40.781526 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5caff9-7ba5-4a40-8431-f1b70ddba2c3 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:40.782925 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 649/1320] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:40:40.789253 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b565a1-01bc-44af-9080-43d95f627b2f None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:40.789956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b565a1-01bc-44af-9080-43d95f627b2f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:40.790104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b565a1-01bc-44af-9080-43d95f627b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:40.866132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-89b565a1-01bc-44af-9080-43d95f627b2f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:40:40.867415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-89b565a1-01bc-44af-9080-43d95f627b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:40.977533 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 672/1321] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:40:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:40:41.019609 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5caff9-7ba5-4a40-8431-f1b70ddba2c3 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:40:41.021150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-dd5caff9-7ba5-4a40-8431-f1b70ddba2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:41.072923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:41.130786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5caff9-7ba5-4a40-8431-f1b70ddba2c3 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:40:41.210056 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22341-4612-4ebd-9413-128d1e1f7dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:40:41.210678 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22341-4612-4ebd-9413-128d1e1f7dea service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:41.210991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22341-4612-4ebd-9413-128d1e1f7dea service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:41.211266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22341-4612-4ebd-9413-128d1e1f7dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:41.212917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-02a22341-4612-4ebd-9413-128d1e1f7dea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:41.316090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:41.338723 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a22341-4612-4ebd-9413-128d1e1f7dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:40:41.340916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a22341-4612-4ebd-9413-128d1e1f7dea service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:40:41.361773 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 650/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:40:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:40:44.117327 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a39102-91ba-4ccc-8993-3119e5d44850 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:44.117887 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a39102-91ba-4ccc-8993-3119e5d44850 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:44.117887 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a39102-91ba-4ccc-8993-3119e5d44850 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:44.119259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 673/1323] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:40:44.124717 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d34e6-9859-4218-9983-2247f672f38c None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:44.125183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d34e6-9859-4218-9983-2247f672f38c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:44.125289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d34e6-9859-4218-9983-2247f672f38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:44.191807 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-945d34e6-9859-4218-9983-2247f672f38c None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:40:44.192935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-945d34e6-9859-4218-9983-2247f672f38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:44.300366 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 651/1324] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:40:44.336485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a39102-91ba-4ccc-8993-3119e5d44850 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:40:44.338028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c3a39102-91ba-4ccc-8993-3119e5d44850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:44.359957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:44.455353 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a39102-91ba-4ccc-8993-3119e5d44850 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:40:44.535473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01930c9-4c33-47e6-b443-49e23ca86722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:40:44.536142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01930c9-4c33-47e6-b443-49e23ca86722 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:44.536425 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01930c9-4c33-47e6-b443-49e23ca86722 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:44.536698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01930c9-4c33-47e6-b443-49e23ca86722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:44.538380 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f01930c9-4c33-47e6-b443-49e23ca86722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:44.614892 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:44.654653 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01930c9-4c33-47e6-b443-49e23ca86722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:40:44.656067 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01930c9-4c33-47e6-b443-49e23ca86722 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:40:44.676727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 674/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:40:46.775441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8dbc5-0085-48fb-8e26-22684dea0bfa None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:46.775960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8dbc5-0085-48fb-8e26-22684dea0bfa None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:46.775960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8dbc5-0085-48fb-8e26-22684dea0bfa None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:46.777276 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 652/1326] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:40:46.782619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3cee-5872-4c22-8c75-4479415137fc None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:46.783116 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3cee-5872-4c22-8c75-4479415137fc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:46.783211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3cee-5872-4c22-8c75-4479415137fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:46.849701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-492c3cee-5872-4c22-8c75-4479415137fc None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:40:46.851118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-492c3cee-5872-4c22-8c75-4479415137fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:46.954476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 675/1327] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:40:46.990900 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8dbc5-0085-48fb-8e26-22684dea0bfa None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:40:46.992477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-87b8dbc5-0085-48fb-8e26-22684dea0bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:47.053163 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:47.105791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8dbc5-0085-48fb-8e26-22684dea0bfa None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:40:47.188321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35345777-938d-4d7c-a76b-24edc1996720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:40:47.188972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345777-938d-4d7c-a76b-24edc1996720 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:47.189256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345777-938d-4d7c-a76b-24edc1996720 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:47.189534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345777-938d-4d7c-a76b-24edc1996720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:47.191933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-35345777-938d-4d7c-a76b-24edc1996720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:47.312388 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:47.314898 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35345777-938d-4d7c-a76b-24edc1996720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:40:47.316447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35345777-938d-4d7c-a76b-24edc1996720 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:40:47.335342 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 653/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:40:49.449044 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a1689-4bff-4ba1-a43b-990d633aaea8 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:49.449615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a1689-4bff-4ba1-a43b-990d633aaea8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:49.449615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a1689-4bff-4ba1-a43b-990d633aaea8 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:49.450998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 676/1329] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:40:49.456471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cdb0e-d4bf-4902-ad09-835f4901a44b None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:49.456988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cdb0e-d4bf-4902-ad09-835f4901a44b None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:49.457089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cdb0e-d4bf-4902-ad09-835f4901a44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:49.530472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-d17cdb0e-d4bf-4902-ad09-835f4901a44b None None] MFA Rules not processed for user `010c431b36384d8087a2e654e92b481d`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:40:49.531742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d17cdb0e-d4bf-4902-ad09-835f4901a44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:49.632861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 654/1330] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:40:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:40:49.670949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a1689-4bff-4ba1-a43b-990d633aaea8 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:40:49.672476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5c7a1689-4bff-4ba1-a43b-990d633aaea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:49.704901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:49.786367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a1689-4bff-4ba1-a43b-990d633aaea8 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:40:49.866969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f0ddd-f905-460e-9cd9-dba9cafbdd56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:40:49.867625 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f0ddd-f905-460e-9cd9-dba9cafbdd56 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:49.867906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f0ddd-f905-460e-9cd9-dba9cafbdd56 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:49.868178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f0ddd-f905-460e-9cd9-dba9cafbdd56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:49.869814 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-818f0ddd-f905-460e-9cd9-dba9cafbdd56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:49.973180 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:50.011529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f0ddd-f905-460e-9cd9-dba9cafbdd56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:40:50.012984 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f0ddd-f905-460e-9cd9-dba9cafbdd56 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:40:50.031677 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 677/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:40:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:40:52.355393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2cd4-f46f-471f-8b71-21cd1441f4d2 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:52.355990 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2cd4-f46f-471f-8b71-21cd1441f4d2 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:52.355990 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2cd4-f46f-471f-8b71-21cd1441f4d2 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:52.357335 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 655/1332] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:40:52.363760 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee82afe-0026-424c-91c9-fe0c805eb1a6 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:52.364482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee82afe-0026-424c-91c9-fe0c805eb1a6 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:52.364649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee82afe-0026-424c-91c9-fe0c805eb1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:52.442683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-cee82afe-0026-424c-91c9-fe0c805eb1a6 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:40:52.443934 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-cee82afe-0026-424c-91c9-fe0c805eb1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:52.544382 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 678/1333] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:40:52.580044 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea2cd4-f46f-471f-8b71-21cd1441f4d2 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:40:52.581641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-b6ea2cd4-f46f-471f-8b71-21cd1441f4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:52.652067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:52.688284 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea2cd4-f46f-471f-8b71-21cd1441f4d2 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:40:52.766578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb9c4b-b5fd-44d8-bf2a-fda0372c2789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:40:52.767252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb9c4b-b5fd-44d8-bf2a-fda0372c2789 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:52.767553 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb9c4b-b5fd-44d8-bf2a-fda0372c2789 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:52.767759 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb9c4b-b5fd-44d8-bf2a-fda0372c2789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:52.769582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8bbb9c4b-b5fd-44d8-bf2a-fda0372c2789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:52.893806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb9c4b-b5fd-44d8-bf2a-fda0372c2789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:40:52.896129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb9c4b-b5fd-44d8-bf2a-fda0372c2789 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:40:52.916451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:52.927053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 656/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:40:55.006839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e5ee4-01d4-4322-8c15-d717a71a9b98 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:55.007398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e5ee4-01d4-4322-8c15-d717a71a9b98 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:55.007398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e5ee4-01d4-4322-8c15-d717a71a9b98 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:55.008817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 679/1335] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:40:55.015392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a01647-0edf-47cb-a45b-9482d7b2b2b8 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:55.016092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a01647-0edf-47cb-a45b-9482d7b2b2b8 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:55.016233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a01647-0edf-47cb-a45b-9482d7b2b2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:55.107316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-14a01647-0edf-47cb-a45b-9482d7b2b2b8 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:40:55.108554 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-14a01647-0edf-47cb-a45b-9482d7b2b2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:55.207368 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 657/1336] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:40:55.252507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e5ee4-01d4-4322-8c15-d717a71a9b98 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:40:55.254961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-931e5ee4-01d4-4322-8c15-d717a71a9b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:55.312587 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:55.378743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e5ee4-01d4-4322-8c15-d717a71a9b98 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:40:55.457022 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e2fb7-460d-4bd7-87c2-e330792fb0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:40:55.457739 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e2fb7-460d-4bd7-87c2-e330792fb0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:55.457927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e2fb7-460d-4bd7-87c2-e330792fb0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:55.458227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e2fb7-460d-4bd7-87c2-e330792fb0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:55.459889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9b1e2fb7-460d-4bd7-87c2-e330792fb0b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:55.553785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:55.580974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e2fb7-460d-4bd7-87c2-e330792fb0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:40:55.582416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e2fb7-460d-4bd7-87c2-e330792fb0b4 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:40:55.601186 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 680/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:40:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:40:57.937013 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27639ef9-20fd-45b5-a496-bb60479b97f0 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:57.937546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27639ef9-20fd-45b5-a496-bb60479b97f0 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:57.937546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27639ef9-20fd-45b5-a496-bb60479b97f0 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:57.938918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 658/1338] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:40:57.944360 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0ad21-55a1-466a-8be5-39cfe8ecc20f None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:57.944889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0ad21-55a1-466a-8be5-39cfe8ecc20f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:57.944889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0ad21-55a1-466a-8be5-39cfe8ecc20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:58.012433 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-82c0ad21-55a1-466a-8be5-39cfe8ecc20f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:40:58.013613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-82c0ad21-55a1-466a-8be5-39cfe8ecc20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:58.119326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 681/1339] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:40:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:40:58.155104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27639ef9-20fd-45b5-a496-bb60479b97f0 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:40:58.156663 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-27639ef9-20fd-45b5-a496-bb60479b97f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:58.240033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:40:58.278503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27639ef9-20fd-45b5-a496-bb60479b97f0 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:40:58.377664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d8e61-cb9b-4a56-adea-65d4d6038298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:40:58.378401 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d8e61-cb9b-4a56-adea-65d4d6038298 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:40:58.378676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d8e61-cb9b-4a56-adea-65d4d6038298 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:40:58.378987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d8e61-cb9b-4a56-adea-65d4d6038298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:40:58.380665 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e70d8e61-cb9b-4a56-adea-65d4d6038298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:40:58.500349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d8e61-cb9b-4a56-adea-65d4d6038298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:40:58.501719 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d8e61-cb9b-4a56-adea-65d4d6038298 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:40:58.520025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 659/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:40:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:02.547579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a7c61-5df1-463b-a382-ef4c0d6584ac None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:02.548117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a7c61-5df1-463b-a382-ef4c0d6584ac None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:02.548599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a7c61-5df1-463b-a382-ef4c0d6584ac None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:02.550263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 682/1341] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:02.556014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf2ef1-fd8f-4d13-864b-cc7b458cfffb None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:02.556483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf2ef1-fd8f-4d13-864b-cc7b458cfffb None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:02.556586 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf2ef1-fd8f-4d13-864b-cc7b458cfffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:02.563472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:41:02.631541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-5edf2ef1-fd8f-4d13-864b-cc7b458cfffb None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:02.632756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-5edf2ef1-fd8f-4d13-864b-cc7b458cfffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:02.743096 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 660/1342] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:41:02.781853 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a7c61-5df1-463b-a382-ef4c0d6584ac None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:02.784434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0b3a7c61-5df1-463b-a382-ef4c0d6584ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:02.839116 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:41:02.890068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a7c61-5df1-463b-a382-ef4c0d6584ac None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:02.893886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30151e0b-77a7-4a35-9f62-72c2e3b93a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:02.894555 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30151e0b-77a7-4a35-9f62-72c2e3b93a5c service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:02.894860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30151e0b-77a7-4a35-9f62-72c2e3b93a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:02.895139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30151e0b-77a7-4a35-9f62-72c2e3b93a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:02.904412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30151e0b-77a7-4a35-9f62-72c2e3b93a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:02.905842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30151e0b-77a7-4a35-9f62-72c2e3b93a5c service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:02.915546 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 683/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:05.603974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43146149-b47e-46b7-9cc0-19ef2d45a331 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:05.604609 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43146149-b47e-46b7-9cc0-19ef2d45a331 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:05.604609 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43146149-b47e-46b7-9cc0-19ef2d45a331 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:05.605955 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 661/1344] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:05.612084 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874fd24-744c-491c-a79f-9fa21f4b32b3 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:05.612655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874fd24-744c-491c-a79f-9fa21f4b32b3 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:05.612655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874fd24-744c-491c-a79f-9fa21f4b32b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:05.642674 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-5874fd24-744c-491c-a79f-9fa21f4b32b3 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:05.644385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5874fd24-744c-491c-a79f-9fa21f4b32b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:05.730385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 684/1345] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:05.770047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43146149-b47e-46b7-9cc0-19ef2d45a331 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:05.782401 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43146149-b47e-46b7-9cc0-19ef2d45a331 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:05.786960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575f32a-441a-4c82-bbc5-7cf7b5a0f053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:05.787617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575f32a-441a-4c82-bbc5-7cf7b5a0f053 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:05.787880 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575f32a-441a-4c82-bbc5-7cf7b5a0f053 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:05.788149 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575f32a-441a-4c82-bbc5-7cf7b5a0f053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:05.797925 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575f32a-441a-4c82-bbc5-7cf7b5a0f053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:05.800107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575f32a-441a-4c82-bbc5-7cf7b5a0f053 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:05.809882 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 662/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:09.860570 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e90e97-c1a7-4c7f-ac6e-88389acbecfc None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:09.861091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e90e97-c1a7-4c7f-ac6e-88389acbecfc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:09.861091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e90e97-c1a7-4c7f-ac6e-88389acbecfc None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:09.862506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 685/1347] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:09.867845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffa765-789a-4ea2-8717-f4251ff81368 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:09.868283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffa765-789a-4ea2-8717-f4251ff81368 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:09.868422 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffa765-789a-4ea2-8717-f4251ff81368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:09.889067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-45ffa765-789a-4ea2-8717-f4251ff81368 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:09.890340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-45ffa765-789a-4ea2-8717-f4251ff81368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:09.899505 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 663/1348] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:09.936603 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e90e97-c1a7-4c7f-ac6e-88389acbecfc None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:09.947778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e90e97-c1a7-4c7f-ac6e-88389acbecfc None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:09.951553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499a344-d1d5-463f-9610-bff52bb819a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:09.952201 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499a344-d1d5-463f-9610-bff52bb819a2 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:09.952480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499a344-d1d5-463f-9610-bff52bb819a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:09.952757 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499a344-d1d5-463f-9610-bff52bb819a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:09.963106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499a344-d1d5-463f-9610-bff52bb819a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:09.965052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499a344-d1d5-463f-9610-bff52bb819a2 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:09.975638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 686/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:14.947961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3a240-a3bb-42f6-a395-f5bdfe788c77 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:14.948507 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3a240-a3bb-42f6-a395-f5bdfe788c77 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:14.948507 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3a240-a3bb-42f6-a395-f5bdfe788c77 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:14.956291 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 664/1350] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 03:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:14.958095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0746852-5213-4de7-a045-0cf61d3f7dc8 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:14.959235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0746852-5213-4de7-a045-0cf61d3f7dc8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:14.959687 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0746852-5213-4de7-a045-0cf61d3f7dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:15.032047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-b0746852-5213-4de7-a045-0cf61d3f7dc8 None None] MFA Rules not processed for user `13562e65139b44ab931fb8fdb41a61b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:15.033489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b0746852-5213-4de7-a045-0cf61d3f7dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:15.060571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:41:15.111140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 687/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 03:41:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:19.251592 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5249e-6675-4a2f-8418-287f7c092677 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:19.252723 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5249e-6675-4a2f-8418-287f7c092677 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:19.253301 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5249e-6675-4a2f-8418-287f7c092677 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:19.254964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 665/1352] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 03:41:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:19.260459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12d5ba-8aef-42e8-bb29-4b3698184a99 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:19.260953 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12d5ba-8aef-42e8-bb29-4b3698184a99 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:19.261070 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12d5ba-8aef-42e8-bb29-4b3698184a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:19.279721 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-9b12d5ba-8aef-42e8-bb29-4b3698184a99 None None] MFA Rules not processed for user `13562e65139b44ab931fb8fdb41a61b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:19.280922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9b12d5ba-8aef-42e8-bb29-4b3698184a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:19.290271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 688/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 03:41:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:19.883443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=72 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:41:20.878165 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e19544-c613-48b1-9a4c-b10ec7da3637 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:20.878862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e19544-c613-48b1-9a4c-b10ec7da3637 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:20.878862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e19544-c613-48b1-9a4c-b10ec7da3637 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:20.880066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 666/1354] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 03:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:20.885667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774e345-f6eb-4b66-84f6-93ac935888de None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:20.886095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774e345-f6eb-4b66-84f6-93ac935888de None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:20.886295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774e345-f6eb-4b66-84f6-93ac935888de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:20.905435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-5774e345-f6eb-4b66-84f6-93ac935888de None None] MFA Rules not processed for user `13562e65139b44ab931fb8fdb41a61b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:20.906647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5774e345-f6eb-4b66-84f6-93ac935888de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:20.916407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 689/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 03:41:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:24.390896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6a513-a544-4126-ab38-68fed038220b None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:24.391403 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6a513-a544-4126-ab38-68fed038220b None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:24.391403 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6a513-a544-4126-ab38-68fed038220b None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:24.395215 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 667/1356] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:24.400028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9002f-854b-45ac-aed3-21e4d76a5afa None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:24.400924 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9002f-854b-45ac-aed3-21e4d76a5afa None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:24.401211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9002f-854b-45ac-aed3-21e4d76a5afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:24.421563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-eaa9002f-854b-45ac-aed3-21e4d76a5afa None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:24.422744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-eaa9002f-854b-45ac-aed3-21e4d76a5afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:24.431018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 690/1357] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:24.490898 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220da36-3777-4b44-951e-ca5c934d8de1 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:24.491704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220da36-3777-4b44-951e-ca5c934d8de1 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:24.492425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220da36-3777-4b44-951e-ca5c934d8de1 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:24.494529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 668/1358] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jun 30 03:41:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:24.501722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192add51-8a58-42f8-bc90-bcefc23e8569 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:24.501990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192add51-8a58-42f8-bc90-bcefc23e8569 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:24.502258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192add51-8a58-42f8-bc90-bcefc23e8569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:24.554826 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-192add51-8a58-42f8-bc90-bcefc23e8569 None None] MFA Rules not processed for user `758b152c320e4a94921bb96541cbea98`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:24.555931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-192add51-8a58-42f8-bc90-bcefc23e8569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:24.647026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 691/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jun 30 03:41:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:24.655375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220da36-3777-4b44-951e-ca5c934d8de1 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:24.672108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220da36-3777-4b44-951e-ca5c934d8de1 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:24.677803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579bee4-80e8-4361-8047-f3cff61ab4ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:24.678984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579bee4-80e8-4361-8047-f3cff61ab4ac service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:24.679451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579bee4-80e8-4361-8047-f3cff61ab4ac service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:24.679947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579bee4-80e8-4361-8047-f3cff61ab4ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:24.688843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579bee4-80e8-4361-8047-f3cff61ab4ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:24.690942 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579bee4-80e8-4361-8047-f3cff61ab4ac service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:24.701046 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 669/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:26.932882 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b10c-09d0-4f16-81c0-daec5cfe50dd None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:26.933476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b10c-09d0-4f16-81c0-daec5cfe50dd None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:26.933476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b10c-09d0-4f16-81c0-daec5cfe50dd None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:26.935027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 692/1361] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:26.940458 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b838061-0690-497d-8015-5a7545f86b40 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:26.940890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b838061-0690-497d-8015-5a7545f86b40 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:26.941094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b838061-0690-497d-8015-5a7545f86b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:26.959782 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-4b838061-0690-497d-8015-5a7545f86b40 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:26.960998 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-4b838061-0690-497d-8015-5a7545f86b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:26.969327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 670/1362] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:41:27.013816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410b10c-09d0-4f16-81c0-daec5cfe50dd None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:27.028896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410b10c-09d0-4f16-81c0-daec5cfe50dd None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:27.034665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0028c7-3510-406e-b139-aaa42fd6694b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:27.035347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0028c7-3510-406e-b139-aaa42fd6694b service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:27.035614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0028c7-3510-406e-b139-aaa42fd6694b service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:27.035881 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0028c7-3510-406e-b139-aaa42fd6694b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:27.044505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0028c7-3510-406e-b139-aaa42fd6694b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:27.046115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0028c7-3510-406e-b139-aaa42fd6694b service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:27.056412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 693/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:29.396753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07560816-c975-4d11-9c87-264498199d21 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:29.397238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07560816-c975-4d11-9c87-264498199d21 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:29.397334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07560816-c975-4d11-9c87-264498199d21 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:29.398645 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 671/1364] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:29.404270 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012f28c-5041-4195-a9f9-9b395fab65d4 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:29.404681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012f28c-5041-4195-a9f9-9b395fab65d4 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:29.404842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012f28c-5041-4195-a9f9-9b395fab65d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:29.423411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-c012f28c-5041-4195-a9f9-9b395fab65d4 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:29.424880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c012f28c-5041-4195-a9f9-9b395fab65d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:29.447281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 694/1365] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:29.482482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a78e-c1f7-4fd2-9e22-50a3a91d398b None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:29.482972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a78e-c1f7-4fd2-9e22-50a3a91d398b None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:29.483343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a78e-c1f7-4fd2-9e22-50a3a91d398b None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:29.484855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 672/1366] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jun 30 03:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:29.490633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57335a0-ee31-4179-b450-2ef7c13da02e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:29.490971 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57335a0-ee31-4179-b450-2ef7c13da02e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:29.491253 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57335a0-ee31-4179-b450-2ef7c13da02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:29.509457 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-d57335a0-ee31-4179-b450-2ef7c13da02e None None] MFA Rules not processed for user `758b152c320e4a94921bb96541cbea98`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:29.510647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d57335a0-ee31-4179-b450-2ef7c13da02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:29.519991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 695/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jun 30 03:41:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:41:29.528059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a78e-c1f7-4fd2-9e22-50a3a91d398b None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:29.544969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a78e-c1f7-4fd2-9e22-50a3a91d398b None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:29.550796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7076407-cd85-4c8b-acc9-9940e6c6e711 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:29.551351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7076407-cd85-4c8b-acc9-9940e6c6e711 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:29.551629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7076407-cd85-4c8b-acc9-9940e6c6e711 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:29.551902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7076407-cd85-4c8b-acc9-9940e6c6e711 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:29.560820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7076407-cd85-4c8b-acc9-9940e6c6e711 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:29.562424 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7076407-cd85-4c8b-acc9-9940e6c6e711 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:29.572505 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 673/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:31.678155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b3c54-cabb-4ec7-9986-017f006f9f9e None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:31.679287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b3c54-cabb-4ec7-9986-017f006f9f9e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:31.679669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b3c54-cabb-4ec7-9986-017f006f9f9e None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:31.681139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 696/1369] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:31.686544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0374e-a939-4018-ba11-bceea7210ee0 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:31.687003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0374e-a939-4018-ba11-bceea7210ee0 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:31.687085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0374e-a939-4018-ba11-bceea7210ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:31.705693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-1db0374e-a939-4018-ba11-bceea7210ee0 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:31.707043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-1db0374e-a939-4018-ba11-bceea7210ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:31.715467 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 674/1370] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:31.762424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b3c54-cabb-4ec7-9986-017f006f9f9e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:31.779280 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b3c54-cabb-4ec7-9986-017f006f9f9e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:31.785651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b680356-9bdb-4223-bc7b-c3e33861a85e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:31.786503 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b680356-9bdb-4223-bc7b-c3e33861a85e service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:31.786983 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b680356-9bdb-4223-bc7b-c3e33861a85e service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:31.787430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b680356-9bdb-4223-bc7b-c3e33861a85e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:31.797529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b680356-9bdb-4223-bc7b-c3e33861a85e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:31.799598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b680356-9bdb-4223-bc7b-c3e33861a85e service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:31.810643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 697/1371] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:32.450481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab22bd3-38a4-4d1c-b319-652ed98f8400 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:32.451279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab22bd3-38a4-4d1c-b319-652ed98f8400 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:32.451763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab22bd3-38a4-4d1c-b319-652ed98f8400 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:32.453589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 675/1372] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:32.458940 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e6e41-9952-447f-8d5d-ff2d1f4e2439 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:32.459234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e6e41-9952-447f-8d5d-ff2d1f4e2439 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:32.459542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e6e41-9952-447f-8d5d-ff2d1f4e2439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:32.480477 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-ec5e6e41-9952-447f-8d5d-ff2d1f4e2439 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:32.481939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ec5e6e41-9952-447f-8d5d-ff2d1f4e2439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:32.495495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 698/1373] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:32.850726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9528166-b05b-4ea9-b3a8-1701bd0e4473 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:32.851616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9528166-b05b-4ea9-b3a8-1701bd0e4473 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:32.851616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9528166-b05b-4ea9-b3a8-1701bd0e4473 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:32.852936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 676/1374] 10.222.0.26 () {54 vars in 963 bytes} [Thu Jun 30 03:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:32.858173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ec337-8389-406f-b232-aae6531678c2 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:32.858615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ec337-8389-406f-b232-aae6531678c2 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:32.859117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ec337-8389-406f-b232-aae6531678c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:32.865960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:41:32.914897 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6b9ec337-8389-406f-b232-aae6531678c2 None None] MFA Rules not processed for user `aef547cb73e04f62afb9e6c20793ad8d`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:32.916098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6b9ec337-8389-406f-b232-aae6531678c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:32.985558 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 699/1375] 10.222.0.26 () {58 vars in 1060 bytes} [Thu Jun 30 03:41:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:41:32.992500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9528166-b05b-4ea9-b3a8-1701bd0e4473 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:33.004532 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9528166-b05b-4ea9-b3a8-1701bd0e4473 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:33.008737 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc498d4-04dc-4f60-9d28-67c4fa22869a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:33.009671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc498d4-04dc-4f60-9d28-67c4fa22869a service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:33.010102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc498d4-04dc-4f60-9d28-67c4fa22869a service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:33.010534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc498d4-04dc-4f60-9d28-67c4fa22869a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:33.021134 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc498d4-04dc-4f60-9d28-67c4fa22869a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:33.022787 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc498d4-04dc-4f60-9d28-67c4fa22869a service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:33.039475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 677/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:33.886268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a880f21-5a76-49fe-b91e-4aa3d44c4d59 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:33.886809 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a880f21-5a76-49fe-b91e-4aa3d44c4d59 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:33.886910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a880f21-5a76-49fe-b91e-4aa3d44c4d59 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:33.888224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 700/1377] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:33.895739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049a51b-b149-406c-bcbd-0b92b2cdc023 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:33.896227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049a51b-b149-406c-bcbd-0b92b2cdc023 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:33.896343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049a51b-b149-406c-bcbd-0b92b2cdc023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:33.915767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6049a51b-b149-406c-bcbd-0b92b2cdc023 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:33.916957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6049a51b-b149-406c-bcbd-0b92b2cdc023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:33.925814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 678/1378] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:33.968765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a880f21-5a76-49fe-b91e-4aa3d44c4d59 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:33.984738 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a880f21-5a76-49fe-b91e-4aa3d44c4d59 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:33.991049 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad317e0d-9923-4683-b4c2-98c794d83715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:33.991717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad317e0d-9923-4683-b4c2-98c794d83715 service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:33.992003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad317e0d-9923-4683-b4c2-98c794d83715 service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:33.992285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad317e0d-9923-4683-b4c2-98c794d83715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:34.000468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad317e0d-9923-4683-b4c2-98c794d83715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:34.002054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad317e0d-9923-4683-b4c2-98c794d83715 service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:34.011626 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 701/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:36.076073 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553ba62-9ad4-4235-b0b7-23e7c216cd60 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:36.076646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553ba62-9ad4-4235-b0b7-23e7c216cd60 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:36.076646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553ba62-9ad4-4235-b0b7-23e7c216cd60 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:36.078105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 679/1380] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:36.083351 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7665e-0b63-40b2-8163-e0f52e8d5061 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:36.083788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7665e-0b63-40b2-8163-e0f52e8d5061 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:36.083883 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7665e-0b63-40b2-8163-e0f52e8d5061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:36.116138 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-ded7665e-0b63-40b2-8163-e0f52e8d5061 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:36.117634 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ded7665e-0b63-40b2-8163-e0f52e8d5061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:36.133779 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 702/1381] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:36.178141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553ba62-9ad4-4235-b0b7-23e7c216cd60 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:36.193774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553ba62-9ad4-4235-b0b7-23e7c216cd60 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:36.200976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df7ecc-694f-4c4e-90e6-07076ab83c63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:36.201621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df7ecc-694f-4c4e-90e6-07076ab83c63 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:36.201898 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df7ecc-694f-4c4e-90e6-07076ab83c63 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:36.202168 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df7ecc-694f-4c4e-90e6-07076ab83c63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:36.210534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df7ecc-694f-4c4e-90e6-07076ab83c63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:36.212252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df7ecc-694f-4c4e-90e6-07076ab83c63 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:36.222070 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 680/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:38.436838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2556a-cb89-4af6-9ba6-12d1a9a7b672 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:38.437406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2556a-cb89-4af6-9ba6-12d1a9a7b672 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:38.437406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2556a-cb89-4af6-9ba6-12d1a9a7b672 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:38.438752 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 703/1383] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:38.444454 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8db72-54de-4122-9b43-6c3ea02e0bb2 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:38.444880 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8db72-54de-4122-9b43-6c3ea02e0bb2 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:38.444992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8db72-54de-4122-9b43-6c3ea02e0bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:38.463350 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-dfb8db72-54de-4122-9b43-6c3ea02e0bb2 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:38.464534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-dfb8db72-54de-4122-9b43-6c3ea02e0bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:38.474525 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 681/1384] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:38.515608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2556a-cb89-4af6-9ba6-12d1a9a7b672 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:38.530497 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2556a-cb89-4af6-9ba6-12d1a9a7b672 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:38.536465 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823bc6b-b7dc-45f7-893b-c5eacc328a67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:38.537119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823bc6b-b7dc-45f7-893b-c5eacc328a67 service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:38.538075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823bc6b-b7dc-45f7-893b-c5eacc328a67 service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:38.538353 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823bc6b-b7dc-45f7-893b-c5eacc328a67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:38.547616 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823bc6b-b7dc-45f7-893b-c5eacc328a67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:38.549362 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823bc6b-b7dc-45f7-893b-c5eacc328a67 service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:38.561806 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 704/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:40.621217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c3bb9-2e4f-49d0-b2e1-b54d9d899aec None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:40.621764 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c3bb9-2e4f-49d0-b2e1-b54d9d899aec None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:40.621764 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c3bb9-2e4f-49d0-b2e1-b54d9d899aec None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:40.623188 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 682/1386] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:40.628875 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c89738-bb88-4ad6-8205-2aa056084b15 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:40.629317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c89738-bb88-4ad6-8205-2aa056084b15 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:40.629413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c89738-bb88-4ad6-8205-2aa056084b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:40.648432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-b7c89738-bb88-4ad6-8205-2aa056084b15 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:40.649550 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b7c89738-bb88-4ad6-8205-2aa056084b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:40.657690 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 705/1387] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:40.701508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c3bb9-2e4f-49d0-b2e1-b54d9d899aec None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:40.718064 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c3bb9-2e4f-49d0-b2e1-b54d9d899aec None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:40.726511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df1476-6a0b-4f3e-8cee-48e39ae8df9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:40.727634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df1476-6a0b-4f3e-8cee-48e39ae8df9e service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:40.727974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df1476-6a0b-4f3e-8cee-48e39ae8df9e service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:40.728327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df1476-6a0b-4f3e-8cee-48e39ae8df9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:40.741762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df1476-6a0b-4f3e-8cee-48e39ae8df9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:40.745104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df1476-6a0b-4f3e-8cee-48e39ae8df9e service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:40.764262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 683/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:42.896834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f36f9-79f7-45c9-8ffa-7c9ac51be44b None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:42.897387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f36f9-79f7-45c9-8ffa-7c9ac51be44b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:42.897487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f36f9-79f7-45c9-8ffa-7c9ac51be44b None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:42.898989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 706/1389] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:42.904598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5495-f6ae-434c-b424-cfa1bf87a13d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:42.905029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5495-f6ae-434c-b424-cfa1bf87a13d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:42.905141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5495-f6ae-434c-b424-cfa1bf87a13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:42.924692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-75da5495-f6ae-434c-b424-cfa1bf87a13d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:42.925958 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-75da5495-f6ae-434c-b424-cfa1bf87a13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:42.934453 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 684/1390] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:42.981463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f36f9-79f7-45c9-8ffa-7c9ac51be44b None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:42.997505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f36f9-79f7-45c9-8ffa-7c9ac51be44b None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:43.003443 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344c659-d461-44b6-88b3-a80758cab5bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:43.004126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344c659-d461-44b6-88b3-a80758cab5bc service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:43.004440 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344c659-d461-44b6-88b3-a80758cab5bc service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:43.004708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344c659-d461-44b6-88b3-a80758cab5bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:43.014546 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344c659-d461-44b6-88b3-a80758cab5bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:43.016353 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344c659-d461-44b6-88b3-a80758cab5bc service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:43.027275 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 707/1391] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:45.126002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c20195-c65f-4d36-9ea5-226fa651ea2e None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:45.126563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c20195-c65f-4d36-9ea5-226fa651ea2e None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:45.126563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c20195-c65f-4d36-9ea5-226fa651ea2e None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:45.128196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 685/1392] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:45.133596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c34a6-b4b0-4233-98c9-3902964bedcc None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:45.134115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c34a6-b4b0-4233-98c9-3902964bedcc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:45.134115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c34a6-b4b0-4233-98c9-3902964bedcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:45.152913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-8c5c34a6-b4b0-4233-98c9-3902964bedcc None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:45.154133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8c5c34a6-b4b0-4233-98c9-3902964bedcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:45.163172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 708/1393] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:45.206937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c20195-c65f-4d36-9ea5-226fa651ea2e None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:45.222386 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c20195-c65f-4d36-9ea5-226fa651ea2e None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:45.228521 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6866089-e60e-46e6-bbc3-a52f7991344e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:45.229204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6866089-e60e-46e6-bbc3-a52f7991344e service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:45.229501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6866089-e60e-46e6-bbc3-a52f7991344e service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:45.229784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6866089-e60e-46e6-bbc3-a52f7991344e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:45.239377 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6866089-e60e-46e6-bbc3-a52f7991344e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:45.241079 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6866089-e60e-46e6-bbc3-a52f7991344e service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:45.251541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 686/1394] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:47.331216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db92e23-97d0-40cc-8d0c-dfd09d20d8d2 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:47.331771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db92e23-97d0-40cc-8d0c-dfd09d20d8d2 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:47.331771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db92e23-97d0-40cc-8d0c-dfd09d20d8d2 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:47.333041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 709/1395] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:47.338591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56c81-39f3-4bde-9fa5-4b182dcddc03 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:47.339058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56c81-39f3-4bde-9fa5-4b182dcddc03 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:47.339290 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56c81-39f3-4bde-9fa5-4b182dcddc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:47.357783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-7ae56c81-39f3-4bde-9fa5-4b182dcddc03 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:47.359003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7ae56c81-39f3-4bde-9fa5-4b182dcddc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:47.367301 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 687/1396] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:41:47.411847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db92e23-97d0-40cc-8d0c-dfd09d20d8d2 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:47.428308 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db92e23-97d0-40cc-8d0c-dfd09d20d8d2 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:47.434114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729b4af-e3b8-458e-b3de-7dd65c007a80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:47.434749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b4af-e3b8-458e-b3de-7dd65c007a80 service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:47.435059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b4af-e3b8-458e-b3de-7dd65c007a80 service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:47.435332 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b4af-e3b8-458e-b3de-7dd65c007a80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:47.444239 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729b4af-e3b8-458e-b3de-7dd65c007a80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:47.445826 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729b4af-e3b8-458e-b3de-7dd65c007a80 service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:47.456082 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 710/1397] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:48.229809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154e303-8dd5-475a-a2aa-bc91b51dc2a9 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:48.230037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154e303-8dd5-475a-a2aa-bc91b51dc2a9 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:48.230270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154e303-8dd5-475a-a2aa-bc91b51dc2a9 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:48.231891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 688/1398] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:48.237135 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028abc7-955a-488f-a2d5-969a8e5ce596 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:48.237441 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028abc7-955a-488f-a2d5-969a8e5ce596 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:48.237715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028abc7-955a-488f-a2d5-969a8e5ce596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:48.256976 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-4028abc7-955a-488f-a2d5-969a8e5ce596 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:48.258174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4028abc7-955a-488f-a2d5-969a8e5ce596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:48.266645 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 711/1399] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:48.320728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0c606-6a62-4e5c-90d5-6b9a5021acf3 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:48.321020 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0c606-6a62-4e5c-90d5-6b9a5021acf3 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:48.321297 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0c606-6a62-4e5c-90d5-6b9a5021acf3 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:48.322677 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 689/1400] 10.222.0.26 () {54 vars in 962 bytes} [Thu Jun 30 03:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:48.327782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab3db3-85f3-4285-8fb3-9472957785f2 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:48.328072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab3db3-85f3-4285-8fb3-9472957785f2 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:48.328347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab3db3-85f3-4285-8fb3-9472957785f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:48.379899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-0bab3db3-85f3-4285-8fb3-9472957785f2 None None] MFA Rules not processed for user `450fda3236cc4d1ba3189b6b66f65686`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:48.381100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0bab3db3-85f3-4285-8fb3-9472957785f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:48.414061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:41:48.443278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 712/1401] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Jun 30 03:41:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:48.450928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0c606-6a62-4e5c-90d5-6b9a5021acf3 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:48.462753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0c606-6a62-4e5c-90d5-6b9a5021acf3 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:48.466402 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69bcc5-597b-4f71-acee-5ddde490306f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450fda3236cc4d1ba3189b6b66f65686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:48.467159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69bcc5-597b-4f71-acee-5ddde490306f service glance] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:48.467500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69bcc5-597b-4f71-acee-5ddde490306f service glance] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:48.467833 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69bcc5-597b-4f71-acee-5ddde490306f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:48.477327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69bcc5-597b-4f71-acee-5ddde490306f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:48.478975 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69bcc5-597b-4f71-acee-5ddde490306f service glance] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:48.488836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 690/1402] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:49.205126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe92e3-490f-4eff-b6d1-26cfab428bd7 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:49.205502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe92e3-490f-4eff-b6d1-26cfab428bd7 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:49.205946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe92e3-490f-4eff-b6d1-26cfab428bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:49.263274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e9fe92e3-490f-4eff-b6d1-26cfab428bd7 None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:49.270180 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e9fe92e3-490f-4eff-b6d1-26cfab428bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:49.338074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 713/1403] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:41:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:49.380122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3556560-606e-4a69-b049-23e398d148b0 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:49.380371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3556560-606e-4a69-b049-23e398d148b0 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:49.380664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3556560-606e-4a69-b049-23e398d148b0 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:49.382068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 691/1404] 10.222.0.26 () {54 vars in 942 bytes} [Thu Jun 30 03:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:49.388683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ca6b-e758-4be7-97f6-764a8c3406e2 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:49.389198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ca6b-e758-4be7-97f6-764a8c3406e2 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:49.389198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ca6b-e758-4be7-97f6-764a8c3406e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:49.440925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-c037ca6b-e758-4be7-97f6-764a8c3406e2 None None] MFA Rules not processed for user `9de5d5c703b84e508e3112f90070e002`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:49.442158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c037ca6b-e758-4be7-97f6-764a8c3406e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:49.517150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 714/1405] 10.222.0.26 () {58 vars in 1039 bytes} [Thu Jun 30 03:41:49 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:49.520653 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff5622-26ba-4d8d-854e-f5535f237306 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:49.521310 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff5622-26ba-4d8d-854e-f5535f237306 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:49.521409 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff5622-26ba-4d8d-854e-f5535f237306 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:49.522840 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 692/1406] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:41:49.526607 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ca6b-e758-4be7-97f6-764a8c3406e2 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:49.527748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb842b-875f-4b6b-9e96-34b02fc07429 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:49.528053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb842b-875f-4b6b-9e96-34b02fc07429 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:49.528327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb842b-875f-4b6b-9e96-34b02fc07429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:49.536604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ca6b-e758-4be7-97f6-764a8c3406e2 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:49.541779 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15628e3-84f7-4823-9e89-ea9f31330347 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:49.542419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15628e3-84f7-4823-9e89-ea9f31330347 service swift] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:49.542737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15628e3-84f7-4823-9e89-ea9f31330347 service swift] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:49.543053 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15628e3-84f7-4823-9e89-ea9f31330347 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:49.546689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-37eb842b-875f-4b6b-9e96-34b02fc07429 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:41:49.547918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-37eb842b-875f-4b6b-9e96-34b02fc07429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:41:49.551610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15628e3-84f7-4823-9e89-ea9f31330347 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:49.553237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15628e3-84f7-4823-9e89-ea9f31330347 service swift] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:49.558797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 693/1407] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:41:49.559045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:41:49.567185 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 715/1408] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:41:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:41:49.605397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb842b-875f-4b6b-9e96-34b02fc07429 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:41:49.618680 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb842b-875f-4b6b-9e96-34b02fc07429 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:41:49.624472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c486efe-7c67-49a6-a37f-e2c6e8241bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:41:49.625095 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c486efe-7c67-49a6-a37f-e2c6e8241bf9 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:41:49.625373 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c486efe-7c67-49a6-a37f-e2c6e8241bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:41:49.625649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c486efe-7c67-49a6-a37f-e2c6e8241bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:41:49.635574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c486efe-7c67-49a6-a37f-e2c6e8241bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:41:49.637226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c486efe-7c67-49a6-a37f-e2c6e8241bf9 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:41:49.648408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 694/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:41:59.643452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=69 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:42:11.577400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2809c2-d8f3-46d1-b064-aa5c5658de60 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:11.577991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2809c2-d8f3-46d1-b064-aa5c5658de60 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:11.577991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2809c2-d8f3-46d1-b064-aa5c5658de60 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:11.579416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 716/1410] 10.222.0.26 () {54 vars in 918 bytes} [Thu Jun 30 03:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:11.585319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2228f-fa89-45fc-a473-b5c3398c7352 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:11.585748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2228f-fa89-45fc-a473-b5c3398c7352 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:11.585873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2228f-fa89-45fc-a473-b5c3398c7352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:11.606584 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-a2f2228f-fa89-45fc-a473-b5c3398c7352 None None] MFA Rules not processed for user `13562e65139b44ab931fb8fdb41a61b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:11.607831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a2f2228f-fa89-45fc-a473-b5c3398c7352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:11.618072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 695/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Jun 30 03:42:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:11.632761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef51bb6-854d-4391-b22b-66a535451a93 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:11.633054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef51bb6-854d-4391-b22b-66a535451a93 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:11.633329 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef51bb6-854d-4391-b22b-66a535451a93 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:11.634704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 717/1412] 10.222.0.26 () {54 vars in 918 bytes} [Thu Jun 30 03:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:11.639413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b3123-fa40-4d5d-a93e-4d168a43c63d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:11.639700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b3123-fa40-4d5d-a93e-4d168a43c63d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:11.639978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b3123-fa40-4d5d-a93e-4d168a43c63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:11.658546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-bf9b3123-fa40-4d5d-a93e-4d168a43c63d None None] MFA Rules not processed for user `758b152c320e4a94921bb96541cbea98`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:11.659781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-bf9b3123-fa40-4d5d-a93e-4d168a43c63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:11.669727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 696/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Jun 30 03:42:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:14.164144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720a675-9f78-445f-a1b2-aeaab1e1a0e6 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:14.164721 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720a675-9f78-445f-a1b2-aeaab1e1a0e6 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:14.164721 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720a675-9f78-445f-a1b2-aeaab1e1a0e6 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:14.166018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:14.171665 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952195ba-92f4-46d3-b690-676707c841d6 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:14.172088 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952195ba-92f4-46d3-b690-676707c841d6 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:14.172168 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952195ba-92f4-46d3-b690-676707c841d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:14.190937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-952195ba-92f4-46d3-b690-676707c841d6 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:14.192156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-952195ba-92f4-46d3-b690-676707c841d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:14.200565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:14.249116 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720a675-9f78-445f-a1b2-aeaab1e1a0e6 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:14.264158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720a675-9f78-445f-a1b2-aeaab1e1a0e6 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:14.269566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2ff4e-f5aa-429c-9838-9d63160cbf64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:14.270212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2ff4e-f5aa-429c-9838-9d63160cbf64 service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:14.270496 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2ff4e-f5aa-429c-9838-9d63160cbf64 service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:14.270793 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2ff4e-f5aa-429c-9838-9d63160cbf64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:14.279052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2ff4e-f5aa-429c-9838-9d63160cbf64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:14.280638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2ff4e-f5aa-429c-9838-9d63160cbf64 service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:14.290359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 719/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:15.203378 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dddb2-ea50-4bd3-bb05-fc2083f558b7 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:15.204232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dddb2-ea50-4bd3-bb05-fc2083f558b7 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:15.204232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dddb2-ea50-4bd3-bb05-fc2083f558b7 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:15.206266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 03:42:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:15.214655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762aca7-e8ee-4d3b-a2c0-37ee8460b28a None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:15.215119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762aca7-e8ee-4d3b-a2c0-37ee8460b28a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:15.215289 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762aca7-e8ee-4d3b-a2c0-37ee8460b28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:15.240442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-a762aca7-e8ee-4d3b-a2c0-37ee8460b28a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:15.241667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a762aca7-e8ee-4d3b-a2c0-37ee8460b28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:15.250425 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 03:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:15.406577 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dddb2-ea50-4bd3-bb05-fc2083f558b7 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:15.430424 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dddb2-ea50-4bd3-bb05-fc2083f558b7 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:15.437417 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b8ca3-67ca-4e7c-877f-53ad9f1525ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:15.438058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b8ca3-67ca-4e7c-877f-53ad9f1525ec service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:15.438351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b8ca3-67ca-4e7c-877f-53ad9f1525ec service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:15.438630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b8ca3-67ca-4e7c-877f-53ad9f1525ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:15.447445 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b8ca3-67ca-4e7c-877f-53ad9f1525ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:15.449045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b8ca3-67ca-4e7c-877f-53ad9f1525ec service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:15.459346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 699/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:16.358203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568310cf-6d15-4310-a3cd-b77ea9d05638 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:16.359172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568310cf-6d15-4310-a3cd-b77ea9d05638 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:16.359172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568310cf-6d15-4310-a3cd-b77ea9d05638 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:16.361395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 03:42:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:16.367565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e2b42-5338-4b3a-a185-dedb76bb7028 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:16.368325 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e2b42-5338-4b3a-a185-dedb76bb7028 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:16.368508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e2b42-5338-4b3a-a185-dedb76bb7028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:16.392222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-289e2b42-5338-4b3a-a185-dedb76bb7028 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:16.393433 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-289e2b42-5338-4b3a-a185-dedb76bb7028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:16.402154 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 03:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:16.552439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568310cf-6d15-4310-a3cd-b77ea9d05638 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:16.568588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568310cf-6d15-4310-a3cd-b77ea9d05638 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:16.577548 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd42806-4af1-439c-85d7-6479531810cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:16.578195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd42806-4af1-439c-85d7-6479531810cf service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:16.578472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd42806-4af1-439c-85d7-6479531810cf service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:16.578734 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd42806-4af1-439c-85d7-6479531810cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:16.588656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd42806-4af1-439c-85d7-6479531810cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:16.590275 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd42806-4af1-439c-85d7-6479531810cf service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:16.600942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 722/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:17.472148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a769d9-078d-4f32-abf4-c2cb04760148 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:17.472716 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a769d9-078d-4f32-abf4-c2cb04760148 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:17.472716 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a769d9-078d-4f32-abf4-c2cb04760148 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:17.474058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 03:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:17.480250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b46f08-106c-4a19-b131-175854e0f7d4 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:17.481259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b46f08-106c-4a19-b131-175854e0f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:17.481259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b46f08-106c-4a19-b131-175854e0f7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:17.502339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-b0b46f08-106c-4a19-b131-175854e0f7d4 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:17.503577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b0b46f08-106c-4a19-b131-175854e0f7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:17.512029 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 03:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:17.667903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a769d9-078d-4f32-abf4-c2cb04760148 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:17.684698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a769d9-078d-4f32-abf4-c2cb04760148 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:17.691605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c76817-6726-4215-9eb6-9d08b80c0cd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:17.692237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c76817-6726-4215-9eb6-9d08b80c0cd6 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:17.692512 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c76817-6726-4215-9eb6-9d08b80c0cd6 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:17.692783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c76817-6726-4215-9eb6-9d08b80c0cd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:17.701876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c76817-6726-4215-9eb6-9d08b80c0cd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:17.703526 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c76817-6726-4215-9eb6-9d08b80c0cd6 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:17.713255 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 702/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:18.571321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a394e7-c44d-4813-92bd-971081dd9e8e None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:18.572122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a394e7-c44d-4813-92bd-971081dd9e8e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:18.572122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a394e7-c44d-4813-92bd-971081dd9e8e None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:18.574223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 03:42:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:18.579600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80388b5-f333-402e-8251-59c7d21c4eea None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:18.580044 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80388b5-f333-402e-8251-59c7d21c4eea None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:18.580208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80388b5-f333-402e-8251-59c7d21c4eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:18.599928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-f80388b5-f333-402e-8251-59c7d21c4eea None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:18.601125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-f80388b5-f333-402e-8251-59c7d21c4eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:18.612182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 03:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:18.768462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a394e7-c44d-4813-92bd-971081dd9e8e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:18.785187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a394e7-c44d-4813-92bd-971081dd9e8e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:18.791198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba409e-77aa-4f35-b09f-9ab4074743fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:18.791828 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba409e-77aa-4f35-b09f-9ab4074743fe service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:18.792103 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba409e-77aa-4f35-b09f-9ab4074743fe service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:18.792376 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba409e-77aa-4f35-b09f-9ab4074743fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:18.800780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba409e-77aa-4f35-b09f-9ab4074743fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:18.802364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba409e-77aa-4f35-b09f-9ab4074743fe service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:18.811732 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 725/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:19.629098 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03ceb4-0c7f-4dcf-aa55-939e9c6d6118 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:19.629694 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03ceb4-0c7f-4dcf-aa55-939e9c6d6118 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:19.629694 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03ceb4-0c7f-4dcf-aa55-939e9c6d6118 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:19.631966 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 03:42:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:19.640455 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d54c9-8c7d-49cb-902b-6432ce6fdad5 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:19.640892 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d54c9-8c7d-49cb-902b-6432ce6fdad5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:19.641095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d54c9-8c7d-49cb-902b-6432ce6fdad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:19.667488 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-5b8d54c9-8c7d-49cb-902b-6432ce6fdad5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:19.668713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5b8d54c9-8c7d-49cb-902b-6432ce6fdad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:19.679796 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 03:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:19.834887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03ceb4-0c7f-4dcf-aa55-939e9c6d6118 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:19.851733 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03ceb4-0c7f-4dcf-aa55-939e9c6d6118 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:19.858656 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d728a3-cd51-4f26-b9e8-24a9091c698e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:19.859345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d728a3-cd51-4f26-b9e8-24a9091c698e service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:19.859619 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d728a3-cd51-4f26-b9e8-24a9091c698e service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:19.859889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d728a3-cd51-4f26-b9e8-24a9091c698e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:19.868550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d728a3-cd51-4f26-b9e8-24a9091c698e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:19.870148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d728a3-cd51-4f26-b9e8-24a9091c698e service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:19.880211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 705/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:20.690065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9c4ae-2e7e-48e4-a945-0b9448b23db6 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:20.690804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9c4ae-2e7e-48e4-a945-0b9448b23db6 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:20.690804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9c4ae-2e7e-48e4-a945-0b9448b23db6 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:20.692867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 03:42:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:20.701368 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2be9c-06bf-436f-aa8b-6fdb2316dd2f None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:20.701792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2be9c-06bf-436f-aa8b-6fdb2316dd2f None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:20.702036 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2be9c-06bf-436f-aa8b-6fdb2316dd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:20.723515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-88c2be9c-06bf-436f-aa8b-6fdb2316dd2f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:20.724733 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-88c2be9c-06bf-436f-aa8b-6fdb2316dd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:20.733905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 03:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:20.884847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9c4ae-2e7e-48e4-a945-0b9448b23db6 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:20.900034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9c4ae-2e7e-48e4-a945-0b9448b23db6 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:20.907120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d402c7-9cf6-4838-8599-49e9d724992c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:20.907766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d402c7-9cf6-4838-8599-49e9d724992c service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:20.908045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d402c7-9cf6-4838-8599-49e9d724992c service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:20.908313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d402c7-9cf6-4838-8599-49e9d724992c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:20.917442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d402c7-9cf6-4838-8599-49e9d724992c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:20.919057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d402c7-9cf6-4838-8599-49e9d724992c service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:20.928627 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 728/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:21.742066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223c087-f44b-4c08-ace9-a2b924f9a1f1 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:21.742694 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223c087-f44b-4c08-ace9-a2b924f9a1f1 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:21.742694 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223c087-f44b-4c08-ace9-a2b924f9a1f1 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:21.744055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 03:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:21.750177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00ac40-ce46-4344-a871-27ef4f6cdb0a None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:21.750910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00ac40-ce46-4344-a871-27ef4f6cdb0a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:21.751123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00ac40-ce46-4344-a871-27ef4f6cdb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:21.772260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-5d00ac40-ce46-4344-a871-27ef4f6cdb0a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:21.773493 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5d00ac40-ce46-4344-a871-27ef4f6cdb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:21.782582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 03:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:21.936181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223c087-f44b-4c08-ace9-a2b924f9a1f1 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:21.961094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223c087-f44b-4c08-ace9-a2b924f9a1f1 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:21.970635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4500f41-1db1-40c2-b28b-c0b36bb98c26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:21.971979 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4500f41-1db1-40c2-b28b-c0b36bb98c26 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:21.972362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4500f41-1db1-40c2-b28b-c0b36bb98c26 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:21.972633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4500f41-1db1-40c2-b28b-c0b36bb98c26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:21.981440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4500f41-1db1-40c2-b28b-c0b36bb98c26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:21.983072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4500f41-1db1-40c2-b28b-c0b36bb98c26 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:21.993134 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 708/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:22.804134 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d33d5-b059-4eba-9015-e335c57df265 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:22.805030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d33d5-b059-4eba-9015-e335c57df265 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:22.805030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d33d5-b059-4eba-9015-e335c57df265 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:22.807148 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 03:42:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:22.813215 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944b4a4-3a1e-4f1c-a0f2-f4d003812bc4 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:22.813659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944b4a4-3a1e-4f1c-a0f2-f4d003812bc4 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:22.813917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944b4a4-3a1e-4f1c-a0f2-f4d003812bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:22.833390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6944b4a4-3a1e-4f1c-a0f2-f4d003812bc4 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:22.834592 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6944b4a4-3a1e-4f1c-a0f2-f4d003812bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:22.843056 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 03:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:22.993945 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d33d5-b059-4eba-9015-e335c57df265 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:23.013263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d33d5-b059-4eba-9015-e335c57df265 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:23.019457 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d74a8d-a843-4a94-80f1-94d692920843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:23.020091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d74a8d-a843-4a94-80f1-94d692920843 service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:23.020368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d74a8d-a843-4a94-80f1-94d692920843 service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:23.020637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d74a8d-a843-4a94-80f1-94d692920843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:23.028936 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d74a8d-a843-4a94-80f1-94d692920843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:23.030499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d74a8d-a843-4a94-80f1-94d692920843 service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:23.040104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 731/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:24.968297 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0e7f-e5ba-4727-83c2-4dc805676e32 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:24.969228 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0e7f-e5ba-4727-83c2-4dc805676e32 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:24.969228 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0e7f-e5ba-4727-83c2-4dc805676e32 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:24.971129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:42:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:24.977238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743b772-d428-4056-aec8-29fe6449557f None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:24.977689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743b772-d428-4056-aec8-29fe6449557f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:24.977811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743b772-d428-4056-aec8-29fe6449557f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:24.996491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-3743b772-d428-4056-aec8-29fe6449557f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:24.997696 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3743b772-d428-4056-aec8-29fe6449557f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:25.006529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:25.047871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f0e7f-e5ba-4727-83c2-4dc805676e32 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:25.066115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f0e7f-e5ba-4727-83c2-4dc805676e32 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:25.069880 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c347b-1720-4c0f-a6ac-629d32aa3a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:25.070529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c347b-1720-4c0f-a6ac-629d32aa3a99 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:25.070847 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c347b-1720-4c0f-a6ac-629d32aa3a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:25.071129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c347b-1720-4c0f-a6ac-629d32aa3a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:25.080945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c347b-1720-4c0f-a6ac-629d32aa3a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:25.082371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c347b-1720-4c0f-a6ac-629d32aa3a99 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:25.092812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 711/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:27.257526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d987c-c858-459f-b410-bd4945c7d1ea None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:27.258379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d987c-c858-459f-b410-bd4945c7d1ea None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:27.258379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d987c-c858-459f-b410-bd4945c7d1ea None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:27.260564 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:42:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:27.268805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561c3e0-6f2a-4545-b145-29faaf259376 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:27.269288 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561c3e0-6f2a-4545-b145-29faaf259376 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:27.269385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561c3e0-6f2a-4545-b145-29faaf259376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:27.288735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-1561c3e0-6f2a-4545-b145-29faaf259376 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:27.289936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-1561c3e0-6f2a-4545-b145-29faaf259376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:27.299184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:27.337393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d987c-c858-459f-b410-bd4945c7d1ea None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:27.339269 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b02d987c-c858-459f-b410-bd4945c7d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:27.353437 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d987c-c858-459f-b410-bd4945c7d1ea None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:27.357262 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fe15f-4af7-4195-97b0-0e018b0e8dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:27.357933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fe15f-4af7-4195-97b0-0e018b0e8dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:27.358210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fe15f-4af7-4195-97b0-0e018b0e8dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:27.358481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fe15f-4af7-4195-97b0-0e018b0e8dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:27.368201 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fe15f-4af7-4195-97b0-0e018b0e8dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:27.369626 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fe15f-4af7-4195-97b0-0e018b0e8dc3 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:27.378795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 734/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:29.881400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160265df-f485-49f5-aade-3ea73da3ed5a None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:29.881400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160265df-f485-49f5-aade-3ea73da3ed5a None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:29.881911 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160265df-f485-49f5-aade-3ea73da3ed5a None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:29.882978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:29.889537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f837e-2d11-418f-91d8-095a8a5def52 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:29.890232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f837e-2d11-418f-91d8-095a8a5def52 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:29.890433 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f837e-2d11-418f-91d8-095a8a5def52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:29.911214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-865f837e-2d11-418f-91d8-095a8a5def52 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:29.912505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-865f837e-2d11-418f-91d8-095a8a5def52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:29.926559 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:29.961496 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160265df-f485-49f5-aade-3ea73da3ed5a None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:29.974662 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160265df-f485-49f5-aade-3ea73da3ed5a None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:29.978577 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c7d0c-67d6-49a2-89a0-9ee0fce1a53b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:29.979262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c7d0c-67d6-49a2-89a0-9ee0fce1a53b service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:29.979543 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c7d0c-67d6-49a2-89a0-9ee0fce1a53b service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:29.979821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c7d0c-67d6-49a2-89a0-9ee0fce1a53b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:29.989664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c7d0c-67d6-49a2-89a0-9ee0fce1a53b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:29.991201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c7d0c-67d6-49a2-89a0-9ee0fce1a53b service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:30.001852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 714/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:32.214351 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e498fd2-64d4-4881-9a5d-72404e4ebe6f None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:32.215261 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e498fd2-64d4-4881-9a5d-72404e4ebe6f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:32.215261 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e498fd2-64d4-4881-9a5d-72404e4ebe6f None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:32.217317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:42:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:32.226598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4352-f1c5-4267-b46b-7d14cc9d27da None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:32.227052 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4352-f1c5-4267-b46b-7d14cc9d27da None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:32.227210 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4352-f1c5-4267-b46b-7d14cc9d27da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:32.250125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-252e4352-f1c5-4267-b46b-7d14cc9d27da None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:32.251379 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-252e4352-f1c5-4267-b46b-7d14cc9d27da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:32.260219 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:32.299980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e498fd2-64d4-4881-9a5d-72404e4ebe6f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:32.313784 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e498fd2-64d4-4881-9a5d-72404e4ebe6f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:32.318473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587e1a4-2477-4dda-9b29-daad8322d8d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:32.319142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587e1a4-2477-4dda-9b29-daad8322d8d7 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:32.319430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587e1a4-2477-4dda-9b29-daad8322d8d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:32.319710 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587e1a4-2477-4dda-9b29-daad8322d8d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:32.330149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587e1a4-2477-4dda-9b29-daad8322d8d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:32.331756 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587e1a4-2477-4dda-9b29-daad8322d8d7 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:32.342031 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 737/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:34.444566 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a250f-8264-4687-8b39-2ff57caf0310 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:34.445254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a250f-8264-4687-8b39-2ff57caf0310 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:34.445254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a250f-8264-4687-8b39-2ff57caf0310 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:34.447251 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:42:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:34.456311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aedc9a-d04b-4821-a539-9c3ee052d490 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:34.456790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aedc9a-d04b-4821-a539-9c3ee052d490 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:34.457022 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aedc9a-d04b-4821-a539-9c3ee052d490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:34.477220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-97aedc9a-d04b-4821-a539-9c3ee052d490 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:34.478434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-97aedc9a-d04b-4821-a539-9c3ee052d490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:34.488538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:34.527066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a250f-8264-4687-8b39-2ff57caf0310 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:34.546074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a250f-8264-4687-8b39-2ff57caf0310 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:34.552584 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c7198-9d86-4ebe-a71c-6f5ca0ff0484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:34.553278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c7198-9d86-4ebe-a71c-6f5ca0ff0484 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:34.553651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c7198-9d86-4ebe-a71c-6f5ca0ff0484 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:34.553926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c7198-9d86-4ebe-a71c-6f5ca0ff0484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:34.570123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c7198-9d86-4ebe-a71c-6f5ca0ff0484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:34.572348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c7198-9d86-4ebe-a71c-6f5ca0ff0484 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:34.585941 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 717/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:36.767850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e1c72-c699-405c-a8f4-7890fd2fd9f2 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:36.768741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e1c72-c699-405c-a8f4-7890fd2fd9f2 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:36.768741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e1c72-c699-405c-a8f4-7890fd2fd9f2 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:36.770018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:36.778623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503bcf0-fccc-4f43-967e-18ad20f69d65 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:36.781218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503bcf0-fccc-4f43-967e-18ad20f69d65 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:36.781218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503bcf0-fccc-4f43-967e-18ad20f69d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:36.803655 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-8503bcf0-fccc-4f43-967e-18ad20f69d65 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:36.804871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8503bcf0-fccc-4f43-967e-18ad20f69d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:36.814238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:36.853032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e1c72-c699-405c-a8f4-7890fd2fd9f2 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:36.869187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e1c72-c699-405c-a8f4-7890fd2fd9f2 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:36.873992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51586ff-3bf6-46e2-9154-05b4e5654055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:36.874639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51586ff-3bf6-46e2-9154-05b4e5654055 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:36.874987 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51586ff-3bf6-46e2-9154-05b4e5654055 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:36.875244 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51586ff-3bf6-46e2-9154-05b4e5654055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:36.893508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51586ff-3bf6-46e2-9154-05b4e5654055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:36.896656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51586ff-3bf6-46e2-9154-05b4e5654055 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:36.907223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 740/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:39.085789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52354-0bf1-489e-8611-a04de2586bfb None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:39.086346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52354-0bf1-489e-8611-a04de2586bfb None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:39.086346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52354-0bf1-489e-8611-a04de2586bfb None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:39.087794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:39.093996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97085263-5586-4965-8bf4-7cb054519b00 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:39.094506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97085263-5586-4965-8bf4-7cb054519b00 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:39.094610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97085263-5586-4965-8bf4-7cb054519b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:39.116130 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-97085263-5586-4965-8bf4-7cb054519b00 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:39.117359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-97085263-5586-4965-8bf4-7cb054519b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:39.126546 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:42:39.171797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac52354-0bf1-489e-8611-a04de2586bfb None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:39.185920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac52354-0bf1-489e-8611-a04de2586bfb None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:39.189739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae241b-87e7-4178-b1ad-99593b587406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:39.190415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae241b-87e7-4178-b1ad-99593b587406 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:39.190692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae241b-87e7-4178-b1ad-99593b587406 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:39.190998 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae241b-87e7-4178-b1ad-99593b587406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:39.201437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae241b-87e7-4178-b1ad-99593b587406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:39.202947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae241b-87e7-4178-b1ad-99593b587406 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:39.214624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 720/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:41.296750 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0e44b-7c77-4ec0-a81d-e0d876ca0310 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:41.297592 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0e44b-7c77-4ec0-a81d-e0d876ca0310 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:41.297592 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0e44b-7c77-4ec0-a81d-e0d876ca0310 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:41.299701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:42:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:41.306020 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8961d71-d7b0-4705-80aa-0877d364ab00 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:41.306450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8961d71-d7b0-4705-80aa-0877d364ab00 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:41.306592 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8961d71-d7b0-4705-80aa-0877d364ab00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:41.315353 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=79 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:42:41.329366 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-d8961d71-d7b0-4705-80aa-0877d364ab00 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:41.330627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d8961d71-d7b0-4705-80aa-0877d364ab00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:41.338940 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:41.379822 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0e44b-7c77-4ec0-a81d-e0d876ca0310 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:41.389383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=73 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:42:41.397026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0e44b-7c77-4ec0-a81d-e0d876ca0310 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:41.401074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739c01a-b6e0-4506-8a38-88579fc56eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:41.401722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739c01a-b6e0-4506-8a38-88579fc56eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:41.402008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739c01a-b6e0-4506-8a38-88579fc56eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:41.402295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739c01a-b6e0-4506-8a38-88579fc56eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:41.411682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739c01a-b6e0-4506-8a38-88579fc56eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:41.413126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739c01a-b6e0-4506-8a38-88579fc56eb1 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:41.422485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 743/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:43.451478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d09a-c024-4ecf-a4b3-2c1651eb67d4 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:43.452112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d09a-c024-4ecf-a4b3-2c1651eb67d4 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:43.452112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d09a-c024-4ecf-a4b3-2c1651eb67d4 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:43.453408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:43.459073 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680533eb-6ce7-49e8-b5d1-63932c7ac5a8 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:43.459519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680533eb-6ce7-49e8-b5d1-63932c7ac5a8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:43.459624 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680533eb-6ce7-49e8-b5d1-63932c7ac5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:43.479572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-680533eb-6ce7-49e8-b5d1-63932c7ac5a8 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:43.480754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-680533eb-6ce7-49e8-b5d1-63932c7ac5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:43.489854 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:43.526473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6d09a-c024-4ecf-a4b3-2c1651eb67d4 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:43.539666 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6d09a-c024-4ecf-a4b3-2c1651eb67d4 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:43.544604 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249a571-91b0-4728-b108-fe126a4eb52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:43.545545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249a571-91b0-4728-b108-fe126a4eb52f service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:43.545911 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249a571-91b0-4728-b108-fe126a4eb52f service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:43.546330 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249a571-91b0-4728-b108-fe126a4eb52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:43.558059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249a571-91b0-4728-b108-fe126a4eb52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:43.559535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249a571-91b0-4728-b108-fe126a4eb52f service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:43.569545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 723/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:45.626921 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad68fc2-21d9-4f86-906b-9a2b6baaf662 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:45.627734 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad68fc2-21d9-4f86-906b-9a2b6baaf662 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:45.627734 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad68fc2-21d9-4f86-906b-9a2b6baaf662 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:45.629836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:42:45.637159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29500a32-b30d-4ab2-be69-1d5b589319fa None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:45.637604 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29500a32-b30d-4ab2-be69-1d5b589319fa None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:45.637718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29500a32-b30d-4ab2-be69-1d5b589319fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:45.658117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-29500a32-b30d-4ab2-be69-1d5b589319fa None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:42:45.659402 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-29500a32-b30d-4ab2-be69-1d5b589319fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:42:45.669023 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:42:45.708803 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad68fc2-21d9-4f86-906b-9a2b6baaf662 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:42:45.722178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad68fc2-21d9-4f86-906b-9a2b6baaf662 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:42:45.727026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb5f73-b523-4827-9499-c4c965b1e70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:42:45.727671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb5f73-b523-4827-9499-c4c965b1e70e service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:42:45.727958 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb5f73-b523-4827-9499-c4c965b1e70e service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:42:45.728239 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb5f73-b523-4827-9499-c4c965b1e70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:42:45.738445 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb5f73-b523-4827-9499-c4c965b1e70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:42:45.739946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb5f73-b523-4827-9499-c4c965b1e70e service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:42:45.749930 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 746/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:42:55.652639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=11 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:42:55.745254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=14 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:43:05.683748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06a817-3946-499a-8d09-8c12b68f38fc None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:05.684687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06a817-3946-499a-8d09-8c12b68f38fc None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:05.684687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06a817-3946-499a-8d09-8c12b68f38fc None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:05.686937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 725/1471] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:43:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:43:05.695949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34941ae-91d0-48e4-ae81-44fb6de1f952 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:05.696392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34941ae-91d0-48e4-ae81-44fb6de1f952 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:05.696498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34941ae-91d0-48e4-ae81-44fb6de1f952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:05.718982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-f34941ae-91d0-48e4-ae81-44fb6de1f952 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:43:05.720186 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f34941ae-91d0-48e4-ae81-44fb6de1f952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:43:05.729215 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 747/1472] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:43:05.778187 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1cb8d-d43e-468c-b9a5-76790b3a4a21 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:05.778473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1cb8d-d43e-468c-b9a5-76790b3a4a21 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:05.778749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1cb8d-d43e-468c-b9a5-76790b3a4a21 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:05.780143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 726/1473] 10.222.0.26 () {54 vars in 962 bytes} [Thu Jun 30 03:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:43:05.787320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0ea45-cd78-42e7-b0eb-34fc37bbca3c None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:05.787607 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0ea45-cd78-42e7-b0eb-34fc37bbca3c None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:05.787887 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0ea45-cd78-42e7-b0eb-34fc37bbca3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:05.810864 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-a7e0ea45-cd78-42e7-b0eb-34fc37bbca3c None None] MFA Rules not processed for user `450fda3236cc4d1ba3189b6b66f65686`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:43:05.812089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a7e0ea45-cd78-42e7-b0eb-34fc37bbca3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:43:05.820011 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 748/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Jun 30 03:43:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:43:05.830425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1cb8d-d43e-468c-b9a5-76790b3a4a21 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:43:05.843712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1cb8d-d43e-468c-b9a5-76790b3a4a21 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:43:05.848895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a590e-e1f9-4096-9957-ea5d0c443755 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450fda3236cc4d1ba3189b6b66f65686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:43:05.849567 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a590e-e1f9-4096-9957-ea5d0c443755 service glance] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:05.849803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a590e-e1f9-4096-9957-ea5d0c443755 service glance] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:05.850102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a590e-e1f9-4096-9957-ea5d0c443755 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:05.860511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a590e-e1f9-4096-9957-ea5d0c443755 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:43:05.861959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a590e-e1f9-4096-9957-ea5d0c443755 service glance] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:43:05.871790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 727/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:43:07.985093 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2025d66-69e6-412f-b818-50b747f683ce None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:07.985666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2025d66-69e6-412f-b818-50b747f683ce None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:07.985666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2025d66-69e6-412f-b818-50b747f683ce None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:07.987923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 749/1476] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:43:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:43:07.993745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703511d-3a3d-4730-87de-122c5bfd2f50 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:07.994220 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703511d-3a3d-4730-87de-122c5bfd2f50 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:07.994323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703511d-3a3d-4730-87de-122c5bfd2f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:08.012815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e703511d-3a3d-4730-87de-122c5bfd2f50 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:43:08.014012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e703511d-3a3d-4730-87de-122c5bfd2f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:43:08.022665 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 728/1477] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:43:08.053477 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2025d66-69e6-412f-b818-50b747f683ce None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:43:08.069469 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2025d66-69e6-412f-b818-50b747f683ce None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:43:08.074220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb105c2-52ad-43cb-a6fc-0732740cd0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:43:08.074893 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb105c2-52ad-43cb-a6fc-0732740cd0af admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:08.075173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb105c2-52ad-43cb-a6fc-0732740cd0af admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:08.075443 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb105c2-52ad-43cb-a6fc-0732740cd0af admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:08.076165 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb105c2-52ad-43cb-a6fc-0732740cd0af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:43:08.077946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: WARNING py.warnings [None req-ceb105c2-52ad-43cb-a6fc-0732740cd0af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:43:08.077946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: warnings.warn(msg) Jun 30 03:43:08.077946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: Jun 30 03:43:08.079109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb105c2-52ad-43cb-a6fc-0732740cd0af admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:43:08.100125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 750/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 03:43:08 2022] GET /identity/v3/projects => generated 2553 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:43:10.138308 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0191ff-9649-496b-b0d7-acb31ece79a3 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:10.138890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0191ff-9649-496b-b0d7-acb31ece79a3 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:10.138890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0191ff-9649-496b-b0d7-acb31ece79a3 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:10.140214 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 729/1479] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:43:10.147105 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3370d8-98cf-4f8f-94db-a167d9f45df0 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:10.147750 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3370d8-98cf-4f8f-94db-a167d9f45df0 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:10.147842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3370d8-98cf-4f8f-94db-a167d9f45df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:10.178204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-1d3370d8-98cf-4f8f-94db-a167d9f45df0 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:43:10.179466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1d3370d8-98cf-4f8f-94db-a167d9f45df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:43:10.188974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 751/1480] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:43:10.233429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0191ff-9649-496b-b0d7-acb31ece79a3 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:43:10.249686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0191ff-9649-496b-b0d7-acb31ece79a3 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:43:10.255527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae0b3c-c4f4-4757-a807-bab87a7340ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:43:10.256168 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae0b3c-c4f4-4757-a807-bab87a7340ea service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:10.256468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae0b3c-c4f4-4757-a807-bab87a7340ea service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:10.256725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae0b3c-c4f4-4757-a807-bab87a7340ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:10.265154 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae0b3c-c4f4-4757-a807-bab87a7340ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:43:10.266775 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae0b3c-c4f4-4757-a807-bab87a7340ea service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:43:10.276543 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 730/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:43:12.507179 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c738af4-0e18-4d0d-a63a-1dd7372d961f None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:12.507782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c738af4-0e18-4d0d-a63a-1dd7372d961f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:12.507782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c738af4-0e18-4d0d-a63a-1dd7372d961f None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:12.509143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 752/1482] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:43:12.515762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1707f-153d-4f29-bcc1-50d3630bb915 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:12.516490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1707f-153d-4f29-bcc1-50d3630bb915 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:12.516703 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1707f-153d-4f29-bcc1-50d3630bb915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:12.537104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e5f1707f-153d-4f29-bcc1-50d3630bb915 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:43:12.538325 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e5f1707f-153d-4f29-bcc1-50d3630bb915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:43:12.547277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 731/1483] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:43:12.584195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c738af4-0e18-4d0d-a63a-1dd7372d961f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:43:12.596072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c738af4-0e18-4d0d-a63a-1dd7372d961f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:43:12.600686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74a8ec-ec1d-43f2-8a03-98c0e6e48e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:43:12.601330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74a8ec-ec1d-43f2-8a03-98c0e6e48e33 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:12.601615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74a8ec-ec1d-43f2-8a03-98c0e6e48e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:12.601894 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74a8ec-ec1d-43f2-8a03-98c0e6e48e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:12.613049 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74a8ec-ec1d-43f2-8a03-98c0e6e48e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:43:12.615599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74a8ec-ec1d-43f2-8a03-98c0e6e48e33 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:43:12.630295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 753/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:43:14.707794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f1b79-fbbf-4d61-97f1-b691b946f0a8 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:14.708390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f1b79-fbbf-4d61-97f1-b691b946f0a8 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:14.708390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f1b79-fbbf-4d61-97f1-b691b946f0a8 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:14.709743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 732/1485] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:43:14.716234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd916d8-d9f2-4e78-8206-fd432513e464 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:14.716679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd916d8-d9f2-4e78-8206-fd432513e464 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:14.716795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd916d8-d9f2-4e78-8206-fd432513e464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:14.743613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-4dd916d8-d9f2-4e78-8206-fd432513e464 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:43:14.744811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4dd916d8-d9f2-4e78-8206-fd432513e464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:43:14.753340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 754/1486] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:43:14.795245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f1b79-fbbf-4d61-97f1-b691b946f0a8 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:43:14.807874 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f1b79-fbbf-4d61-97f1-b691b946f0a8 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:43:14.812061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aad3cb-dfa4-47e7-b33c-7d5d2dd840f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:43:14.812708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aad3cb-dfa4-47e7-b33c-7d5d2dd840f5 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:14.812987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aad3cb-dfa4-47e7-b33c-7d5d2dd840f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:14.813258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aad3cb-dfa4-47e7-b33c-7d5d2dd840f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:14.824029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aad3cb-dfa4-47e7-b33c-7d5d2dd840f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:43:14.825519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aad3cb-dfa4-47e7-b33c-7d5d2dd840f5 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:43:14.836383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 733/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:43:16.996333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51551b7-4b7c-4c95-8a85-d5bc8a9f56a7 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:16.997181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51551b7-4b7c-4c95-8a85-d5bc8a9f56a7 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:16.997293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51551b7-4b7c-4c95-8a85-d5bc8a9f56a7 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:16.999480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 755/1488] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:43:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:43:17.008176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e717b-235e-4c1a-8c4e-5c798c1df069 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:17.008626 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e717b-235e-4c1a-8c4e-5c798c1df069 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:17.008735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e717b-235e-4c1a-8c4e-5c798c1df069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:17.031382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-cc0e717b-235e-4c1a-8c4e-5c798c1df069 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:43:17.032601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cc0e717b-235e-4c1a-8c4e-5c798c1df069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:43:17.041606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 734/1489] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:43:17.085245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51551b7-4b7c-4c95-8a85-d5bc8a9f56a7 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:43:17.101755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51551b7-4b7c-4c95-8a85-d5bc8a9f56a7 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:43:17.106113 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950ce4c-7fb8-47f6-b518-313fb7d32585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:43:17.106751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950ce4c-7fb8-47f6-b518-313fb7d32585 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:17.107058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950ce4c-7fb8-47f6-b518-313fb7d32585 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:17.107328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950ce4c-7fb8-47f6-b518-313fb7d32585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:17.116701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950ce4c-7fb8-47f6-b518-313fb7d32585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:43:17.118137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950ce4c-7fb8-47f6-b518-313fb7d32585 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:43:17.127759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 756/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:43:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:43:19.329327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc26f8-fa28-43b5-8b26-1c4c331b7ff8 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:19.329871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc26f8-fa28-43b5-8b26-1c4c331b7ff8 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:19.329871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc26f8-fa28-43b5-8b26-1c4c331b7ff8 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:19.331204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 735/1491] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 03:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:43:19.337906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4bc6f-10fc-4e67-884a-fb5a7172cddd None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:19.338549 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4bc6f-10fc-4e67-884a-fb5a7172cddd None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:19.338751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4bc6f-10fc-4e67-884a-fb5a7172cddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:19.361529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-f6a4bc6f-10fc-4e67-884a-fb5a7172cddd None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:43:19.362727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f6a4bc6f-10fc-4e67-884a-fb5a7172cddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:43:19.372323 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 757/1492] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 03:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:43:19.414376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc26f8-fa28-43b5-8b26-1c4c331b7ff8 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:43:19.433008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc26f8-fa28-43b5-8b26-1c4c331b7ff8 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:43:19.439555 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b21e76-2070-4b43-af57-5e5f3fc8918c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:43:19.440336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b21e76-2070-4b43-af57-5e5f3fc8918c service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:43:19.440650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b21e76-2070-4b43-af57-5e5f3fc8918c service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:43:19.440983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b21e76-2070-4b43-af57-5e5f3fc8918c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:43:19.451607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b21e76-2070-4b43-af57-5e5f3fc8918c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:43:19.453059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b21e76-2070-4b43-af57-5e5f3fc8918c service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:43:19.463309 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 736/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:43:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:43:29.355948 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=33 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:43:29.458961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=33 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:45:00.395739 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f6ccc-7d6c-4fd2-b004-badd0338f4f9 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:00.396663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f6ccc-7d6c-4fd2-b004-badd0338f4f9 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:00.396663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f6ccc-7d6c-4fd2-b004-badd0338f4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:00.418140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-139f6ccc-7d6c-4fd2-b004-badd0338f4f9 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:45:00.419383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-139f6ccc-7d6c-4fd2-b004-badd0338f4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:45:00.428852 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 758/1494] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:45:00.438100 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c69d7-1a0b-463e-bb24-8344b4253c59 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:00.439004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c69d7-1a0b-463e-bb24-8344b4253c59 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:00.439004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c69d7-1a0b-463e-bb24-8344b4253c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:00.468355 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-2e4c69d7-1a0b-463e-bb24-8344b4253c59 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:45:00.469569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2e4c69d7-1a0b-463e-bb24-8344b4253c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:45:00.479459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 737/1495] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:45:00.484158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f6ccc-7d6c-4fd2-b004-badd0338f4f9 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:45:00.494374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f6ccc-7d6c-4fd2-b004-badd0338f4f9 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:45:00.500281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51d6a3-a9a9-4bbb-853b-0232ef2fa3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:45:00.500944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d6a3-a9a9-4bbb-853b-0232ef2fa3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:00.501224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d6a3-a9a9-4bbb-853b-0232ef2fa3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:00.501502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d6a3-a9a9-4bbb-853b-0232ef2fa3d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:00.502229 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51d6a3-a9a9-4bbb-853b-0232ef2fa3d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:45:00.502534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51d6a3-a9a9-4bbb-853b-0232ef2fa3d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:45:00.503610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: WARNING py.warnings [None req-7e51d6a3-a9a9-4bbb-853b-0232ef2fa3d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:45:00.503610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: warnings.warn(msg) Jun 30 03:45:00.503610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: Jun 30 03:45:00.504496 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51d6a3-a9a9-4bbb-853b-0232ef2fa3d7 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:45:00.516880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 759/1496] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:45:00.525323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c69d7-1a0b-463e-bb24-8344b4253c59 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:45:00.535349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c69d7-1a0b-463e-bb24-8344b4253c59 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:45:00.540354 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78437350-a240-4b3c-80b8-4aff67fa8792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:45:00.541021 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78437350-a240-4b3c-80b8-4aff67fa8792 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:00.541307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78437350-a240-4b3c-80b8-4aff67fa8792 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:00.541578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78437350-a240-4b3c-80b8-4aff67fa8792 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:00.542321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78437350-a240-4b3c-80b8-4aff67fa8792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:45:00.544192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: WARNING py.warnings [None req-78437350-a240-4b3c-80b8-4aff67fa8792 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:45:00.544192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: warnings.warn(msg) Jun 30 03:45:00.544192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: Jun 30 03:45:00.545412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78437350-a240-4b3c-80b8-4aff67fa8792 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:45:00.585384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 738/1497] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:45:00 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:45:00.589719 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51d6a3-a9a9-4bbb-853b-0232ef2fa3d7 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:45:00.600273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51d6a3-a9a9-4bbb-853b-0232ef2fa3d7 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:45:00.658659 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e1de7-dad3-4ebb-80b4-3651b252ae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:45:00.659383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e1de7-dad3-4ebb-80b4-3651b252ae65 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:00.659674 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e1de7-dad3-4ebb-80b4-3651b252ae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:00.659947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e1de7-dad3-4ebb-80b4-3651b252ae65 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:00.660643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e1de7-dad3-4ebb-80b4-3651b252ae65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:45:00.661668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: WARNING py.warnings [None req-187e1de7-dad3-4ebb-80b4-3651b252ae65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:45:00.661668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: warnings.warn(msg) Jun 30 03:45:00.661668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: Jun 30 03:45:00.662912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e1de7-dad3-4ebb-80b4-3651b252ae65 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:45:00.683558 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 760/1498] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:45:00 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:45:00.687874 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78437350-a240-4b3c-80b8-4aff67fa8792 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:45:00.699689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78437350-a240-4b3c-80b8-4aff67fa8792 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:45:00.704347 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfea419-b644-498a-a29f-e080dfb88754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:45:00.705079 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfea419-b644-498a-a29f-e080dfb88754 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:00.705363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfea419-b644-498a-a29f-e080dfb88754 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:00.705651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfea419-b644-498a-a29f-e080dfb88754 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:00.706385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfea419-b644-498a-a29f-e080dfb88754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:45:00.707465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: WARNING py.warnings [None req-fbfea419-b644-498a-a29f-e080dfb88754 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:45:00.707465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: warnings.warn(msg) Jun 30 03:45:00.707465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: Jun 30 03:45:00.708390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfea419-b644-498a-a29f-e080dfb88754 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:45:00.721714 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 739/1499] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:45:00.725707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e1de7-dad3-4ebb-80b4-3651b252ae65 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:45:00.735939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e1de7-dad3-4ebb-80b4-3651b252ae65 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:45:00.740954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e60dd6-f79c-479b-b584-0d9fe937d526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:45:00.741613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60dd6-f79c-479b-b584-0d9fe937d526 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:00.741899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60dd6-f79c-479b-b584-0d9fe937d526 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:00.742180 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60dd6-f79c-479b-b584-0d9fe937d526 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:00.742947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e60dd6-f79c-479b-b584-0d9fe937d526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:45:00.743970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: WARNING py.warnings [None req-00e60dd6-f79c-479b-b584-0d9fe937d526 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:45:00.743970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: warnings.warn(msg) Jun 30 03:45:00.743970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: Jun 30 03:45:00.744856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e60dd6-f79c-479b-b584-0d9fe937d526 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:45:00.758454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 761/1500] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:45:00.763332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfea419-b644-498a-a29f-e080dfb88754 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:45:00.779412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfea419-b644-498a-a29f-e080dfb88754 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:45:00.787809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441c29b-69f4-4b17-88d8-73c44ca3ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:45:00.789034 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441c29b-69f4-4b17-88d8-73c44ca3ab31 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:00.789402 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441c29b-69f4-4b17-88d8-73c44ca3ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:00.789773 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441c29b-69f4-4b17-88d8-73c44ca3ab31 admin admin] PATH_INFO: `/v3/projects/385e5900d8d04bf684a16dc415d2513e/users/f584637c9a9f44038e4efa0dc54e1594/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:00.807002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441c29b-69f4-4b17-88d8-73c44ca3ab31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385e5900d8d04bf684a16dc415d2513e, user_id=f584637c9a9f44038e4efa0dc54e1594, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:45:00.808506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: WARNING py.warnings [None req-1441c29b-69f4-4b17-88d8-73c44ca3ab31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:45:00.808506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: warnings.warn(msg) Jun 30 03:45:00.808506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: Jun 30 03:45:00.810499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441c29b-69f4-4b17-88d8-73c44ca3ab31 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:45:00.827474 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 740/1501] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:45:00 2022] PUT /identity/v3/projects/385e5900d8d04bf684a16dc415d2513e/users/f584637c9a9f44038e4efa0dc54e1594/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:45:00.840311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459e7ec-2553-47f5-937b-6fcf19e48b97 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:00.840627 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459e7ec-2553-47f5-937b-6fcf19e48b97 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:00.840904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459e7ec-2553-47f5-937b-6fcf19e48b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:00.869875 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-1459e7ec-2553-47f5-937b-6fcf19e48b97 None None] MFA Rules not processed for user `f584637c9a9f44038e4efa0dc54e1594`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:45:00.871478 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1459e7ec-2553-47f5-937b-6fcf19e48b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:45:00.937594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 762/1502] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:45:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:45:00.952982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341f583-875a-4665-bf48-982caed27cec None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:00.953266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341f583-875a-4665-bf48-982caed27cec None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:00.953535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341f583-875a-4665-bf48-982caed27cec None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:00.955014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 741/1503] 10.222.0.26 () {54 vars in 963 bytes} [Thu Jun 30 03:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:45:00.960139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf7ffe-1641-4310-9063-f2bd7004519f None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:00.960429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf7ffe-1641-4310-9063-f2bd7004519f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:00.960702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf7ffe-1641-4310-9063-f2bd7004519f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:00.979401 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-0fbf7ffe-1641-4310-9063-f2bd7004519f None None] MFA Rules not processed for user `aef547cb73e04f62afb9e6c20793ad8d`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:45:00.980638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0fbf7ffe-1641-4310-9063-f2bd7004519f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:45:01.025100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:45:01.034198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 763/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Thu Jun 30 03:45:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:45:01.042936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341f583-875a-4665-bf48-982caed27cec None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:45:01.054757 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341f583-875a-4665-bf48-982caed27cec None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:45:01.058871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144769d8-30b0-4014-8dba-9f420b0c6806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:45:01.059518 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144769d8-30b0-4014-8dba-9f420b0c6806 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:01.059800 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144769d8-30b0-4014-8dba-9f420b0c6806 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:01.060076 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144769d8-30b0-4014-8dba-9f420b0c6806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:01.068400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144769d8-30b0-4014-8dba-9f420b0c6806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:45:01.069845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144769d8-30b0-4014-8dba-9f420b0c6806 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:45:01.078692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 742/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:45:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:45:01.121604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c3931-6714-4dad-911d-b9dc994b2437 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:01.121888 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c3931-6714-4dad-911d-b9dc994b2437 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:01.122164 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c3931-6714-4dad-911d-b9dc994b2437 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:01.123529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 764/1506] 10.222.0.26 () {52 vars in 829 bytes} [Thu Jun 30 03:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:45:01.127252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144769d8-30b0-4014-8dba-9f420b0c6806 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:45:01.192344 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144769d8-30b0-4014-8dba-9f420b0c6806 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:45:01.197093 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:45:01.197973 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:01.198307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:01.198616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] PATH_INFO: `/v3/users/f584637c9a9f44038e4efa0dc54e1594` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:01.200034 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f584637c9a9f44038e4efa0dc54e1594)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:45:01.201072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: WARNING py.warnings [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:45:01.201072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: warnings.warn(msg) Jun 30 03:45:01.201072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: Jun 30 03:45:01.202284 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:45:01.278140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f584637c9a9f44038e4efa0dc54e1594'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:45:01.297650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f584637c9a9f44038e4efa0dc54e1594'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:45:01.327156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f584637c9a9f44038e4efa0dc54e1594'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:45:01.328449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f584637c9a9f44038e4efa0dc54e1594'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:45:01.333705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f584637c9a9f44038e4efa0dc54e1594'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:45:01.340121 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:45:01.356910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 743/1507] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:45:01 2022] DELETE /identity/v3/users/f584637c9a9f44038e4efa0dc54e1594 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:45:01.361472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d8318-2a3b-49f0-aea8-def2b9f71632 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:01.361867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d8318-2a3b-49f0-aea8-def2b9f71632 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:01.362142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d8318-2a3b-49f0-aea8-def2b9f71632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:01.380386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-472d8318-2a3b-49f0-aea8-def2b9f71632 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:45:01.381883 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-472d8318-2a3b-49f0-aea8-def2b9f71632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:45:01.445573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 765/1508] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:45:01.456585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:45:01.458293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:45:01.518268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7facb0-c763-4d5c-a209-4c0da5d39bcc admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:45:01.522312 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561681f-381c-482b-8077-4c642f65deba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:45:01.523032 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561681f-381c-482b-8077-4c642f65deba service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:01.523315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561681f-381c-482b-8077-4c642f65deba service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:01.523600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561681f-381c-482b-8077-4c642f65deba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:01.533204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561681f-381c-482b-8077-4c642f65deba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:45:01.534667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561681f-381c-482b-8077-4c642f65deba service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:45:01.544481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 744/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:45:02.000909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d8318-2a3b-49f0-aea8-def2b9f71632 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:45:02.002786 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-472d8318-2a3b-49f0-aea8-def2b9f71632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:45:02.015708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d8318-2a3b-49f0-aea8-def2b9f71632 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:45:02.020938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:45:02.021819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:45:02.022091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:45:02.022383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840 admin admin] PATH_INFO: `/v3/projects/385e5900d8d04bf684a16dc415d2513e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:45:02.023702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=385e5900d8d04bf684a16dc415d2513e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:45:02.024752 dv-cinder-846842-7-smb devstack@keystone.service[87040]: WARNING py.warnings [None req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:45:02.024752 dv-cinder-846842-7-smb devstack@keystone.service[87040]: warnings.warn(msg) Jun 30 03:45:02.024752 dv-cinder-846842-7-smb devstack@keystone.service[87040]: Jun 30 03:45:02.025992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:45:02.086686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385e5900d8d04bf684a16dc415d2513e', 'request_id': 'req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:45:02.101152 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385e5900d8d04bf684a16dc415d2513e', 'request_id': 'req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:45:02.115739 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385e5900d8d04bf684a16dc415d2513e', 'request_id': 'req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:45:02.128052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840 admin admin] The token cache is being invalidate because project 385e5900d8d04bf684a16dc415d2513e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:45:02.128334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:45:02.128997 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-85d8e3e4-a7bf-4463-b390-61fa4a8c3840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:45:02.130674 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 766/1510] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:45:01 2022] DELETE /identity/v3/projects/385e5900d8d04bf684a16dc415d2513e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:45:11.539991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:45:12.124760 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:46:46.393366 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55213f6a-14d8-4aa0-8311-e277385426fd None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:46:46.394017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55213f6a-14d8-4aa0-8311-e277385426fd None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:46:46.394017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55213f6a-14d8-4aa0-8311-e277385426fd None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:46:46.395387 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 03:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:46:46.403270 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69b12-c186-44b7-bb89-d9a81287c911 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:46:46.403722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69b12-c186-44b7-bb89-d9a81287c911 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:46:46.403847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69b12-c186-44b7-bb89-d9a81287c911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:46:46.426110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-5fa69b12-c186-44b7-bb89-d9a81287c911 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:46:46.427337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5fa69b12-c186-44b7-bb89-d9a81287c911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:46:46.492917 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 03:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:46:46.652476 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55213f6a-14d8-4aa0-8311-e277385426fd None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:46:46.655183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-55213f6a-14d8-4aa0-8311-e277385426fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:46:46.742756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55213f6a-14d8-4aa0-8311-e277385426fd None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:46:46.748871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4479b-f2e0-45cd-8fd0-961a4c5266f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:46:46.749503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4479b-f2e0-45cd-8fd0-961a4c5266f1 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:46:46.749787 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4479b-f2e0-45cd-8fd0-961a4c5266f1 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:46:46.750065 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4479b-f2e0-45cd-8fd0-961a4c5266f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:46:46.758867 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4479b-f2e0-45cd-8fd0-961a4c5266f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:46:46.760481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4479b-f2e0-45cd-8fd0-961a4c5266f1 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:46:46.770627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 746/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:46:47.618248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdfa51-6ee2-494a-85e8-98d6eb1c7a24 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:46:47.618824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdfa51-6ee2-494a-85e8-98d6eb1c7a24 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:46:47.618824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdfa51-6ee2-494a-85e8-98d6eb1c7a24 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:46:47.620952 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 768/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 03:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:46:47.625925 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cfb95-497e-4b6d-a818-c7dc951d4e9c None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:46:47.626376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cfb95-497e-4b6d-a818-c7dc951d4e9c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:46:47.626481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cfb95-497e-4b6d-a818-c7dc951d4e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:46:47.645063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-bf5cfb95-497e-4b6d-a818-c7dc951d4e9c None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:46:47.646263 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-bf5cfb95-497e-4b6d-a818-c7dc951d4e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:46:47.654752 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 747/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 03:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:46:47.806472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdfa51-6ee2-494a-85e8-98d6eb1c7a24 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:46:47.826798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdfa51-6ee2-494a-85e8-98d6eb1c7a24 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:46:47.833884 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01b6a3-cee6-4043-9922-da2d9c418846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:46:47.834468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01b6a3-cee6-4043-9922-da2d9c418846 service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:46:47.834751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01b6a3-cee6-4043-9922-da2d9c418846 service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:46:47.835055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01b6a3-cee6-4043-9922-da2d9c418846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:46:47.844141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01b6a3-cee6-4043-9922-da2d9c418846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:46:47.845779 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01b6a3-cee6-4043-9922-da2d9c418846 service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:46:47.856167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 769/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:46:48.608306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a902e8-54c5-4bae-9861-98eeada4211b None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:46:48.608557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a902e8-54c5-4bae-9861-98eeada4211b None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:46:48.608863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a902e8-54c5-4bae-9861-98eeada4211b None None] PATH_INFO: `/v3` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:46:48.610245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 748/1517] 10.222.0.43 () {54 vars in 925 bytes} [Thu Jun 30 03:46:48 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:46:48.616984 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e65af1-f8e1-48c9-a5f4-4c608035b8a7 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:46:48.617296 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e65af1-f8e1-48c9-a5f4-4c608035b8a7 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:46:48.617576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e65af1-f8e1-48c9-a5f4-4c608035b8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:46:48.638540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e5e65af1-f8e1-48c9-a5f4-4c608035b8a7 None None] MFA Rules not processed for user `13562e65139b44ab931fb8fdb41a61b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:46:48.639791 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e5e65af1-f8e1-48c9-a5f4-4c608035b8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:46:48.711345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 770/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Jun 30 03:46:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:46:52.518017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59fdd4-f1a5-4bae-b9fe-a13d3ea00ec7 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:46:52.518527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59fdd4-f1a5-4bae-b9fe-a13d3ea00ec7 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:46:52.518527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59fdd4-f1a5-4bae-b9fe-a13d3ea00ec7 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:46:52.521160 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 749/1519] 10.222.0.26 () {54 vars in 960 bytes} [Thu Jun 30 03:46:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:46:52.526538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fc148-3345-49bb-ac7b-dc6d5e6599df None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:46:52.527035 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fc148-3345-49bb-ac7b-dc6d5e6599df None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:46:52.527132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fc148-3345-49bb-ac7b-dc6d5e6599df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:46:52.547414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-4e7fc148-3345-49bb-ac7b-dc6d5e6599df None None] MFA Rules not processed for user `13562e65139b44ab931fb8fdb41a61b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:46:52.548600 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4e7fc148-3345-49bb-ac7b-dc6d5e6599df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:46:52.558820 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 771/1520] 10.222.0.26 () {58 vars in 1057 bytes} [Thu Jun 30 03:46:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:46:52.566603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59fdd4-f1a5-4bae-b9fe-a13d3ea00ec7 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:46:52.582306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59fdd4-f1a5-4bae-b9fe-a13d3ea00ec7 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:46:52.588282 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572677f-2dc3-4b0d-8986-95850829c9c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13562e65139b44ab931fb8fdb41a61b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:46:52.588898 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572677f-2dc3-4b0d-8986-95850829c9c2 service placement] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:46:52.589189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572677f-2dc3-4b0d-8986-95850829c9c2 service placement] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:46:52.589460 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572677f-2dc3-4b0d-8986-95850829c9c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:46:52.598332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572677f-2dc3-4b0d-8986-95850829c9c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:46:52.600000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572677f-2dc3-4b0d-8986-95850829c9c2 service placement] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:46:52.609834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 750/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:46:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:46:59.089008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72bf9-de2a-4024-8e93-a1243a9fb7e9 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:46:59.089554 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72bf9-de2a-4024-8e93-a1243a9fb7e9 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:46:59.089554 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72bf9-de2a-4024-8e93-a1243a9fb7e9 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:46:59.091768 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 03:46:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:46:59.100330 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39565731-8ee1-4c84-ba86-f4042b5a1b77 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:46:59.101069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39565731-8ee1-4c84-ba86-f4042b5a1b77 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:46:59.101202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39565731-8ee1-4c84-ba86-f4042b5a1b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:46:59.127282 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-39565731-8ee1-4c84-ba86-f4042b5a1b77 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:46:59.128498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-39565731-8ee1-4c84-ba86-f4042b5a1b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:46:59.138332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 03:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:46:59.305657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72bf9-de2a-4024-8e93-a1243a9fb7e9 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:46:59.330385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72bf9-de2a-4024-8e93-a1243a9fb7e9 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:46:59.337164 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de67b1-c329-403f-a9c5-faacfb2ba1e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:46:59.337845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de67b1-c329-403f-a9c5-faacfb2ba1e1 service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:46:59.338134 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de67b1-c329-403f-a9c5-faacfb2ba1e1 service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:46:59.338407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de67b1-c329-403f-a9c5-faacfb2ba1e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:46:59.347717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de67b1-c329-403f-a9c5-faacfb2ba1e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:46:59.349364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de67b1-c329-403f-a9c5-faacfb2ba1e1 service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:46:59.359842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 773/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:47:00.173418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fbe94-eb98-4ae6-b0b4-d50121a51079 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:00.174014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fbe94-eb98-4ae6-b0b4-d50121a51079 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:00.174014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fbe94-eb98-4ae6-b0b4-d50121a51079 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:00.175318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 03:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:47:00.181384 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416d452-7094-4301-9690-ab86c49ac137 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:00.182179 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416d452-7094-4301-9690-ab86c49ac137 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:00.182338 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416d452-7094-4301-9690-ab86c49ac137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:00.206184 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e416d452-7094-4301-9690-ab86c49ac137 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:47:00.207609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e416d452-7094-4301-9690-ab86c49ac137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:47:00.216140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 03:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:47:00.369589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fbe94-eb98-4ae6-b0b4-d50121a51079 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:47:00.387800 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fbe94-eb98-4ae6-b0b4-d50121a51079 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:47:00.394670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d14fd-d5f7-462a-995f-bda0cb13122b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:47:00.395346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d14fd-d5f7-462a-995f-bda0cb13122b service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:00.395624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d14fd-d5f7-462a-995f-bda0cb13122b service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:00.395897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d14fd-d5f7-462a-995f-bda0cb13122b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:00.404149 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d14fd-d5f7-462a-995f-bda0cb13122b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:47:00.405738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d14fd-d5f7-462a-995f-bda0cb13122b service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:47:00.415400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 753/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:47:04.225355 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c43c-4023-46b5-a61a-12b8b0b8a625 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:04.225924 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c43c-4023-46b5-a61a-12b8b0b8a625 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:04.225924 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c43c-4023-46b5-a61a-12b8b0b8a625 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:04.227234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 03:47:04.232926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3101bea-5e20-487c-9618-09ec93718363 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:04.233350 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3101bea-5e20-487c-9618-09ec93718363 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:04.233443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3101bea-5e20-487c-9618-09ec93718363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:04.252237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-d3101bea-5e20-487c-9618-09ec93718363 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:47:04.253432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d3101bea-5e20-487c-9618-09ec93718363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:47:04.261866 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:47:04.301753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90c43c-4023-46b5-a61a-12b8b0b8a625 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:47:04.304112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-dc90c43c-4023-46b5-a61a-12b8b0b8a625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:47:04.379595 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90c43c-4023-46b5-a61a-12b8b0b8a625 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:47:04.386566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef2af0-fd5e-4925-be6e-9afe33daf8d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:47:04.387463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2af0-fd5e-4925-be6e-9afe33daf8d7 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:04.387810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2af0-fd5e-4925-be6e-9afe33daf8d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:04.388172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2af0-fd5e-4925-be6e-9afe33daf8d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:04.403155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef2af0-fd5e-4925-be6e-9afe33daf8d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:47:04.405324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef2af0-fd5e-4925-be6e-9afe33daf8d7 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:47:04.413206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:47:04.420883 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 776/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:47:06.421614 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52421-7c5f-4e81-96f0-7a1f9f182e22 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:06.422489 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52421-7c5f-4e81-96f0-7a1f9f182e22 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:06.422489 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52421-7c5f-4e81-96f0-7a1f9f182e22 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:06.424784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:47:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:47:06.431211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddc69f-992c-423c-97a4-4146bb449f72 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:06.431668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddc69f-992c-423c-97a4-4146bb449f72 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:06.431782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddc69f-992c-423c-97a4-4146bb449f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:06.454226 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-a0ddc69f-992c-423c-97a4-4146bb449f72 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:47:06.455469 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a0ddc69f-992c-423c-97a4-4146bb449f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:47:06.464306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:47:06.506738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b52421-7c5f-4e81-96f0-7a1f9f182e22 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:47:06.510154 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-41b52421-7c5f-4e81-96f0-7a1f9f182e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:47:06.528600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b52421-7c5f-4e81-96f0-7a1f9f182e22 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:47:06.532760 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4814bd-1e0e-4e86-a605-19edd0766518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:47:06.533421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4814bd-1e0e-4e86-a605-19edd0766518 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:06.533681 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4814bd-1e0e-4e86-a605-19edd0766518 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:06.533947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4814bd-1e0e-4e86-a605-19edd0766518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:06.543709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4814bd-1e0e-4e86-a605-19edd0766518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:47:06.545153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4814bd-1e0e-4e86-a605-19edd0766518 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:47:06.555016 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 756/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:47:10.063886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a12b4-0a9b-4f07-be04-9f8bea45947c None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:10.064478 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a12b4-0a9b-4f07-be04-9f8bea45947c None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:10.064478 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a12b4-0a9b-4f07-be04-9f8bea45947c None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:10.065859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:47:10.072579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65251e72-4240-487d-8506-f6d2306ee297 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:10.073066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65251e72-4240-487d-8506-f6d2306ee297 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:10.073388 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65251e72-4240-487d-8506-f6d2306ee297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:10.102077 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-65251e72-4240-487d-8506-f6d2306ee297 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:47:10.103823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-65251e72-4240-487d-8506-f6d2306ee297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:47:10.114229 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:47:10.434648 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a12b4-0a9b-4f07-be04-9f8bea45947c None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:47:10.437175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-bd5a12b4-0a9b-4f07-be04-9f8bea45947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:47:10.518199 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a12b4-0a9b-4f07-be04-9f8bea45947c None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:47:10.522813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cf36e-b04a-449e-9ed1-6a4679da886c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:47:10.523497 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cf36e-b04a-449e-9ed1-6a4679da886c service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:10.523782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cf36e-b04a-449e-9ed1-6a4679da886c service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:10.524056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cf36e-b04a-449e-9ed1-6a4679da886c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:10.533615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cf36e-b04a-449e-9ed1-6a4679da886c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:47:10.535285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cf36e-b04a-449e-9ed1-6a4679da886c service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:47:10.544697 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 779/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:47:12.664399 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231fd4c-c97c-4bf9-9b6f-04d514551fba None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:12.664399 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231fd4c-c97c-4bf9-9b6f-04d514551fba None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:12.664831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231fd4c-c97c-4bf9-9b6f-04d514551fba None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:12.666030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 03:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:47:12.674425 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65468426-5b4d-4c1f-8e6c-3c013990a3ce None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:12.675386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65468426-5b4d-4c1f-8e6c-3c013990a3ce None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:12.675534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65468426-5b4d-4c1f-8e6c-3c013990a3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:12.694655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-65468426-5b4d-4c1f-8e6c-3c013990a3ce None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:47:12.696174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-65468426-5b4d-4c1f-8e6c-3c013990a3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:47:12.704824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 03:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:47:13.016592 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231fd4c-c97c-4bf9-9b6f-04d514551fba None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:47:13.018904 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-5231fd4c-c97c-4bf9-9b6f-04d514551fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:47:13.027437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=65 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:47:13.036822 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231fd4c-c97c-4bf9-9b6f-04d514551fba None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:47:13.040890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd5ee2-24dd-470b-9077-1f2aba4c62f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:47:13.041539 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd5ee2-24dd-470b-9077-1f2aba4c62f2 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:47:13.041823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd5ee2-24dd-470b-9077-1f2aba4c62f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:47:13.042092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd5ee2-24dd-470b-9077-1f2aba4c62f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:47:13.051358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd5ee2-24dd-470b-9077-1f2aba4c62f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:47:13.052808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd5ee2-24dd-470b-9077-1f2aba4c62f2 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:47:13.062398 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 759/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:47:22.689201 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=32 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:47:23.058302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:44.055711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c906f-eba7-407a-be92-6e38f3823755 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.056512 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c906f-eba7-407a-be92-6e38f3823755 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.056512 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c906f-eba7-407a-be92-6e38f3823755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.082231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-116c906f-eba7-407a-be92-6e38f3823755 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:44.083520 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-116c906f-eba7-407a-be92-6e38f3823755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:44.095702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 781/1540] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:44.104665 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3adb3a-5545-4172-b6bb-40f40ed9e2b7 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.105251 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3adb3a-5545-4172-b6bb-40f40ed9e2b7 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.105251 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3adb3a-5545-4172-b6bb-40f40ed9e2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.127806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-df3adb3a-5545-4172-b6bb-40f40ed9e2b7 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:44.129313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-df3adb3a-5545-4172-b6bb-40f40ed9e2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:44.144480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 760/1541] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:44.149671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c906f-eba7-407a-be92-6e38f3823755 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:44.162413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c906f-eba7-407a-be92-6e38f3823755 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:44.168763 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f030997-6fc9-4131-b0b0-cce52fecd447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:44.169565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f030997-6fc9-4131-b0b0-cce52fecd447 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.169852 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f030997-6fc9-4131-b0b0-cce52fecd447 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.170163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f030997-6fc9-4131-b0b0-cce52fecd447 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.171021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f030997-6fc9-4131-b0b0-cce52fecd447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:48:44.171335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f030997-6fc9-4131-b0b0-cce52fecd447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:44.172968 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f030997-6fc9-4131-b0b0-cce52fecd447 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:44.191791 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 782/1542] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:48:44.201592 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3adb3a-5545-4172-b6bb-40f40ed9e2b7 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:44.215780 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3adb3a-5545-4172-b6bb-40f40ed9e2b7 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:44.224253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd20c3f-eae8-4f94-b6e6-51f9447e3693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:44.224951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd20c3f-eae8-4f94-b6e6-51f9447e3693 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.225232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd20c3f-eae8-4f94-b6e6-51f9447e3693 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.225507 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd20c3f-eae8-4f94-b6e6-51f9447e3693 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.226225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd20c3f-eae8-4f94-b6e6-51f9447e3693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:44.228172 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd20c3f-eae8-4f94-b6e6-51f9447e3693 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:44.273564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 761/1543] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:48:44 2022] POST /identity/v3/projects => generated 403 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:44.279214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f030997-6fc9-4131-b0b0-cce52fecd447 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:44.292132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f030997-6fc9-4131-b0b0-cce52fecd447 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:44.368168 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d77ed9-bb74-4935-ba37-c7434dab2c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:44.368913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d77ed9-bb74-4935-ba37-c7434dab2c84 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.369197 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d77ed9-bb74-4935-ba37-c7434dab2c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.369473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d77ed9-bb74-4935-ba37-c7434dab2c84 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.370198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d77ed9-bb74-4935-ba37-c7434dab2c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:44.372273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d77ed9-bb74-4935-ba37-c7434dab2c84 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:44.407002 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 783/1544] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:48:44 2022] POST /identity/v3/users => generated 302 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:44.411658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd20c3f-eae8-4f94-b6e6-51f9447e3693 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:44.427008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd20c3f-eae8-4f94-b6e6-51f9447e3693 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:44.437114 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968a029-2d99-4053-88a0-d845b98da055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:44.437807 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968a029-2d99-4053-88a0-d845b98da055 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.438301 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968a029-2d99-4053-88a0-d845b98da055 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.438590 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968a029-2d99-4053-88a0-d845b98da055 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.439364 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968a029-2d99-4053-88a0-d845b98da055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:44.440994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968a029-2d99-4053-88a0-d845b98da055 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:44.461191 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 762/1545] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:44.466321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d77ed9-bb74-4935-ba37-c7434dab2c84 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:44.477024 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d77ed9-bb74-4935-ba37-c7434dab2c84 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:44.487167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855440c-f219-4d60-b9f9-adbc86c94e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:44.487879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855440c-f219-4d60-b9f9-adbc86c94e86 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.488163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855440c-f219-4d60-b9f9-adbc86c94e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.488440 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855440c-f219-4d60-b9f9-adbc86c94e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.489186 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855440c-f219-4d60-b9f9-adbc86c94e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:44.490862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855440c-f219-4d60-b9f9-adbc86c94e86 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:44.508064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 784/1546] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:44.513226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968a029-2d99-4053-88a0-d845b98da055 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:44.529234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968a029-2d99-4053-88a0-d845b98da055 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:44.537050 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a5268-7226-4750-a3b2-06131e2b4556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:44.537986 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a5268-7226-4750-a3b2-06131e2b4556 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.538267 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a5268-7226-4750-a3b2-06131e2b4556 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.538542 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a5268-7226-4750-a3b2-06131e2b4556 admin admin] PATH_INFO: `/v3/projects/14a8d115c00447a3974ec9c32ad866d9/users/82724a300bde4708a41c04ace13167c4/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.547056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cb214-797f-4f3a-ac2c-b8459f768b4e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.547467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cb214-797f-4f3a-ac2c-b8459f768b4e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.547762 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cb214-797f-4f3a-ac2c-b8459f768b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.561155 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a5268-7226-4750-a3b2-06131e2b4556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a8d115c00447a3974ec9c32ad866d9, user_id=82724a300bde4708a41c04ace13167c4, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:44.564178 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a5268-7226-4750-a3b2-06131e2b4556 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:44.582636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-617cb214-797f-4f3a-ac2c-b8459f768b4e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:44.583899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-617cb214-797f-4f3a-ac2c-b8459f768b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:44.599356 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 763/1547] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:44 2022] PUT /identity/v3/projects/14a8d115c00447a3974ec9c32ad866d9/users/82724a300bde4708a41c04ace13167c4/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:44.604924 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413e0f-5f55-44f8-b3f9-ddfaa1c2d3be None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.605212 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413e0f-5f55-44f8-b3f9-ddfaa1c2d3be None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.605493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413e0f-5f55-44f8-b3f9-ddfaa1c2d3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.630364 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-1e413e0f-5f55-44f8-b3f9-ddfaa1c2d3be None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:44.631599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-1e413e0f-5f55-44f8-b3f9-ddfaa1c2d3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:44.682960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 785/1548] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:48:44.684346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0edc6-4ccd-4b2b-aad4-e0fd53d2f973 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.684639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0edc6-4ccd-4b2b-aad4-e0fd53d2f973 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.684922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0edc6-4ccd-4b2b-aad4-e0fd53d2f973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.720619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-a8a0edc6-4ccd-4b2b-aad4-e0fd53d2f973 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:44.722430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a8a0edc6-4ccd-4b2b-aad4-e0fd53d2f973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:44.751331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 786/1549] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:44.752809 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d785-f3d1-40e0-a4ee-65db66c7808c None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.754061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d785-f3d1-40e0-a4ee-65db66c7808c None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.754359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d785-f3d1-40e0-a4ee-65db66c7808c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.771671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 764/1550] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:48:44.774461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642bf58-6c84-4c7c-93b8-daa9769b50b7 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.774741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642bf58-6c84-4c7c-93b8-daa9769b50b7 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.775055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642bf58-6c84-4c7c-93b8-daa9769b50b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.809424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-72d9d785-f3d1-40e0-a4ee-65db66c7808c None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:44.810662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-72d9d785-f3d1-40e0-a4ee-65db66c7808c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:44.828051 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6642bf58-6c84-4c7c-93b8-daa9769b50b7 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:44.831432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6642bf58-6c84-4c7c-93b8-daa9769b50b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:44.841990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 787/1551] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:44.843106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d785-f3d1-40e0-a4ee-65db66c7808c None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:44.860818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 765/1552] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:44.862181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4131886-69e7-4222-93d5-b651f0bced00 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.862471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4131886-69e7-4222-93d5-b651f0bced00 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.862749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4131886-69e7-4222-93d5-b651f0bced00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.894134 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e4131886-69e7-4222-93d5-b651f0bced00 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:44.895742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e4131886-69e7-4222-93d5-b651f0bced00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:44.905654 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 766/1553] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:44.906814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4131886-69e7-4222-93d5-b651f0bced00 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:44.918617 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:44.926146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4131886-69e7-4222-93d5-b651f0bced00 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:44.927819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d785-f3d1-40e0-a4ee-65db66c7808c None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:44.933978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba971296-6b44-44b4-a36e-bc6ccc1a9a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:44.934646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba971296-6b44-44b4-a36e-bc6ccc1a9a96 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.935141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba971296-6b44-44b4-a36e-bc6ccc1a9a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.935267 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba971296-6b44-44b4-a36e-bc6ccc1a9a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.936861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6e98a-916d-4532-9752-d23758a11b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:44.937612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e98a-916d-4532-9752-d23758a11b7d admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.937890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e98a-916d-4532-9752-d23758a11b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.938161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e98a-916d-4532-9752-d23758a11b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.938964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6e98a-916d-4532-9752-d23758a11b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:48:44.939272 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6e98a-916d-4532-9752-d23758a11b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:44.940318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: WARNING py.warnings [None req-bbb6e98a-916d-4532-9752-d23758a11b7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:48:44.940318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: warnings.warn(msg) Jun 30 03:48:44.940318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: Jun 30 03:48:44.941326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6e98a-916d-4532-9752-d23758a11b7d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:44.951110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba971296-6b44-44b4-a36e-bc6ccc1a9a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:44.953016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba971296-6b44-44b4-a36e-bc6ccc1a9a96 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:44.955870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 767/1554] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:48:44.957243 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78dc7-9bf9-4ab1-89e0-cc0c9e854733 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.957535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78dc7-9bf9-4ab1-89e0-cc0c9e854733 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.957815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78dc7-9bf9-4ab1-89e0-cc0c9e854733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.970103 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 788/1555] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:44.971000 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba971296-6b44-44b4-a36e-bc6ccc1a9a96 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:44.980101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-7fa78dc7-9bf9-4ab1-89e0-cc0c9e854733 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:44.981398 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7fa78dc7-9bf9-4ab1-89e0-cc0c9e854733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:44.982035 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba971296-6b44-44b4-a36e-bc6ccc1a9a96 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:44.988569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517a020-047b-4f33-90fe-f17f026cda67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:44.989580 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517a020-047b-4f33-90fe-f17f026cda67 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:44.989879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517a020-047b-4f33-90fe-f17f026cda67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:44.990142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517a020-047b-4f33-90fe-f17f026cda67 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:44.991018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 768/1556] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:44.991150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517a020-047b-4f33-90fe-f17f026cda67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:48:44.991442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517a020-047b-4f33-90fe-f17f026cda67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:44.994159 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517a020-047b-4f33-90fe-f17f026cda67 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.000192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0f5d6-4ee8-4c35-b8b2-39b74daa29eb None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.000519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0f5d6-4ee8-4c35-b8b2-39b74daa29eb None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.000890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0f5d6-4ee8-4c35-b8b2-39b74daa29eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.014832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 789/1557] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:48:45.014832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4d383-27f3-4e2f-821c-c54da20a6ab5 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.014832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4d383-27f3-4e2f-821c-c54da20a6ab5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.014832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4d383-27f3-4e2f-821c-c54da20a6ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.020556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-4ad0f5d6-4ee8-4c35-b8b2-39b74daa29eb None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:45.021927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-4ad0f5d6-4ee8-4c35-b8b2-39b74daa29eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:45.030613 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 769/1558] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:45.040673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400032ea-b698-488e-84ff-eb7241ca8688 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.040673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400032ea-b698-488e-84ff-eb7241ca8688 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.040673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400032ea-b698-488e-84ff-eb7241ca8688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.049532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-fee4d383-27f3-4e2f-821c-c54da20a6ab5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:45.050882 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-fee4d383-27f3-4e2f-821c-c54da20a6ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:45.060125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 790/1559] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:45.064987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-400032ea-b698-488e-84ff-eb7241ca8688 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:45.066195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-400032ea-b698-488e-84ff-eb7241ca8688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:45.066330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4d383-27f3-4e2f-821c-c54da20a6ab5 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.074753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 770/1560] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:45.075940 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900281c-83a0-4b82-b9ce-c7b4c4a26779 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.076227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900281c-83a0-4b82-b9ce-c7b4c4a26779 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.076607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900281c-83a0-4b82-b9ce-c7b4c4a26779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.080623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4d383-27f3-4e2f-821c-c54da20a6ab5 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.086466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505769bf-9759-4c9d-82cd-35e083e5ea7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.087525 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505769bf-9759-4c9d-82cd-35e083e5ea7e admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.088007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505769bf-9759-4c9d-82cd-35e083e5ea7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.088584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505769bf-9759-4c9d-82cd-35e083e5ea7e admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.090009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505769bf-9759-4c9d-82cd-35e083e5ea7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.091559 dv-cinder-846842-7-smb devstack@keystone.service[87040]: WARNING py.warnings [None req-505769bf-9759-4c9d-82cd-35e083e5ea7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:48:45.091559 dv-cinder-846842-7-smb devstack@keystone.service[87040]: warnings.warn(msg) Jun 30 03:48:45.091559 dv-cinder-846842-7-smb devstack@keystone.service[87040]: Jun 30 03:48:45.093557 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505769bf-9759-4c9d-82cd-35e083e5ea7e admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.096009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-3900281c-83a0-4b82-b9ce-c7b4c4a26779 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:45.097209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3900281c-83a0-4b82-b9ce-c7b4c4a26779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:45.105801 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 771/1561] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:45.106532 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900281c-83a0-4b82-b9ce-c7b4c4a26779 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.119830 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900281c-83a0-4b82-b9ce-c7b4c4a26779 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.124776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e6be3-917e-47cb-a99c-8c8a60d994bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.125489 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e6be3-917e-47cb-a99c-8c8a60d994bb admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.125917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e6be3-917e-47cb-a99c-8c8a60d994bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.126077 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e6be3-917e-47cb-a99c-8c8a60d994bb admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.126941 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e6be3-917e-47cb-a99c-8c8a60d994bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.128960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e6be3-917e-47cb-a99c-8c8a60d994bb admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.131980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 791/1562] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:45.133604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf98300-2084-4716-824d-fdac10290c40 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.133956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf98300-2084-4716-824d-fdac10290c40 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.134296 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf98300-2084-4716-824d-fdac10290c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.156808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-acf98300-2084-4716-824d-fdac10290c40 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:45.158876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-acf98300-2084-4716-824d-fdac10290c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:45.164997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 772/1563] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:45.164997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc66e9-8de9-421e-8a09-db29e46a6bb4 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.164997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc66e9-8de9-421e-8a09-db29e46a6bb4 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.164997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc66e9-8de9-421e-8a09-db29e46a6bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.183469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-cebc66e9-8de9-421e-8a09-db29e46a6bb4 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:45.184727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cebc66e9-8de9-421e-8a09-db29e46a6bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:45.206970 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:45.236926 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 792/1564] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:45.238082 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be23b1-deb5-4b87-b760-eb7b79ff1b1a None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.238374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be23b1-deb5-4b87-b760-eb7b79ff1b1a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.238681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be23b1-deb5-4b87-b760-eb7b79ff1b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.266649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 773/1565] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:45.274158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-80be23b1-deb5-4b87-b760-eb7b79ff1b1a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:45.274158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-80be23b1-deb5-4b87-b760-eb7b79ff1b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:45.275566 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc66e9-8de9-421e-8a09-db29e46a6bb4 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.280140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 793/1566] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:45.281227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be23b1-deb5-4b87-b760-eb7b79ff1b1a None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.289412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc66e9-8de9-421e-8a09-db29e46a6bb4 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.293816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be23b1-deb5-4b87-b760-eb7b79ff1b1a None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.295092 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b4394-f462-4b47-92f3-2c2851c7bd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.295917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b4394-f462-4b47-92f3-2c2851c7bd93 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.296209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b4394-f462-4b47-92f3-2c2851c7bd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.296786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b4394-f462-4b47-92f3-2c2851c7bd93 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.297585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b4394-f462-4b47-92f3-2c2851c7bd93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:48:45.297921 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b4394-f462-4b47-92f3-2c2851c7bd93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.299838 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b4394-f462-4b47-92f3-2c2851c7bd93 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.301336 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72aa33e-85ef-4bdb-a9a2-c68094d9e49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.302022 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72aa33e-85ef-4bdb-a9a2-c68094d9e49f admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.302304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72aa33e-85ef-4bdb-a9a2-c68094d9e49f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.302583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72aa33e-85ef-4bdb-a9a2-c68094d9e49f admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.303349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72aa33e-85ef-4bdb-a9a2-c68094d9e49f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:48:45.303982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72aa33e-85ef-4bdb-a9a2-c68094d9e49f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.305841 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72aa33e-85ef-4bdb-a9a2-c68094d9e49f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.315676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 774/1567] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:48:45.317832 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b4394-f462-4b47-92f3-2c2851c7bd93 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.319457 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 794/1568] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:48:45.321131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72aa33e-85ef-4bdb-a9a2-c68094d9e49f admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.331888 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72aa33e-85ef-4bdb-a9a2-c68094d9e49f admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.332214 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b4394-f462-4b47-92f3-2c2851c7bd93 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.336938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfcae9-80ac-4a36-a6d6-24b136c152e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.337334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bd0e6-f833-4e99-b9a9-886a6c95a1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.337641 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfcae9-80ac-4a36-a6d6-24b136c152e1 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.337893 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfcae9-80ac-4a36-a6d6-24b136c152e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.338171 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfcae9-80ac-4a36-a6d6-24b136c152e1 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.338368 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bd0e6-f833-4e99-b9a9-886a6c95a1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.338735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bd0e6-f833-4e99-b9a9-886a6c95a1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.339273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfcae9-80ac-4a36-a6d6-24b136c152e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.339570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bd0e6-f833-4e99-b9a9-886a6c95a1f8 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.340347 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87bd0e6-f833-4e99-b9a9-886a6c95a1f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.341199 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfcae9-80ac-4a36-a6d6-24b136c152e1 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.341542 dv-cinder-846842-7-smb devstack@keystone.service[87039]: WARNING py.warnings [None req-c87bd0e6-f833-4e99-b9a9-886a6c95a1f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:48:45.341542 dv-cinder-846842-7-smb devstack@keystone.service[87039]: warnings.warn(msg) Jun 30 03:48:45.341542 dv-cinder-846842-7-smb devstack@keystone.service[87039]: Jun 30 03:48:45.343027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87bd0e6-f833-4e99-b9a9-886a6c95a1f8 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.365305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 795/1569] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:45.371835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 775/1570] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/users => generated 290 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:45.372008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfcae9-80ac-4a36-a6d6-24b136c152e1 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.372119 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e06ba-b11d-4510-b816-cf62c2d6001f None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.372119 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e06ba-b11d-4510-b816-cf62c2d6001f None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.372119 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e06ba-b11d-4510-b816-cf62c2d6001f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.382755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfcae9-80ac-4a36-a6d6-24b136c152e1 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.389595 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f782e-3f27-48ba-8e7b-c3468624053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.390368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f782e-3f27-48ba-8e7b-c3468624053b admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.390647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f782e-3f27-48ba-8e7b-c3468624053b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.390978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f782e-3f27-48ba-8e7b-c3468624053b admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.391773 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f782e-3f27-48ba-8e7b-c3468624053b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:48:45.392088 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f782e-3f27-48ba-8e7b-c3468624053b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.393744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f782e-3f27-48ba-8e7b-c3468624053b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.394405 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-c31e06ba-b11d-4510-b816-cf62c2d6001f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:45.396616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-c31e06ba-b11d-4510-b816-cf62c2d6001f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:45.406285 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 776/1571] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:45.410269 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e06ba-b11d-4510-b816-cf62c2d6001f None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.410397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 796/1572] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:48:45.410397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f782e-3f27-48ba-8e7b-c3468624053b admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.420602 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e06ba-b11d-4510-b816-cf62c2d6001f None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.423225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f782e-3f27-48ba-8e7b-c3468624053b admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.425119 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37911495-80c4-470d-99fe-4b447bf712a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.426391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37911495-80c4-470d-99fe-4b447bf712a3 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.426675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37911495-80c4-470d-99fe-4b447bf712a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.426978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37911495-80c4-470d-99fe-4b447bf712a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.427717 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37911495-80c4-470d-99fe-4b447bf712a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:48:45.428024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37911495-80c4-470d-99fe-4b447bf712a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.428527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0533fd-dbdd-4156-afa5-b79bd1eaf41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.429168 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0533fd-dbdd-4156-afa5-b79bd1eaf41d admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.429452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0533fd-dbdd-4156-afa5-b79bd1eaf41d admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.429640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37911495-80c4-470d-99fe-4b447bf712a3 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.429751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0533fd-dbdd-4156-afa5-b79bd1eaf41d admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.430415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0533fd-dbdd-4156-afa5-b79bd1eaf41d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.432488 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0533fd-dbdd-4156-afa5-b79bd1eaf41d admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.442369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 777/1573] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:48:45.443590 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37911495-80c4-470d-99fe-4b447bf712a3 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.459662 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37911495-80c4-470d-99fe-4b447bf712a3 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.474228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 797/1574] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:45.475097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0533fd-dbdd-4156-afa5-b79bd1eaf41d admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.485185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108c216-827c-4b37-8b5b-3d319da018ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.485877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108c216-827c-4b37-8b5b-3d319da018ec admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.486233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108c216-827c-4b37-8b5b-3d319da018ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.486440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108c216-827c-4b37-8b5b-3d319da018ec admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.487351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108c216-827c-4b37-8b5b-3d319da018ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.489635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108c216-827c-4b37-8b5b-3d319da018ec admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.527789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:45.535029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 778/1575] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:45.536818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108c216-827c-4b37-8b5b-3d319da018ec admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.561167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0533fd-dbdd-4156-afa5-b79bd1eaf41d admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.617807 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108c216-827c-4b37-8b5b-3d319da018ec admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.623030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ce4e4-e2f5-4cb8-aec9-63273feee56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.623871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ce4e4-e2f5-4cb8-aec9-63273feee56b admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.624160 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ce4e4-e2f5-4cb8-aec9-63273feee56b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.624443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ce4e4-e2f5-4cb8-aec9-63273feee56b admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.625189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ce4e4-e2f5-4cb8-aec9-63273feee56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.626894 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ce4e4-e2f5-4cb8-aec9-63273feee56b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.628340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cada0-8a5f-40ab-99e0-31758bdb7e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.628989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cada0-8a5f-40ab-99e0-31758bdb7e29 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.629274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cada0-8a5f-40ab-99e0-31758bdb7e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.629635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cada0-8a5f-40ab-99e0-31758bdb7e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.630758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cada0-8a5f-40ab-99e0-31758bdb7e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.632437 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cada0-8a5f-40ab-99e0-31758bdb7e29 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.638985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 779/1576] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:45.644762 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 798/1577] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:45.644946 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ce4e4-e2f5-4cb8-aec9-63273feee56b admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.645835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cada0-8a5f-40ab-99e0-31758bdb7e29 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.656952 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ce4e4-e2f5-4cb8-aec9-63273feee56b admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.661609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cada0-8a5f-40ab-99e0-31758bdb7e29 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.661936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b280ea5-8de3-4ef3-86b3-c0d2dfff5aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.662683 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280ea5-8de3-4ef3-86b3-c0d2dfff5aaa admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.663112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280ea5-8de3-4ef3-86b3-c0d2dfff5aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.663483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280ea5-8de3-4ef3-86b3-c0d2dfff5aaa admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.664303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b280ea5-8de3-4ef3-86b3-c0d2dfff5aaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:48:45.664688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b280ea5-8de3-4ef3-86b3-c0d2dfff5aaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.666506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b280ea5-8de3-4ef3-86b3-c0d2dfff5aaa admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.667051 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7d756-ff8e-452d-a492-445f6bb4d705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.667979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d756-ff8e-452d-a492-445f6bb4d705 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.668115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d756-ff8e-452d-a492-445f6bb4d705 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.668574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d756-ff8e-452d-a492-445f6bb4d705 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.669344 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7d756-ff8e-452d-a492-445f6bb4d705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.671646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7d756-ff8e-452d-a492-445f6bb4d705 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.687353 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 780/1578] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:48:45.687353 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b280ea5-8de3-4ef3-86b3-c0d2dfff5aaa admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.699736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b280ea5-8de3-4ef3-86b3-c0d2dfff5aaa admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.704724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f2780-a2cb-46b3-b7ad-64326eb43325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.705393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f2780-a2cb-46b3-b7ad-64326eb43325 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.705673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f2780-a2cb-46b3-b7ad-64326eb43325 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.705952 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f2780-a2cb-46b3-b7ad-64326eb43325 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.706519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 799/1579] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/projects => generated 407 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:45.707570 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7d756-ff8e-452d-a492-445f6bb4d705 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.709772 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f2780-a2cb-46b3-b7ad-64326eb43325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.711885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f2780-a2cb-46b3-b7ad-64326eb43325 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.745615 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 781/1580] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:45.746491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f2780-a2cb-46b3-b7ad-64326eb43325 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.762128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:45.778389 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7d756-ff8e-452d-a492-445f6bb4d705 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.825830 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f2780-a2cb-46b3-b7ad-64326eb43325 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.831558 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352642a9-9764-4206-bdc5-28398cebcac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.832647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352642a9-9764-4206-bdc5-28398cebcac2 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.832933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352642a9-9764-4206-bdc5-28398cebcac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.833192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352642a9-9764-4206-bdc5-28398cebcac2 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.834216 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352642a9-9764-4206-bdc5-28398cebcac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.836648 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352642a9-9764-4206-bdc5-28398cebcac2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.860431 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1cbcd-8545-43f8-979a-b0f0ae20b644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.861320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1cbcd-8545-43f8-979a-b0f0ae20b644 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.861866 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1cbcd-8545-43f8-979a-b0f0ae20b644 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.862299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1cbcd-8545-43f8-979a-b0f0ae20b644 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.863234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1cbcd-8545-43f8-979a-b0f0ae20b644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.865415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1cbcd-8545-43f8-979a-b0f0ae20b644 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.868731 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 782/1581] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:45.868731 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352642a9-9764-4206-bdc5-28398cebcac2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.875346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:45.884975 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352642a9-9764-4206-bdc5-28398cebcac2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.889943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed33b9-f2c0-46d1-beeb-6bf96ae8e9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.890659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed33b9-f2c0-46d1-beeb-6bf96ae8e9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.890981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed33b9-f2c0-46d1-beeb-6bf96ae8e9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.891522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed33b9-f2c0-46d1-beeb-6bf96ae8e9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.892559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed33b9-f2c0-46d1-beeb-6bf96ae8e9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.893816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 800/1582] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:45.894194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed33b9-f2c0-46d1-beeb-6bf96ae8e9c3 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.894853 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1cbcd-8545-43f8-979a-b0f0ae20b644 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.906844 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1cbcd-8545-43f8-979a-b0f0ae20b644 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.908790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 783/1583] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:45.909541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed33b9-f2c0-46d1-beeb-6bf96ae8e9c3 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.912523 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c1cef-1552-4594-8210-7e7e9fe62c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.913318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c1cef-1552-4594-8210-7e7e9fe62c32 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.913679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c1cef-1552-4594-8210-7e7e9fe62c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.914058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c1cef-1552-4594-8210-7e7e9fe62c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.915035 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c1cef-1552-4594-8210-7e7e9fe62c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.916943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c1cef-1552-4594-8210-7e7e9fe62c32 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.921258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed33b9-f2c0-46d1-beeb-6bf96ae8e9c3 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.926373 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8d224-16a0-4c7b-a10c-a73d265c4804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.927138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8d224-16a0-4c7b-a10c-a73d265c4804 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.927479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8d224-16a0-4c7b-a10c-a73d265c4804 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.927815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8d224-16a0-4c7b-a10c-a73d265c4804 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.928573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8d224-16a0-4c7b-a10c-a73d265c4804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.932762 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 801/1584] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:45.932898 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8d224-16a0-4c7b-a10c-a73d265c4804 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.932994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c1cef-1552-4594-8210-7e7e9fe62c32 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.944747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c1cef-1552-4594-8210-7e7e9fe62c32 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:45.949859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395a7d8-67b6-495e-ae5c-a44d4a8aca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:45.951069 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395a7d8-67b6-495e-ae5c-a44d4a8aca02 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.951521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395a7d8-67b6-495e-ae5c-a44d4a8aca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.951791 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395a7d8-67b6-495e-ae5c-a44d4a8aca02 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:45.952592 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395a7d8-67b6-495e-ae5c-a44d4a8aca02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:45.954880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395a7d8-67b6-495e-ae5c-a44d4a8aca02 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:45.966060 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 784/1585] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:45.967490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8d224-16a0-4c7b-a10c-a73d265c4804 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:45.985082 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 802/1586] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/users => generated 304 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:45.986970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26caa3-e27b-4310-bb71-9e2e94e98964 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:45.987499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26caa3-e27b-4310-bb71-9e2e94e98964 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:45.987867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26caa3-e27b-4310-bb71-9e2e94e98964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.017304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-5d26caa3-e27b-4310-bb71-9e2e94e98964 None None] MFA Rules not processed for user `82724a300bde4708a41c04ace13167c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:46.018910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5d26caa3-e27b-4310-bb71-9e2e94e98964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:46.035406 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8d224-16a0-4c7b-a10c-a73d265c4804 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.040363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd19402-7b33-430f-a9bd-832cf5525924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.041149 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd19402-7b33-430f-a9bd-832cf5525924 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.041431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd19402-7b33-430f-a9bd-832cf5525924 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.041710 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd19402-7b33-430f-a9bd-832cf5525924 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.042410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd19402-7b33-430f-a9bd-832cf5525924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.044395 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd19402-7b33-430f-a9bd-832cf5525924 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.067565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 785/1587] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:46.068461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd19402-7b33-430f-a9bd-832cf5525924 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.079653 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd19402-7b33-430f-a9bd-832cf5525924 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.084494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf53e72-bba6-45d6-b29f-f5b4dcf44464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.085151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf53e72-bba6-45d6-b29f-f5b4dcf44464 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.085432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf53e72-bba6-45d6-b29f-f5b4dcf44464 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.085711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf53e72-bba6-45d6-b29f-f5b4dcf44464 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.086439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf53e72-bba6-45d6-b29f-f5b4dcf44464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.088087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf53e72-bba6-45d6-b29f-f5b4dcf44464 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.091432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 803/1588] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:46.095610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26caa3-e27b-4310-bb71-9e2e94e98964 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.103685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 786/1589] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:46.103685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf53e72-bba6-45d6-b29f-f5b4dcf44464 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.105021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26caa3-e27b-4310-bb71-9e2e94e98964 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.109662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbf61f-e431-4648-8f45-83473615034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.110328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbf61f-e431-4648-8f45-83473615034b admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.110612 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbf61f-e431-4648-8f45-83473615034b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.110922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbf61f-e431-4648-8f45-83473615034b admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.111533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf53e72-bba6-45d6-b29f-f5b4dcf44464 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.111952 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbf61f-e431-4648-8f45-83473615034b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.113276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbf61f-e431-4648-8f45-83473615034b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.116147 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414c3ad-08fc-45a4-b551-91e151f62025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.117018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414c3ad-08fc-45a4-b551-91e151f62025 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.117297 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414c3ad-08fc-45a4-b551-91e151f62025 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.117565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414c3ad-08fc-45a4-b551-91e151f62025 admin admin] PATH_INFO: `/v3/projects/659789a2da584fbda97cb9de335946b7/users/825dd3922747496b88f0718b069abc1f/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.126368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 804/1590] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:46.126368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbf61f-e431-4648-8f45-83473615034b admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.132826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414c3ad-08fc-45a4-b551-91e151f62025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=659789a2da584fbda97cb9de335946b7, user_id=825dd3922747496b88f0718b069abc1f, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.135555 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbf61f-e431-4648-8f45-83473615034b admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.135701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414c3ad-08fc-45a4-b551-91e151f62025 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.140299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01aa6ee-3621-45cd-972b-1e3143cba068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.141187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aa6ee-3621-45cd-972b-1e3143cba068 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.141468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aa6ee-3621-45cd-972b-1e3143cba068 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.141748 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aa6ee-3621-45cd-972b-1e3143cba068 admin admin] PATH_INFO: `/v3/projects/2320bbb4a49349c79a2c2e9aade43d51/users/2b7d3af2c65145769b47d8e7accd0aa2/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.150118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 787/1591] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:46 2022] PUT /identity/v3/projects/659789a2da584fbda97cb9de335946b7/users/825dd3922747496b88f0718b069abc1f/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:46.154647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414c3ad-08fc-45a4-b551-91e151f62025 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.157547 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01aa6ee-3621-45cd-972b-1e3143cba068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2320bbb4a49349c79a2c2e9aade43d51, user_id=2b7d3af2c65145769b47d8e7accd0aa2, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.158830 dv-cinder-846842-7-smb devstack@keystone.service[87040]: WARNING py.warnings [None req-d01aa6ee-3621-45cd-972b-1e3143cba068 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:48:46.158830 dv-cinder-846842-7-smb devstack@keystone.service[87040]: warnings.warn(msg) Jun 30 03:48:46.158830 dv-cinder-846842-7-smb devstack@keystone.service[87040]: Jun 30 03:48:46.160915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01aa6ee-3621-45cd-972b-1e3143cba068 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.176464 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 805/1592] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:46 2022] PUT /identity/v3/projects/2320bbb4a49349c79a2c2e9aade43d51/users/2b7d3af2c65145769b47d8e7accd0aa2/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:46.177313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01aa6ee-3621-45cd-972b-1e3143cba068 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.182314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:46.222491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414c3ad-08fc-45a4-b551-91e151f62025 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.245867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01aa6ee-3621-45cd-972b-1e3143cba068 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.250695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6945efa-345d-4b36-8da1-d5dbf08b0e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.251399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6945efa-345d-4b36-8da1-d5dbf08b0e88 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.251681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6945efa-345d-4b36-8da1-d5dbf08b0e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.251955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6945efa-345d-4b36-8da1-d5dbf08b0e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.252689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6945efa-345d-4b36-8da1-d5dbf08b0e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.254303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6945efa-345d-4b36-8da1-d5dbf08b0e88 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.264583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 806/1593] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:46.265176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6945efa-345d-4b36-8da1-d5dbf08b0e88 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.274826 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6945efa-345d-4b36-8da1-d5dbf08b0e88 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.280147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc0748-2fb8-4087-8d1d-2a19532f7504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.280767 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc0748-2fb8-4087-8d1d-2a19532f7504 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.281051 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc0748-2fb8-4087-8d1d-2a19532f7504 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.281332 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc0748-2fb8-4087-8d1d-2a19532f7504 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.282053 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc0748-2fb8-4087-8d1d-2a19532f7504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.282596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce5a2f-3919-4f80-8ef1-84ebb2ffcf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.283303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce5a2f-3919-4f80-8ef1-84ebb2ffcf6f admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.283587 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce5a2f-3919-4f80-8ef1-84ebb2ffcf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.283689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc0748-2fb8-4087-8d1d-2a19532f7504 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.283863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce5a2f-3919-4f80-8ef1-84ebb2ffcf6f admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.284577 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce5a2f-3919-4f80-8ef1-84ebb2ffcf6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.286607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce5a2f-3919-4f80-8ef1-84ebb2ffcf6f admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.293426 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 807/1594] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:46.294191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc0748-2fb8-4087-8d1d-2a19532f7504 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.300380 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:46.304139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc0748-2fb8-4087-8d1d-2a19532f7504 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.310012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720fbfa-6121-4d39-81ad-2f97d0da0e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.310685 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720fbfa-6121-4d39-81ad-2f97d0da0e1c admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.311074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720fbfa-6121-4d39-81ad-2f97d0da0e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.311415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720fbfa-6121-4d39-81ad-2f97d0da0e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.314874 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 788/1595] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:48:46 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:46.315039 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720fbfa-6121-4d39-81ad-2f97d0da0e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.315151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce5a2f-3919-4f80-8ef1-84ebb2ffcf6f admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.315246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720fbfa-6121-4d39-81ad-2f97d0da0e1c admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.322131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce5a2f-3919-4f80-8ef1-84ebb2ffcf6f admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.326728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b2f6b-bca8-4aa2-9649-c1a6d7541ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.327410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b2f6b-bca8-4aa2-9649-c1a6d7541ecf admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.327693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b2f6b-bca8-4aa2-9649-c1a6d7541ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.331301 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b2f6b-bca8-4aa2-9649-c1a6d7541ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.332126 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b2f6b-bca8-4aa2-9649-c1a6d7541ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.333993 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b2f6b-bca8-4aa2-9649-c1a6d7541ecf admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.344191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 808/1596] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:48:46 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:46.345718 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720fbfa-6121-4d39-81ad-2f97d0da0e1c admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.349098 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 789/1597] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:46.350408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b59b22-01df-46fa-b7dc-993dbcf3a2da None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.350700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b59b22-01df-46fa-b7dc-993dbcf3a2da None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.350997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b59b22-01df-46fa-b7dc-993dbcf3a2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.369370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-19b59b22-01df-46fa-b7dc-993dbcf3a2da None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:46.370585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-19b59b22-01df-46fa-b7dc-993dbcf3a2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:46.407791 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720fbfa-6121-4d39-81ad-2f97d0da0e1c admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.412682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a718c-390c-4105-ba9e-508126cf4473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.413363 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a718c-390c-4105-ba9e-508126cf4473 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.413648 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a718c-390c-4105-ba9e-508126cf4473 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.413925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a718c-390c-4105-ba9e-508126cf4473 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.414662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a718c-390c-4105-ba9e-508126cf4473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.416327 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a718c-390c-4105-ba9e-508126cf4473 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.426472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 809/1598] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:46.428001 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e228d3d-2dcc-429e-ae2c-9cca7085513e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.428364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e228d3d-2dcc-429e-ae2c-9cca7085513e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.428642 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e228d3d-2dcc-429e-ae2c-9cca7085513e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.431097 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 790/1599] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:46.432028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b59b22-01df-46fa-b7dc-993dbcf3a2da None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.442343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b59b22-01df-46fa-b7dc-993dbcf3a2da None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.447025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d83aec-db02-4104-b54d-1081dcd992b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.447704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d83aec-db02-4104-b54d-1081dcd992b0 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.447990 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d83aec-db02-4104-b54d-1081dcd992b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.448264 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d83aec-db02-4104-b54d-1081dcd992b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.449050 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d83aec-db02-4104-b54d-1081dcd992b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.450683 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d83aec-db02-4104-b54d-1081dcd992b0 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.455903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-5e228d3d-2dcc-429e-ae2c-9cca7085513e None None] MFA Rules not processed for user `2b7d3af2c65145769b47d8e7accd0aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:46.457129 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5e228d3d-2dcc-429e-ae2c-9cca7085513e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:46.461404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 791/1600] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:46.462253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d83aec-db02-4104-b54d-1081dcd992b0 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.473614 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d83aec-db02-4104-b54d-1081dcd992b0 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.478652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30860b63-a031-4b30-9952-6e2673997f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.479384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30860b63-a031-4b30-9952-6e2673997f3c admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.479673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30860b63-a031-4b30-9952-6e2673997f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.479950 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30860b63-a031-4b30-9952-6e2673997f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.480762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30860b63-a031-4b30-9952-6e2673997f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.482400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30860b63-a031-4b30-9952-6e2673997f3c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.492561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 792/1601] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:46.493333 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30860b63-a031-4b30-9952-6e2673997f3c admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.503160 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30860b63-a031-4b30-9952-6e2673997f3c admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.507811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5220725-c525-42aa-be62-f4edd1e2fe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.508462 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5220725-c525-42aa-be62-f4edd1e2fe6e admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.508745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5220725-c525-42aa-be62-f4edd1e2fe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.509016 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5220725-c525-42aa-be62-f4edd1e2fe6e admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.509742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5220725-c525-42aa-be62-f4edd1e2fe6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.511394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5220725-c525-42aa-be62-f4edd1e2fe6e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.524767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 793/1602] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:46.524767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5220725-c525-42aa-be62-f4edd1e2fe6e admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.527541 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 810/1603] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:46.528346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e228d3d-2dcc-429e-ae2c-9cca7085513e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.536874 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5220725-c525-42aa-be62-f4edd1e2fe6e admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.538432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e228d3d-2dcc-429e-ae2c-9cca7085513e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.542624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8646c10-7981-4978-8ae3-0f7d6f9dcd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.543139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd150e-9a53-4bd2-b076-bdbc9fc3f281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.543513 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8646c10-7981-4978-8ae3-0f7d6f9dcd68 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.543791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8646c10-7981-4978-8ae3-0f7d6f9dcd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.544020 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd150e-9a53-4bd2-b076-bdbc9fc3f281 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.544123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8646c10-7981-4978-8ae3-0f7d6f9dcd68 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.544307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd150e-9a53-4bd2-b076-bdbc9fc3f281 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.544586 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd150e-9a53-4bd2-b076-bdbc9fc3f281 admin admin] PATH_INFO: `/v3/projects/7da7cf00a1a04d34ac15d06e1451133a/users/4067f36996a348f39b50fd88f223c87b/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.545480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8646c10-7981-4978-8ae3-0f7d6f9dcd68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.547618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8646c10-7981-4978-8ae3-0f7d6f9dcd68 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.561700 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd150e-9a53-4bd2-b076-bdbc9fc3f281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da7cf00a1a04d34ac15d06e1451133a, user_id=4067f36996a348f39b50fd88f223c87b, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.564592 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd150e-9a53-4bd2-b076-bdbc9fc3f281 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.570322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:46.577953 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 794/1604] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:48:46 2022] POST /identity/v3/users => generated 309 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:46.578837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8646c10-7981-4978-8ae3-0f7d6f9dcd68 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.585448 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 811/1605] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:46 2022] PUT /identity/v3/projects/7da7cf00a1a04d34ac15d06e1451133a/users/4067f36996a348f39b50fd88f223c87b/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:46.586008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd150e-9a53-4bd2-b076-bdbc9fc3f281 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.591203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8646c10-7981-4978-8ae3-0f7d6f9dcd68 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.632512 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:46.644691 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd150e-9a53-4bd2-b076-bdbc9fc3f281 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.648260 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747d81f-b9af-4d41-96c4-dc67dffcf15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.648491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab91391-332f-447d-ac20-3bd327f490ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.649169 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747d81f-b9af-4d41-96c4-dc67dffcf15c admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.649276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab91391-332f-447d-ac20-3bd327f490ec service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.649454 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747d81f-b9af-4d41-96c4-dc67dffcf15c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.649566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab91391-332f-447d-ac20-3bd327f490ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.649734 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747d81f-b9af-4d41-96c4-dc67dffcf15c admin admin] PATH_INFO: `/v3/projects/9e49753ac49f48d794f5866dd76d3848/users/f6dd88c437b74acfb3b54e4b8fd47e89/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.649838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab91391-332f-447d-ac20-3bd327f490ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.659380 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab91391-332f-447d-ac20-3bd327f490ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.660811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab91391-332f-447d-ac20-3bd327f490ec service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.664633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747d81f-b9af-4d41-96c4-dc67dffcf15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e49753ac49f48d794f5866dd76d3848, user_id=f6dd88c437b74acfb3b54e4b8fd47e89, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.667346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747d81f-b9af-4d41-96c4-dc67dffcf15c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.670821 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 812/1606] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:46.671796 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab91391-332f-447d-ac20-3bd327f490ec service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.681829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab91391-332f-447d-ac20-3bd327f490ec service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.684394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 795/1607] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:46 2022] PUT /identity/v3/projects/9e49753ac49f48d794f5866dd76d3848/users/f6dd88c437b74acfb3b54e4b8fd47e89/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:46.685254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747d81f-b9af-4d41-96c4-dc67dffcf15c admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.753062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747d81f-b9af-4d41-96c4-dc67dffcf15c admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.754165 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d971136-5103-412e-bacc-84e9296055d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.755205 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d971136-5103-412e-bacc-84e9296055d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.755685 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d971136-5103-412e-bacc-84e9296055d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.756093 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d971136-5103-412e-bacc-84e9296055d9 admin admin] PATH_INFO: `/v3/projects/cd4c421db4ba4b8283eaeddc9ae1a204/users/cfaea6cf840e4d51b7451c08a71f0fa7/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.758387 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fe9b4-1651-41b1-acde-c68796683b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.759318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fe9b4-1651-41b1-acde-c68796683b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.759601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fe9b4-1651-41b1-acde-c68796683b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.760943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fe9b4-1651-41b1-acde-c68796683b13 admin admin] PATH_INFO: `/v3/projects/6817f59f39094a58b284ae0a0dbab465/users/aa8ee32c5d484363b8af1898d2603e90/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.775192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d971136-5103-412e-bacc-84e9296055d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4c421db4ba4b8283eaeddc9ae1a204, user_id=cfaea6cf840e4d51b7451c08a71f0fa7, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.777861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fe9b4-1651-41b1-acde-c68796683b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6817f59f39094a58b284ae0a0dbab465, user_id=aa8ee32c5d484363b8af1898d2603e90, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.778394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d971136-5103-412e-bacc-84e9296055d9 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.780887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fe9b4-1651-41b1-acde-c68796683b13 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.799945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 796/1609] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:46 2022] PUT /identity/v3/projects/6817f59f39094a58b284ae0a0dbab465/users/aa8ee32c5d484363b8af1898d2603e90/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:46.799945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fe9b4-1651-41b1-acde-c68796683b13 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.802838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 813/1609] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:46 2022] PUT /identity/v3/projects/cd4c421db4ba4b8283eaeddc9ae1a204/users/cfaea6cf840e4d51b7451c08a71f0fa7/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:46.806580 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a486f-de99-4b38-b208-01ce4e5508a8 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.806948 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a486f-de99-4b38-b208-01ce4e5508a8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.807289 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a486f-de99-4b38-b208-01ce4e5508a8 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.808957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 814/1610] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jun 30 03:48:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:48:46.810060 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a486f-de99-4b38-b208-01ce4e5508a8 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:46.874183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fe9b4-1651-41b1-acde-c68796683b13 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.884740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9ee44-b604-4cc3-84a2-5b5eb57038fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.886015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9ee44-b604-4cc3-84a2-5b5eb57038fb admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.886298 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9ee44-b604-4cc3-84a2-5b5eb57038fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.886814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9ee44-b604-4cc3-84a2-5b5eb57038fb admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.887565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9ee44-b604-4cc3-84a2-5b5eb57038fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.889677 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9ee44-b604-4cc3-84a2-5b5eb57038fb admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.890903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a486f-de99-4b38-b208-01ce4e5508a8 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:46.896139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b86d1-9620-4697-84c5-e616b9715a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:46.896893 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b86d1-9620-4697-84c5-e616b9715a5b admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.897127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:46.897245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b86d1-9620-4697-84c5-e616b9715a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.897421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b86d1-9620-4697-84c5-e616b9715a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.898282 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b86d1-9620-4697-84c5-e616b9715a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:46.900397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b86d1-9620-4697-84c5-e616b9715a5b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:46.906949 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 797/1611] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:46.908785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649a759-412b-49dd-bd8b-e715d6b9ba47 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.909562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649a759-412b-49dd-bd8b-e715d6b9ba47 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.909928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649a759-412b-49dd-bd8b-e715d6b9ba47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.918505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 815/1612] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:46.918505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b86d2-9156-4494-b080-cd893f134fa0 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.918505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b86d2-9156-4494-b080-cd893f134fa0 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.918505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b86d2-9156-4494-b080-cd893f134fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.928258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-5649a759-412b-49dd-bd8b-e715d6b9ba47 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:46.929464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-5649a759-412b-49dd-bd8b-e715d6b9ba47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:46.936809 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-d75b86d2-9156-4494-b080-cd893f134fa0 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:46.938094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 798/1613] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:46.938216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d75b86d2-9156-4494-b080-cd893f134fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:46.939380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245be7ad-ee8d-41d0-a23a-3ec1c0510305 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.939682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245be7ad-ee8d-41d0-a23a-3ec1c0510305 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.939933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245be7ad-ee8d-41d0-a23a-3ec1c0510305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.948146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 816/1614] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:46.951662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6e540-aed1-4f40-853d-f2704ff3ae0e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.951955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6e540-aed1-4f40-853d-f2704ff3ae0e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.952235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6e540-aed1-4f40-853d-f2704ff3ae0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.962722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-245be7ad-ee8d-41d0-a23a-3ec1c0510305 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:46.964309 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-245be7ad-ee8d-41d0-a23a-3ec1c0510305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:46.972995 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 799/1615] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:46.974286 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55148ed5-e8e5-4913-9d8c-4e4d7e91a0d4 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:46.974572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55148ed5-e8e5-4913-9d8c-4e4d7e91a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:46.974893 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55148ed5-e8e5-4913-9d8c-4e4d7e91a0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:46.992572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-efc6e540-aed1-4f40-853d-f2704ff3ae0e None None] MFA Rules not processed for user `cfaea6cf840e4d51b7451c08a71f0fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:46.994733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-efc6e540-aed1-4f40-853d-f2704ff3ae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:47.001055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-55148ed5-e8e5-4913-9d8c-4e4d7e91a0d4 None None] MFA Rules not processed for user `758b152c320e4a94921bb96541cbea98`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:47.002384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-55148ed5-e8e5-4913-9d8c-4e4d7e91a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:47.069634 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:47.095041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 817/1616] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:47.096066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6e540-aed1-4f40-853d-f2704ff3ae0e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:47.112032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6e540-aed1-4f40-853d-f2704ff3ae0e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:47.117127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7cf28-42fe-4e00-8c4f-eb4b3dbe3fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:47.118067 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7cf28-42fe-4e00-8c4f-eb4b3dbe3fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:47.118606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7cf28-42fe-4e00-8c4f-eb4b3dbe3fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:47.118737 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 800/1617] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jun 30 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:47.119256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7cf28-42fe-4e00-8c4f-eb4b3dbe3fe5 admin admin] PATH_INFO: `/v3/projects/56b75b78f6004efba19de547a58f1b12/users/5f23454344254cc18c6133a9cc84bda5/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:47.119607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55148ed5-e8e5-4913-9d8c-4e4d7e91a0d4 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:47.135490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55148ed5-e8e5-4913-9d8c-4e4d7e91a0d4 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:47.137336 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7cf28-42fe-4e00-8c4f-eb4b3dbe3fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b75b78f6004efba19de547a58f1b12, user_id=5f23454344254cc18c6133a9cc84bda5, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:47.140202 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7cf28-42fe-4e00-8c4f-eb4b3dbe3fe5 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:47.141291 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01266b78-503c-401e-959f-d3ac6c4115d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:47.142676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01266b78-503c-401e-959f-d3ac6c4115d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:47.143042 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01266b78-503c-401e-959f-d3ac6c4115d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:47.144485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01266b78-503c-401e-959f-d3ac6c4115d7 admin admin] PATH_INFO: `/v3/projects/be6743e7f9c24f248f9298757bb66d93/users/5557ad4a065049a295c8fdc1e5e8fdea/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:47.159970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 818/1618] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:47 2022] PUT /identity/v3/projects/56b75b78f6004efba19de547a58f1b12/users/5f23454344254cc18c6133a9cc84bda5/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:47.161103 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7cf28-42fe-4e00-8c4f-eb4b3dbe3fe5 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:47.165952 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01266b78-503c-401e-959f-d3ac6c4115d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6743e7f9c24f248f9298757bb66d93, user_id=5557ad4a065049a295c8fdc1e5e8fdea, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:47.169184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01266b78-503c-401e-959f-d3ac6c4115d7 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:47.186906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 801/1619] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:47 2022] PUT /identity/v3/projects/be6743e7f9c24f248f9298757bb66d93/users/5557ad4a065049a295c8fdc1e5e8fdea/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:47.188277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01266b78-503c-401e-959f-d3ac6c4115d7 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:47.228025 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7cf28-42fe-4e00-8c4f-eb4b3dbe3fe5 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:47.255763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01266b78-503c-401e-959f-d3ac6c4115d7 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:47.259394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf60673-2bdc-4721-a1ab-6962cf9b64da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:47.260041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf60673-2bdc-4721-a1ab-6962cf9b64da service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:47.260373 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf60673-2bdc-4721-a1ab-6962cf9b64da service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:47.260657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf60673-2bdc-4721-a1ab-6962cf9b64da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:47.291648 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bb8ee-028e-4a48-b508-3d044b96ba4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:47.292334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bb8ee-028e-4a48-b508-3d044b96ba4a service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:47.292614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bb8ee-028e-4a48-b508-3d044b96ba4a service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:47.292892 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bb8ee-028e-4a48-b508-3d044b96ba4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:47.332341 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf60673-2bdc-4721-a1ab-6962cf9b64da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:47.333815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf60673-2bdc-4721-a1ab-6962cf9b64da service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:47.344397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 802/1620] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:47.345262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf60673-2bdc-4721-a1ab-6962cf9b64da service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:47.350649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:47.355295 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf60673-2bdc-4721-a1ab-6962cf9b64da service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:47.360697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d3416-3a62-4832-9030-d88727dc8909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:47.361528 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3416-3a62-4832-9030-d88727dc8909 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:47.361641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3416-3a62-4832-9030-d88727dc8909 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:47.361869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3416-3a62-4832-9030-d88727dc8909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:47.368552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bb8ee-028e-4a48-b508-3d044b96ba4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:47.370081 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bb8ee-028e-4a48-b508-3d044b96ba4a service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:47.372931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d3416-3a62-4832-9030-d88727dc8909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:47.374875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d3416-3a62-4832-9030-d88727dc8909 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:47.382051 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 819/1621] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:47.383084 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bb8ee-028e-4a48-b508-3d044b96ba4a service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:47.385114 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 803/1622] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:47.385805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d3416-3a62-4832-9030-d88727dc8909 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:47.395520 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bb8ee-028e-4a48-b508-3d044b96ba4a service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:47.400995 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fa2f1-1f54-4a16-bf63-2f3909a531d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:47.401982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa2f1-1f54-4a16-bf63-2f3909a531d9 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:47.402434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa2f1-1f54-4a16-bf63-2f3909a531d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:47.402916 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa2f1-1f54-4a16-bf63-2f3909a531d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:47.403783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fa2f1-1f54-4a16-bf63-2f3909a531d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:47.406541 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fa2f1-1f54-4a16-bf63-2f3909a531d9 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:47.444229 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 820/1623] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:48:47 2022] POST /identity/v3/projects => generated 407 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:47.445882 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eefad-2cea-41c3-b2fd-abe850aeeb65 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:47.446358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eefad-2cea-41c3-b2fd-abe850aeeb65 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:47.446966 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eefad-2cea-41c3-b2fd-abe850aeeb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:47.463491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d3416-3a62-4832-9030-d88727dc8909 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:47.470977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:47.485087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-767eefad-2cea-41c3-b2fd-abe850aeeb65 None None] MFA Rules not processed for user `5f23454344254cc18c6133a9cc84bda5`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:47.487310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-767eefad-2cea-41c3-b2fd-abe850aeeb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:47.585199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d06fcc-9e10-4e4c-b564-2655b050bea8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:47.589701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d06fcc-9e10-4e4c-b564-2655b050bea8 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:47.589988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d06fcc-9e10-4e4c-b564-2655b050bea8 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:47.590259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d06fcc-9e10-4e4c-b564-2655b050bea8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:47.601334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 821/1624] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:47.604593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eefad-2cea-41c3-b2fd-abe850aeeb65 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:47.724324 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d06fcc-9e10-4e4c-b564-2655b050bea8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:47.727990 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d06fcc-9e10-4e4c-b564-2655b050bea8 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:47.740819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 804/1625] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:47.741394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d06fcc-9e10-4e4c-b564-2655b050bea8 service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:47.783453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eefad-2cea-41c3-b2fd-abe850aeeb65 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:47.784670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:47.791929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac07670-1169-40dd-ac02-74f5811cb456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:47.793869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac07670-1169-40dd-ac02-74f5811cb456 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:47.794166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac07670-1169-40dd-ac02-74f5811cb456 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:47.794447 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac07670-1169-40dd-ac02-74f5811cb456 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:47.797211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac07670-1169-40dd-ac02-74f5811cb456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:47.800194 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac07670-1169-40dd-ac02-74f5811cb456 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:47.824528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 822/1626] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:47.826110 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d06fcc-9e10-4e4c-b564-2655b050bea8 service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:47.831508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a59b-b0c0-4080-b42c-70358102719d None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:47.831802 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a59b-b0c0-4080-b42c-70358102719d None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:47.832428 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcb1a7-9027-4ed9-b916-f13db7cd178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:47.833283 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a59b-b0c0-4080-b42c-70358102719d None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:47.833624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb1a7-9027-4ed9-b916-f13db7cd178c admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:47.834124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb1a7-9027-4ed9-b916-f13db7cd178c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:47.834865 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 823/1627] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jun 30 03:48:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:48:47.835137 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb1a7-9027-4ed9-b916-f13db7cd178c admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:47.836050 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcb1a7-9027-4ed9-b916-f13db7cd178c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:47.837576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0a59b-b0c0-4080-b42c-70358102719d None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:47.839738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcb1a7-9027-4ed9-b916-f13db7cd178c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:47.871340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 805/1628] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:48:47 2022] POST /identity/v3/users => generated 310 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:47.874209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0cbe7-b070-4a2e-926b-871d03124e95 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:47.874788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0cbe7-b070-4a2e-926b-871d03124e95 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:47.875428 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0cbe7-b070-4a2e-926b-871d03124e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:47.888808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0a59b-b0c0-4080-b42c-70358102719d None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:47.900269 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4a3c9-d8d4-4c63-b011-199c676b2ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:47.901326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4a3c9-d8d4-4c63-b011-199c676b2ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:47.901603 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4a3c9-d8d4-4c63-b011-199c676b2ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:47.901967 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4a3c9-d8d4-4c63-b011-199c676b2ef4 admin admin] PATH_INFO: `/v3/projects/be6743e7f9c24f248f9298757bb66d93/users/5557ad4a065049a295c8fdc1e5e8fdea/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:47.904645 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-dec0cbe7-b070-4a2e-926b-871d03124e95 None None] MFA Rules not processed for user `758b152c320e4a94921bb96541cbea98`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:47.906709 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4a3c9-d8d4-4c63-b011-199c676b2ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6743e7f9c24f248f9298757bb66d93, user_id=5557ad4a065049a295c8fdc1e5e8fdea, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:47.908025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-dec0cbe7-b070-4a2e-926b-871d03124e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:47.913488 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4a3c9-d8d4-4c63-b011-199c676b2ef4 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:47.927455 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 806/1629] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jun 30 03:48:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:47.928742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0cbe7-b070-4a2e-926b-871d03124e95 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:47.941196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 824/1630] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:47 2022] PUT /identity/v3/projects/be6743e7f9c24f248f9298757bb66d93/users/5557ad4a065049a295c8fdc1e5e8fdea/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:47.946943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4a3c9-d8d4-4c63-b011-199c676b2ef4 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:47.947977 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0cbe7-b070-4a2e-926b-871d03124e95 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:48.037695 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b5307-63ed-4aa5-9e88-9ecc3d5e6a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:48.040835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b5307-63ed-4aa5-9e88-9ecc3d5e6a81 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:48.040835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b5307-63ed-4aa5-9e88-9ecc3d5e6a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:48.040835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b5307-63ed-4aa5-9e88-9ecc3d5e6a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:48.040835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b5307-63ed-4aa5-9e88-9ecc3d5e6a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:48.041831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b5307-63ed-4aa5-9e88-9ecc3d5e6a81 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:48.057399 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 807/1631] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:48.062557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b5307-63ed-4aa5-9e88-9ecc3d5e6a81 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:48.090284 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b5307-63ed-4aa5-9e88-9ecc3d5e6a81 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:48.102333 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9883c0-048e-451e-a526-7c7df302597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:48.104023 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9883c0-048e-451e-a526-7c7df302597f admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:48.104314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9883c0-048e-451e-a526-7c7df302597f admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:48.104595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9883c0-048e-451e-a526-7c7df302597f admin admin] PATH_INFO: `/v3/projects/219c3fcf4faa4acf94b7bb253e9b5f9c/users/20f6cef70d424b1dbc20efe43da06363/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:48.129985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9883c0-048e-451e-a526-7c7df302597f admin admin] RBAC: Authorizing `identity:create_grant(project_id=219c3fcf4faa4acf94b7bb253e9b5f9c, user_id=20f6cef70d424b1dbc20efe43da06363, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:48.131123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4a3c9-d8d4-4c63-b011-199c676b2ef4 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:48.133037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9883c0-048e-451e-a526-7c7df302597f admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:48.145217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf42ad7-2242-406c-9a6f-71ae55851aa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:48.153062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42ad7-2242-406c-9a6f-71ae55851aa8 service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:48.153062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42ad7-2242-406c-9a6f-71ae55851aa8 service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:48.153062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42ad7-2242-406c-9a6f-71ae55851aa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:48.168431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 808/1632] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:48 2022] PUT /identity/v3/projects/219c3fcf4faa4acf94b7bb253e9b5f9c/users/20f6cef70d424b1dbc20efe43da06363/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:48.172498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9883c0-048e-451e-a526-7c7df302597f admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:48.194560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:48.242992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9883c0-048e-451e-a526-7c7df302597f admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:48.249695 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be4a15-b93c-4b59-bb46-c80ed56ee614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:48.250556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be4a15-b93c-4b59-bb46-c80ed56ee614 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:48.250936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be4a15-b93c-4b59-bb46-c80ed56ee614 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:48.251312 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be4a15-b93c-4b59-bb46-c80ed56ee614 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:48.252165 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be4a15-b93c-4b59-bb46-c80ed56ee614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:48.254403 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be4a15-b93c-4b59-bb46-c80ed56ee614 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:48.270709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 809/1633] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:48.272353 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5658f9a-ed29-4361-b0b2-8f0b3074fcdf None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:48.272692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5658f9a-ed29-4361-b0b2-8f0b3074fcdf None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:48.273042 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5658f9a-ed29-4361-b0b2-8f0b3074fcdf None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:48.274832 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 810/1634] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jun 30 03:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:48:48.275620 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5658f9a-ed29-4361-b0b2-8f0b3074fcdf None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:48.275748 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf42ad7-2242-406c-9a6f-71ae55851aa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:48.277635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf42ad7-2242-406c-9a6f-71ae55851aa8 service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:48.292082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5658f9a-ed29-4361-b0b2-8f0b3074fcdf None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:48.299819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 825/1635] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:48.303679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ec2ad-3cb6-4888-b385-5b3124170526 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:48.304605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59980cf5-d8f3-435a-b44a-9ca7577cd04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:48.305650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59980cf5-d8f3-435a-b44a-9ca7577cd04e admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:48.305841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59980cf5-d8f3-435a-b44a-9ca7577cd04e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:48.306089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59980cf5-d8f3-435a-b44a-9ca7577cd04e admin admin] PATH_INFO: `/v3/projects/219c3fcf4faa4acf94b7bb253e9b5f9c/users/20f6cef70d424b1dbc20efe43da06363/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:48.306648 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ec2ad-3cb6-4888-b385-5b3124170526 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:48.306948 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ec2ad-3cb6-4888-b385-5b3124170526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:48.312944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59980cf5-d8f3-435a-b44a-9ca7577cd04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=219c3fcf4faa4acf94b7bb253e9b5f9c, user_id=20f6cef70d424b1dbc20efe43da06363, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:48.314903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59980cf5-d8f3-435a-b44a-9ca7577cd04e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:48.352612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 811/1636] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:48 2022] PUT /identity/v3/projects/219c3fcf4faa4acf94b7bb253e9b5f9c/users/20f6cef70d424b1dbc20efe43da06363/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:48.354200 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babb3eb-064a-4abc-9025-d60cecf31dfa None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:48.354492 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babb3eb-064a-4abc-9025-d60cecf31dfa None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:48.354852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babb3eb-064a-4abc-9025-d60cecf31dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:48.355994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e46ec2ad-3cb6-4888-b385-5b3124170526 None None] MFA Rules not processed for user `758b152c320e4a94921bb96541cbea98`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:48.357607 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e46ec2ad-3cb6-4888-b385-5b3124170526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:48.385391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:48.441658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-2babb3eb-064a-4abc-9025-d60cecf31dfa None None] MFA Rules not processed for user `20f6cef70d424b1dbc20efe43da06363`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:48.444077 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2babb3eb-064a-4abc-9025-d60cecf31dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:48.557662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 826/1637] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:48:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:48.573357 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ec2ad-3cb6-4888-b385-5b3124170526 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:48.635945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 812/1638] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:48 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:48.657741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babb3eb-064a-4abc-9025-d60cecf31dfa None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:48.708687 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ec2ad-3cb6-4888-b385-5b3124170526 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:48.715864 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d489a8e-1fdc-459f-b27b-a2c353e15038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:48.718791 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d489a8e-1fdc-459f-b27b-a2c353e15038 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:48.719159 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d489a8e-1fdc-459f-b27b-a2c353e15038 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:48.719641 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d489a8e-1fdc-459f-b27b-a2c353e15038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:48.741965 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d489a8e-1fdc-459f-b27b-a2c353e15038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:48.745609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d489a8e-1fdc-459f-b27b-a2c353e15038 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:48.830918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babb3eb-064a-4abc-9025-d60cecf31dfa None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:48.833311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 827/1639] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:48.833311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3a76d-04ba-42a6-981b-b2f81d0e5637 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:48.833311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3a76d-04ba-42a6-981b-b2f81d0e5637 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:48.833311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3a76d-04ba-42a6-981b-b2f81d0e5637 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:48.833311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 828/1640] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jun 30 03:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:48:48.834246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014c915-e5e0-47cd-988e-5ccf0dd5e7a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:48.834246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014c915-e5e0-47cd-988e-5ccf0dd5e7a6 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:48.834246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014c915-e5e0-47cd-988e-5ccf0dd5e7a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:48.834246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014c915-e5e0-47cd-988e-5ccf0dd5e7a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:48.834750 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874e8fb-e568-4280-8d39-e578e8545217 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:48.838647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874e8fb-e568-4280-8d39-e578e8545217 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:48.841979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874e8fb-e568-4280-8d39-e578e8545217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:48.854157 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014c915-e5e0-47cd-988e-5ccf0dd5e7a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:48.856293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014c915-e5e0-47cd-988e-5ccf0dd5e7a6 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:48.884945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 813/1641] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:48 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:48:48.901023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6874e8fb-e568-4280-8d39-e578e8545217 None None] MFA Rules not processed for user `758b152c320e4a94921bb96541cbea98`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:48.902294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6874e8fb-e568-4280-8d39-e578e8545217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:48.935978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 829/1642] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:48:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:48.985388 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014c915-e5e0-47cd-988e-5ccf0dd5e7a6 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:48.995899 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014c915-e5e0-47cd-988e-5ccf0dd5e7a6 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:49.001394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a265d8d-9859-4e35-98f9-4c0c936bdb42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:49.002280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265d8d-9859-4e35-98f9-4c0c936bdb42 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:49.002837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265d8d-9859-4e35-98f9-4c0c936bdb42 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:49.003329 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265d8d-9859-4e35-98f9-4c0c936bdb42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:49.018441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a265d8d-9859-4e35-98f9-4c0c936bdb42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:49.020763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a265d8d-9859-4e35-98f9-4c0c936bdb42 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:49.045964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 814/1643] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:49.528378 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874e8fb-e568-4280-8d39-e578e8545217 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:49.541939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874e8fb-e568-4280-8d39-e578e8545217 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:49.551007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631e83f-1096-4d65-a8c3-e9e984f0a273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:49.551684 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631e83f-1096-4d65-a8c3-e9e984f0a273 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:49.551962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631e83f-1096-4d65-a8c3-e9e984f0a273 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:49.552234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631e83f-1096-4d65-a8c3-e9e984f0a273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:49.652424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:49.676443 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631e83f-1096-4d65-a8c3-e9e984f0a273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:49.677934 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631e83f-1096-4d65-a8c3-e9e984f0a273 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:49.702563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 830/1644] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:49.867983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a265d8d-9859-4e35-98f9-4c0c936bdb42 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:50.135414 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a265d8d-9859-4e35-98f9-4c0c936bdb42 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:50.163726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e156210-1726-49e5-9eb2-1b06f5174ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:50.164643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e156210-1726-49e5-9eb2-1b06f5174ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:50.164643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e156210-1726-49e5-9eb2-1b06f5174ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:50.164885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e156210-1726-49e5-9eb2-1b06f5174ecc admin admin] PATH_INFO: `/v3/users/5f23454344254cc18c6133a9cc84bda5` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:50.167509 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e156210-1726-49e5-9eb2-1b06f5174ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f23454344254cc18c6133a9cc84bda5)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:50.170111 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e156210-1726-49e5-9eb2-1b06f5174ecc admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:50.242056 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:50.304954 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3e156210-1726-49e5-9eb2-1b06f5174ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f23454344254cc18c6133a9cc84bda5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:50.318940 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3e156210-1726-49e5-9eb2-1b06f5174ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f23454344254cc18c6133a9cc84bda5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:50.326844 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3e156210-1726-49e5-9eb2-1b06f5174ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f23454344254cc18c6133a9cc84bda5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:50.327844 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3e156210-1726-49e5-9eb2-1b06f5174ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f23454344254cc18c6133a9cc84bda5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:50.328638 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3e156210-1726-49e5-9eb2-1b06f5174ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f23454344254cc18c6133a9cc84bda5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:50.354111 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 815/1645] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:48:49 2022] DELETE /identity/v3/users/5f23454344254cc18c6133a9cc84bda5 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:48:50.359135 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be728cb8-2d0f-4f6c-bd93-677ea9efb2cf None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:50.359300 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be728cb8-2d0f-4f6c-bd93-677ea9efb2cf None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:50.359493 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be728cb8-2d0f-4f6c-bd93-677ea9efb2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:50.381606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-be728cb8-2d0f-4f6c-bd93-677ea9efb2cf None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:50.383450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-be728cb8-2d0f-4f6c-bd93-677ea9efb2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:50.541451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 831/1646] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:48:50.616544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e156210-1726-49e5-9eb2-1b06f5174ecc admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:50.618306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3e156210-1726-49e5-9eb2-1b06f5174ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:50.859723 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e156210-1726-49e5-9eb2-1b06f5174ecc admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:50.869501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ef2f4-0ab8-4189-bc27-86aca140dac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:50.870331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ef2f4-0ab8-4189-bc27-86aca140dac7 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:50.871160 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ef2f4-0ab8-4189-bc27-86aca140dac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:50.871567 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ef2f4-0ab8-4189-bc27-86aca140dac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:50.885988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ef2f4-0ab8-4189-bc27-86aca140dac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:50.888715 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ef2f4-0ab8-4189-bc27-86aca140dac7 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:50.902113 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 816/1647] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:50.914598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed493c15-1174-4ab5-80b6-e0b6cb72e897 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:50.915502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed493c15-1174-4ab5-80b6-e0b6cb72e897 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:50.915502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed493c15-1174-4ab5-80b6-e0b6cb72e897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:50.946594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-ed493c15-1174-4ab5-80b6-e0b6cb72e897 None None] MFA Rules not processed for user `5557ad4a065049a295c8fdc1e5e8fdea`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:50.948099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ed493c15-1174-4ab5-80b6-e0b6cb72e897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:51.030370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 832/1648] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:53.265577 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ef2f4-0ab8-4189-bc27-86aca140dac7 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:53.267307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-671ef2f4-0ab8-4189-bc27-86aca140dac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:53.307724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ef2f4-0ab8-4189-bc27-86aca140dac7 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:53.313193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fdfd1-73a0-400e-9cd1-ca1e54f3f361 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:53.314113 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fdfd1-73a0-400e-9cd1-ca1e54f3f361 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:53.314637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fdfd1-73a0-400e-9cd1-ca1e54f3f361 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:53.316734 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 833/1649] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 03:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:48:53.325399 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f931930-3269-47fe-8553-fa39231356e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:53.326601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f931930-3269-47fe-8553-fa39231356e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:53.326916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f931930-3269-47fe-8553-fa39231356e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:53.327197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f931930-3269-47fe-8553-fa39231356e1 admin admin] PATH_INFO: `/v3/projects/56b75b78f6004efba19de547a58f1b12` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:53.332829 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f931930-3269-47fe-8553-fa39231356e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b75b78f6004efba19de547a58f1b12)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:53.334693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: WARNING py.warnings [None req-1f931930-3269-47fe-8553-fa39231356e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:48:53.334693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: warnings.warn(msg) Jun 30 03:48:53.334693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: Jun 30 03:48:53.339767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f931930-3269-47fe-8553-fa39231356e1 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:53.490562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64005e1-111c-4074-9cfc-b7060f1584d4 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:53.491298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64005e1-111c-4074-9cfc-b7060f1584d4 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:53.491772 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64005e1-111c-4074-9cfc-b7060f1584d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:53.526844 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1f931930-3269-47fe-8553-fa39231356e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b75b78f6004efba19de547a58f1b12', 'request_id': 'req-1f931930-3269-47fe-8553-fa39231356e1'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:53.551607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1f931930-3269-47fe-8553-fa39231356e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b75b78f6004efba19de547a58f1b12', 'request_id': 'req-1f931930-3269-47fe-8553-fa39231356e1'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:53.555838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-c64005e1-111c-4074-9cfc-b7060f1584d4 None None] MFA Rules not processed for user `13562e65139b44ab931fb8fdb41a61b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:53.560852 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c64005e1-111c-4074-9cfc-b7060f1584d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:53.565166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1f931930-3269-47fe-8553-fa39231356e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b75b78f6004efba19de547a58f1b12', 'request_id': 'req-1f931930-3269-47fe-8553-fa39231356e1'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:53.639200 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1f931930-3269-47fe-8553-fa39231356e1 admin admin] The token cache is being invalidate because project 56b75b78f6004efba19de547a58f1b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:48:53.639588 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1f931930-3269-47fe-8553-fa39231356e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:53.642044 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1f931930-3269-47fe-8553-fa39231356e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:53.645183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 817/1650] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:48:53 2022] DELETE /identity/v3/projects/56b75b78f6004efba19de547a58f1b12 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:53.661107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75e2cd-92de-4a28-bdcc-1e9f4b30f9f6 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:53.661387 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75e2cd-92de-4a28-bdcc-1e9f4b30f9f6 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:53.661619 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75e2cd-92de-4a28-bdcc-1e9f4b30f9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:53.728805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-5d75e2cd-92de-4a28-bdcc-1e9f4b30f9f6 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:53.730087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-5d75e2cd-92de-4a28-bdcc-1e9f4b30f9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:53.745942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 834/1651] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 03:48:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:53.804979 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:53.805101 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0a74f-ade7-4088-8daf-01b84bb4fa3c None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:53.806178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0a74f-ade7-4088-8daf-01b84bb4fa3c None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:53.808256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0a74f-ade7-4088-8daf-01b84bb4fa3c None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:53.819478 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 835/1652] 10.222.0.26 () {54 vars in 960 bytes} [Thu Jun 30 03:48:53 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:48:53.829285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623f01a-fc5b-4afe-8f1e-a58683f83876 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:53.830626 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623f01a-fc5b-4afe-8f1e-a58683f83876 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:53.831079 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623f01a-fc5b-4afe-8f1e-a58683f83876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:53.916128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:53.943116 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-a623f01a-fc5b-4afe-8f1e-a58683f83876 None None] MFA Rules not processed for user `13562e65139b44ab931fb8fdb41a61b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:53.944413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a623f01a-fc5b-4afe-8f1e-a58683f83876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:53.954138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 818/1653] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:53.970561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f822c-711a-4194-82bc-8cd9fb3d664e None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:53.970561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f822c-711a-4194-82bc-8cd9fb3d664e None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:53.970561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f822c-711a-4194-82bc-8cd9fb3d664e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:53.995084 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 836/1654] 10.222.0.26 () {58 vars in 1057 bytes} [Thu Jun 30 03:48:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:54.000999 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623f01a-fc5b-4afe-8f1e-a58683f83876 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:54.051694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623f01a-fc5b-4afe-8f1e-a58683f83876 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:54.060607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-432f822c-711a-4194-82bc-8cd9fb3d664e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:54.070015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-432f822c-711a-4194-82bc-8cd9fb3d664e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:54.080002 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cdb28-9926-4ff4-89cd-7745e6cb5441 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13562e65139b44ab931fb8fdb41a61b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:54.086357 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdb28-9926-4ff4-89cd-7745e6cb5441 service placement] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:54.086357 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdb28-9926-4ff4-89cd-7745e6cb5441 service placement] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:54.086560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdb28-9926-4ff4-89cd-7745e6cb5441 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:54.114534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cdb28-9926-4ff4-89cd-7745e6cb5441 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:54.116062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 819/1655] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:54.117051 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f822c-711a-4194-82bc-8cd9fb3d664e None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:54.126623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cdb28-9926-4ff4-89cd-7745e6cb5441 service placement] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:54.143716 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f822c-711a-4194-82bc-8cd9fb3d664e None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:54.155000 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 837/1656] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:54.160549 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab23b07-b542-4d83-9d14-d955f63070f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:54.162493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab23b07-b542-4d83-9d14-d955f63070f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:54.162972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab23b07-b542-4d83-9d14-d955f63070f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:54.163280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab23b07-b542-4d83-9d14-d955f63070f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:54.164847 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab23b07-b542-4d83-9d14-d955f63070f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:48:54.167711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab23b07-b542-4d83-9d14-d955f63070f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:54.174684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab23b07-b542-4d83-9d14-d955f63070f8 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:54.209153 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cdb28-9926-4ff4-89cd-7745e6cb5441 service placement] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:54.230580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 820/1657] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:48:54.253760 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cdb28-9926-4ff4-89cd-7745e6cb5441 service placement] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:54.284264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af4ddb-30bf-4592-89e0-917f1e0880b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:54.286381 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af4ddb-30bf-4592-89e0-917f1e0880b3 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:54.291484 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af4ddb-30bf-4592-89e0-917f1e0880b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:54.292494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af4ddb-30bf-4592-89e0-917f1e0880b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:54.301873 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af4ddb-30bf-4592-89e0-917f1e0880b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:54.305572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af4ddb-30bf-4592-89e0-917f1e0880b3 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:54.392640 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 838/1658] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:48:54 2022] POST /identity/v3/projects => generated 399 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:48:54.399025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab23b07-b542-4d83-9d14-d955f63070f8 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:54.412006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab23b07-b542-4d83-9d14-d955f63070f8 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:54.603784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db1d47-972b-4a47-b7b3-03d05f4ec34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:54.604726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db1d47-972b-4a47-b7b3-03d05f4ec34f admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:54.605132 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db1d47-972b-4a47-b7b3-03d05f4ec34f admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:54.605482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db1d47-972b-4a47-b7b3-03d05f4ec34f admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:54.606272 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db1d47-972b-4a47-b7b3-03d05f4ec34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:54.611957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db1d47-972b-4a47-b7b3-03d05f4ec34f admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:54.669334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 821/1659] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:48:54 2022] POST /identity/v3/users => generated 300 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:54.670093 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af4ddb-30bf-4592-89e0-917f1e0880b3 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:54.689389 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af4ddb-30bf-4592-89e0-917f1e0880b3 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:54.700843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc0e4e-2514-4daf-a8cf-2e034b273089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:54.704010 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc0e4e-2514-4daf-a8cf-2e034b273089 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:54.705142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc0e4e-2514-4daf-a8cf-2e034b273089 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:54.707314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc0e4e-2514-4daf-a8cf-2e034b273089 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:54.709235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc0e4e-2514-4daf-a8cf-2e034b273089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:54.715000 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc0e4e-2514-4daf-a8cf-2e034b273089 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:54.761057 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db1d47-972b-4a47-b7b3-03d05f4ec34f admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:54.771654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 839/1660] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:48:54.786195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db1d47-972b-4a47-b7b3-03d05f4ec34f admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:54.802752 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9fe6a-7707-4991-84c0-a8ae921dba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:54.806935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9fe6a-7707-4991-84c0-a8ae921dba98 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:54.806935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9fe6a-7707-4991-84c0-a8ae921dba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:54.806935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9fe6a-7707-4991-84c0-a8ae921dba98 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:54.816813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9fe6a-7707-4991-84c0-a8ae921dba98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:54.822034 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9fe6a-7707-4991-84c0-a8ae921dba98 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:54.858740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc0e4e-2514-4daf-a8cf-2e034b273089 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:54.864457 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 822/1661] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:54.871839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc0e4e-2514-4daf-a8cf-2e034b273089 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:54.889601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2698da-41fc-41ea-baf6-3936342e7c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:54.891697 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2698da-41fc-41ea-baf6-3936342e7c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:54.892148 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2698da-41fc-41ea-baf6-3936342e7c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:54.894116 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2698da-41fc-41ea-baf6-3936342e7c20 admin admin] PATH_INFO: `/v3/projects/aadf2d89a9594ff4bcd296fad9dc3b74/users/27d6ba1d18d844e99ae2c5e5e09be462/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:54.949185 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2698da-41fc-41ea-baf6-3936342e7c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aadf2d89a9594ff4bcd296fad9dc3b74, user_id=27d6ba1d18d844e99ae2c5e5e09be462, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:54.958207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2698da-41fc-41ea-baf6-3936342e7c20 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:55.003176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d917b1-572b-498d-900b-ec4900425a2f None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:55.003477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d917b1-572b-498d-900b-ec4900425a2f None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:55.003751 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d917b1-572b-498d-900b-ec4900425a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:55.005759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 840/1662] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:54 2022] PUT /identity/v3/projects/aadf2d89a9594ff4bcd296fad9dc3b74/users/27d6ba1d18d844e99ae2c5e5e09be462/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:48:55.080191 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-15d917b1-572b-498d-900b-ec4900425a2f None None] MFA Rules not processed for user `27d6ba1d18d844e99ae2c5e5e09be462`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:55.085053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-15d917b1-572b-498d-900b-ec4900425a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:55.244879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2698da-41fc-41ea-baf6-3936342e7c20 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:55.250947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 823/1663] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:55.375664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2698da-41fc-41ea-baf6-3936342e7c20 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:55.381487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e86fe1-1a14-417d-9cf8-157ee8a25183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:55.382407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e86fe1-1a14-417d-9cf8-157ee8a25183 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:55.382898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e86fe1-1a14-417d-9cf8-157ee8a25183 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:55.383365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e86fe1-1a14-417d-9cf8-157ee8a25183 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:55.384218 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e86fe1-1a14-417d-9cf8-157ee8a25183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:55.386324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e86fe1-1a14-417d-9cf8-157ee8a25183 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:55.433503 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 841/1664] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:48:55 2022] POST /identity/v3/projects => generated 401 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:55.435472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d917b1-572b-498d-900b-ec4900425a2f None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:55.451269 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d917b1-572b-498d-900b-ec4900425a2f None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:55.474740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:55.612186 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf16206-932e-457b-9373-5d7c3855ab05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:55.612899 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf16206-932e-457b-9373-5d7c3855ab05 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:55.613185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf16206-932e-457b-9373-5d7c3855ab05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:55.613463 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf16206-932e-457b-9373-5d7c3855ab05 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:55.614180 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf16206-932e-457b-9373-5d7c3855ab05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:55.616573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf16206-932e-457b-9373-5d7c3855ab05 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:55.686314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 824/1665] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:48:55 2022] POST /identity/v3/users => generated 307 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:48:55.688068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e86fe1-1a14-417d-9cf8-157ee8a25183 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:55.707631 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e86fe1-1a14-417d-9cf8-157ee8a25183 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:55.730024 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ebbed-8fcd-414e-912e-49324cbac3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:55.730918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebbed-8fcd-414e-912e-49324cbac3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:55.731326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebbed-8fcd-414e-912e-49324cbac3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:55.731702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebbed-8fcd-414e-912e-49324cbac3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:55.740134 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ebbed-8fcd-414e-912e-49324cbac3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:55.742963 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ebbed-8fcd-414e-912e-49324cbac3d0 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:55.803508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 842/1666] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:55.805565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf16206-932e-457b-9373-5d7c3855ab05 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:55.821272 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf16206-932e-457b-9373-5d7c3855ab05 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:55.848756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d82be-76dd-4916-8aec-91adf3eea84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:55.851504 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d82be-76dd-4916-8aec-91adf3eea84d admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:55.851872 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d82be-76dd-4916-8aec-91adf3eea84d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:55.854794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d82be-76dd-4916-8aec-91adf3eea84d admin admin] PATH_INFO: `/v3/projects/ab7bca48db194fc5ad3fd093c2fe0709/users/6f8e6c72dc204ced943138048435ae30/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:55.927598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d82be-76dd-4916-8aec-91adf3eea84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7bca48db194fc5ad3fd093c2fe0709, user_id=6f8e6c72dc204ced943138048435ae30, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:55.942142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ebbed-8fcd-414e-912e-49324cbac3d0 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:55.943891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d82be-76dd-4916-8aec-91adf3eea84d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:55.945341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ab6ebbed-8fcd-414e-912e-49324cbac3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:55.982529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ebbed-8fcd-414e-912e-49324cbac3d0 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:56.001363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 825/1667] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:55 2022] PUT /identity/v3/projects/ab7bca48db194fc5ad3fd093c2fe0709/users/6f8e6c72dc204ced943138048435ae30/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:56.003302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d82be-76dd-4916-8aec-91adf3eea84d admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:56.242919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d82be-76dd-4916-8aec-91adf3eea84d admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:56.256001 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362438c9-8ba2-4c6a-a9b1-6080a8eb7b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:56.256954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362438c9-8ba2-4c6a-a9b1-6080a8eb7b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:56.257231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362438c9-8ba2-4c6a-a9b1-6080a8eb7b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:56.257474 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362438c9-8ba2-4c6a-a9b1-6080a8eb7b82 admin admin] PATH_INFO: `/v3/users/2b7d3af2c65145769b47d8e7accd0aa2` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:56.259797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362438c9-8ba2-4c6a-a9b1-6080a8eb7b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7d3af2c65145769b47d8e7accd0aa2)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:56.260390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122dbcc-e786-4e75-9ce3-30bb996901db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:56.260849 dv-cinder-846842-7-smb devstack@keystone.service[87040]: WARNING py.warnings [None req-362438c9-8ba2-4c6a-a9b1-6080a8eb7b82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 03:48:56.260849 dv-cinder-846842-7-smb devstack@keystone.service[87040]: warnings.warn(msg) Jun 30 03:48:56.260849 dv-cinder-846842-7-smb devstack@keystone.service[87040]: Jun 30 03:48:56.261326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122dbcc-e786-4e75-9ce3-30bb996901db admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:56.261593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122dbcc-e786-4e75-9ce3-30bb996901db admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:56.261877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122dbcc-e786-4e75-9ce3-30bb996901db admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:56.262082 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362438c9-8ba2-4c6a-a9b1-6080a8eb7b82 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:56.262624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122dbcc-e786-4e75-9ce3-30bb996901db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:56.270783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122dbcc-e786-4e75-9ce3-30bb996901db admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:56.287459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:56.308605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 826/1668] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:48:56.312697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122dbcc-e786-4e75-9ce3-30bb996901db admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:56.340381 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122dbcc-e786-4e75-9ce3-30bb996901db admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:56.360387 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027093ea-81cf-443d-8233-ebc94a9f4610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:56.361359 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027093ea-81cf-443d-8233-ebc94a9f4610 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:56.361643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027093ea-81cf-443d-8233-ebc94a9f4610 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:56.361969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027093ea-81cf-443d-8233-ebc94a9f4610 admin admin] PATH_INFO: `/v3/projects/ab7bca48db194fc5ad3fd093c2fe0709/users/6f8e6c72dc204ced943138048435ae30/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:56.367421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027093ea-81cf-443d-8233-ebc94a9f4610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7bca48db194fc5ad3fd093c2fe0709, user_id=6f8e6c72dc204ced943138048435ae30, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:56.370390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027093ea-81cf-443d-8233-ebc94a9f4610 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:56.405988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 827/1669] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:48:56 2022] PUT /identity/v3/projects/ab7bca48db194fc5ad3fd093c2fe0709/users/6f8e6c72dc204ced943138048435ae30/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:56.418865 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe5753-953d-4044-a81a-2471092a10ff None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:56.419116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe5753-953d-4044-a81a-2471092a10ff None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:56.419424 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe5753-953d-4044-a81a-2471092a10ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:56.473288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-362438c9-8ba2-4c6a-a9b1-6080a8eb7b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7d3af2c65145769b47d8e7accd0aa2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:56.505014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-9afe5753-953d-4044-a81a-2471092a10ff None None] MFA Rules not processed for user `6f8e6c72dc204ced943138048435ae30`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:56.506909 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9afe5753-953d-4044-a81a-2471092a10ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:56.535992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-362438c9-8ba2-4c6a-a9b1-6080a8eb7b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7d3af2c65145769b47d8e7accd0aa2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:56.537062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-362438c9-8ba2-4c6a-a9b1-6080a8eb7b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7d3af2c65145769b47d8e7accd0aa2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:56.580998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-362438c9-8ba2-4c6a-a9b1-6080a8eb7b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7d3af2c65145769b47d8e7accd0aa2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:56.582111 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-362438c9-8ba2-4c6a-a9b1-6080a8eb7b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7d3af2c65145769b47d8e7accd0aa2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:56.602553 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:56.618845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 843/1670] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:48:55 2022] DELETE /identity/v3/users/2b7d3af2c65145769b47d8e7accd0aa2 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:48:56.621250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915633a-f8a5-4fe1-95a9-c01b4723f030 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:56.621965 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915633a-f8a5-4fe1-95a9-c01b4723f030 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:56.623042 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915633a-f8a5-4fe1-95a9-c01b4723f030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:56.665431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 828/1671] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:48:56.667206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6915633a-f8a5-4fe1-95a9-c01b4723f030 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:56.668878 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6915633a-f8a5-4fe1-95a9-c01b4723f030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:56.677116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe5753-953d-4044-a81a-2471092a10ff None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:56.679443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9afe5753-953d-4044-a81a-2471092a10ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:56.798687 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 844/1672] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:48:56.810576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe5753-953d-4044-a81a-2471092a10ff None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:56.839925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915633a-f8a5-4fe1-95a9-c01b4723f030 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:56.843202 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6915633a-f8a5-4fe1-95a9-c01b4723f030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:56.952563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119c0de-2e14-49b1-b576-ade3089d99ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:56.953876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119c0de-2e14-49b1-b576-ade3089d99ba service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:56.954363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119c0de-2e14-49b1-b576-ade3089d99ba service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:56.954860 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119c0de-2e14-49b1-b576-ade3089d99ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:57.069632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915633a-f8a5-4fe1-95a9-c01b4723f030 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:57.091210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509f79b-6bdf-47d6-97c7-daa70f760a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:57.092558 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509f79b-6bdf-47d6-97c7-daa70f760a96 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:57.097184 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509f79b-6bdf-47d6-97c7-daa70f760a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:57.097615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509f79b-6bdf-47d6-97c7-daa70f760a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:57.111154 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119c0de-2e14-49b1-b576-ade3089d99ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:57.115014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119c0de-2e14-49b1-b576-ade3089d99ba service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:57.125260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509f79b-6bdf-47d6-97c7-daa70f760a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:57.135955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509f79b-6bdf-47d6-97c7-daa70f760a96 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:57.165540 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 829/1673] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:57.197154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 845/1674] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:48:57.320538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119c0de-2e14-49b1-b576-ade3089d99ba service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:57.329763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119c0de-2e14-49b1-b576-ade3089d99ba service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:57.333535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fc574-9cea-4fc4-8677-7eb5f67b1288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:57.334203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fc574-9cea-4fc4-8677-7eb5f67b1288 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:57.334485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fc574-9cea-4fc4-8677-7eb5f67b1288 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:57.334788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fc574-9cea-4fc4-8677-7eb5f67b1288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:57.336756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-012fc574-9cea-4fc4-8677-7eb5f67b1288 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:57.340183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509f79b-6bdf-47d6-97c7-daa70f760a96 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:57.344825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5509f79b-6bdf-47d6-97c7-daa70f760a96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:57.375069 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509f79b-6bdf-47d6-97c7-daa70f760a96 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:57.397551 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d1037-6e7b-41c0-9ec4-820b7ef6bbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:57.398571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d1037-6e7b-41c0-9ec4-820b7ef6bbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:57.398972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d1037-6e7b-41c0-9ec4-820b7ef6bbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:57.400845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d1037-6e7b-41c0-9ec4-820b7ef6bbc3 admin admin] PATH_INFO: `/v3/users/82724a300bde4708a41c04ace13167c4` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:57.403995 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d1037-6e7b-41c0-9ec4-820b7ef6bbc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82724a300bde4708a41c04ace13167c4)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:57.414430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d1037-6e7b-41c0-9ec4-820b7ef6bbc3 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:57.471932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:57.488111 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:57.502298 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fc574-9cea-4fc4-8677-7eb5f67b1288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:57.508217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fc574-9cea-4fc4-8677-7eb5f67b1288 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:57.546321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 830/1675] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:57.554483 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9d4d1037-6e7b-41c0-9ec4-820b7ef6bbc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82724a300bde4708a41c04ace13167c4'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:57.584565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9d4d1037-6e7b-41c0-9ec4-820b7ef6bbc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82724a300bde4708a41c04ace13167c4'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:57.585438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9d4d1037-6e7b-41c0-9ec4-820b7ef6bbc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82724a300bde4708a41c04ace13167c4'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:57.598572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9d4d1037-6e7b-41c0-9ec4-820b7ef6bbc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82724a300bde4708a41c04ace13167c4'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:57.599490 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9d4d1037-6e7b-41c0-9ec4-820b7ef6bbc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82724a300bde4708a41c04ace13167c4'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:57.628490 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 846/1676] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:48:57 2022] DELETE /identity/v3/users/82724a300bde4708a41c04ace13167c4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:57.839667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fc574-9cea-4fc4-8677-7eb5f67b1288 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:57.841146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-012fc574-9cea-4fc4-8677-7eb5f67b1288 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:57.870464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fc574-9cea-4fc4-8677-7eb5f67b1288 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:58.050169 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835ebfc-561f-4f9f-aab7-a1cb677204d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:58.054701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835ebfc-561f-4f9f-aab7-a1cb677204d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:58.058083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835ebfc-561f-4f9f-aab7-a1cb677204d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:58.060870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835ebfc-561f-4f9f-aab7-a1cb677204d7 admin admin] PATH_INFO: `/v3/users/cfaea6cf840e4d51b7451c08a71f0fa7` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:58.064768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835ebfc-561f-4f9f-aab7-a1cb677204d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfaea6cf840e4d51b7451c08a71f0fa7)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:58.069462 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835ebfc-561f-4f9f-aab7-a1cb677204d7 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:58.206920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1835ebfc-561f-4f9f-aab7-a1cb677204d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfaea6cf840e4d51b7451c08a71f0fa7'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:58.240102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1835ebfc-561f-4f9f-aab7-a1cb677204d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfaea6cf840e4d51b7451c08a71f0fa7'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:58.261282 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1835ebfc-561f-4f9f-aab7-a1cb677204d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfaea6cf840e4d51b7451c08a71f0fa7'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:58.263876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1835ebfc-561f-4f9f-aab7-a1cb677204d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfaea6cf840e4d51b7451c08a71f0fa7'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:58.264630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1835ebfc-561f-4f9f-aab7-a1cb677204d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfaea6cf840e4d51b7451c08a71f0fa7'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:58.311680 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 831/1677] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:48:57 2022] DELETE /identity/v3/users/cfaea6cf840e4d51b7451c08a71f0fa7 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:58.313333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a94b69-9021-4b29-ae63-d74c8f4253c7 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:58.313814 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a94b69-9021-4b29-ae63-d74c8f4253c7 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:58.314100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a94b69-9021-4b29-ae63-d74c8f4253c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:58.354398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-90a94b69-9021-4b29-ae63-d74c8f4253c7 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:58.355699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-90a94b69-9021-4b29-ae63-d74c8f4253c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:58.522830 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 847/1678] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:58.560976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835ebfc-561f-4f9f-aab7-a1cb677204d7 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:58.564809 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16456494-0444-467a-9d22-2da7330569b1 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:58.565399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16456494-0444-467a-9d22-2da7330569b1 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:58.566380 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16456494-0444-467a-9d22-2da7330569b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:58.567514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-1835ebfc-561f-4f9f-aab7-a1cb677204d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:58.651569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-16456494-0444-467a-9d22-2da7330569b1 None None] MFA Rules not processed for user `825dd3922747496b88f0718b069abc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:58.657902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-16456494-0444-467a-9d22-2da7330569b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:58.758000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835ebfc-561f-4f9f-aab7-a1cb677204d7 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:58.778230 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfe54b-321f-4c70-a536-f9453b7d02f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:58.778555 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe54b-321f-4c70-a536-f9453b7d02f4 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:58.778825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe54b-321f-4c70-a536-f9453b7d02f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:58.779117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe54b-321f-4c70-a536-f9453b7d02f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:58.816431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfe54b-321f-4c70-a536-f9453b7d02f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:58.823089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfe54b-321f-4c70-a536-f9453b7d02f4 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:58.860918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 832/1679] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:58.890708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 848/1680] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:58.905543 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e504dfe-825d-484d-8f30-6e9ee644c1e9 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:58.905820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e504dfe-825d-484d-8f30-6e9ee644c1e9 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:58.906075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e504dfe-825d-484d-8f30-6e9ee644c1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:58.908586 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16456494-0444-467a-9d22-2da7330569b1 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:58.910864 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-16456494-0444-467a-9d22-2da7330569b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:58.940803 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16456494-0444-467a-9d22-2da7330569b1 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:58.943640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6e504dfe-825d-484d-8f30-6e9ee644c1e9 None None] MFA Rules not processed for user `825dd3922747496b88f0718b069abc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:48:58.944876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6e504dfe-825d-484d-8f30-6e9ee644c1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:58.951305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:58.952221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:58.952508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:58.952784 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] PATH_INFO: `/v3/projects/14a8d115c00447a3974ec9c32ad866d9` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:58.954592 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a8d115c00447a3974ec9c32ad866d9)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:58.956596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:58.968605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 833/1681] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:48:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:48:58.981366 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e504dfe-825d-484d-8f30-6e9ee644c1e9 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:58.982351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6e504dfe-825d-484d-8f30-6e9ee644c1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:58.992843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:58.996667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:59.044215 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a8d115c00447a3974ec9c32ad866d9', 'request_id': 'req-4564125d-c226-4012-b9ca-08ac528b46d5'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:59.062698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a8d115c00447a3974ec9c32ad866d9', 'request_id': 'req-4564125d-c226-4012-b9ca-08ac528b46d5'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:59.073503 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a8d115c00447a3974ec9c32ad866d9', 'request_id': 'req-4564125d-c226-4012-b9ca-08ac528b46d5'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:59.092454 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e504dfe-825d-484d-8f30-6e9ee644c1e9 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:59.100225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] The token cache is being invalidate because project 14a8d115c00447a3974ec9c32ad866d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:48:59.100550 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:59.101769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:59.105647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 849/1682] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:48:58 2022] DELETE /identity/v3/projects/14a8d115c00447a3974ec9c32ad866d9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:48:59.109971 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:59.112555 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:59.242364 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf0695-a236-4860-a6e8-c0d7aa5f3444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:59.247475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf0695-a236-4860-a6e8-c0d7aa5f3444 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:59.248869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf0695-a236-4860-a6e8-c0d7aa5f3444 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:59.249847 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf0695-a236-4860-a6e8-c0d7aa5f3444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:59.257829 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-b4bf0695-a236-4860-a6e8-c0d7aa5f3444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:59.265595 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564125d-c226-4012-b9ca-08ac528b46d5 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:59.279179 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547332f-7fbd-4069-9f44-6d5f38432625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:59.280932 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547332f-7fbd-4069-9f44-6d5f38432625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:59.281315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547332f-7fbd-4069-9f44-6d5f38432625 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:59.282019 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547332f-7fbd-4069-9f44-6d5f38432625 admin admin] PATH_INFO: `/v3/users/5557ad4a065049a295c8fdc1e5e8fdea` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:59.284461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547332f-7fbd-4069-9f44-6d5f38432625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5557ad4a065049a295c8fdc1e5e8fdea)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:59.289959 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547332f-7fbd-4069-9f44-6d5f38432625 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:59.412988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-0547332f-7fbd-4069-9f44-6d5f38432625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5557ad4a065049a295c8fdc1e5e8fdea'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:59.441700 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-0547332f-7fbd-4069-9f44-6d5f38432625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5557ad4a065049a295c8fdc1e5e8fdea'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:59.443545 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-0547332f-7fbd-4069-9f44-6d5f38432625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5557ad4a065049a295c8fdc1e5e8fdea'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:59.456826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf0695-a236-4860-a6e8-c0d7aa5f3444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:59.461078 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf0695-a236-4860-a6e8-c0d7aa5f3444 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:48:59.464682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-0547332f-7fbd-4069-9f44-6d5f38432625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5557ad4a065049a295c8fdc1e5e8fdea'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:59.466583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-0547332f-7fbd-4069-9f44-6d5f38432625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5557ad4a065049a295c8fdc1e5e8fdea'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:48:59.496638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 850/1683] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:48:59 2022] DELETE /identity/v3/users/5557ad4a065049a295c8fdc1e5e8fdea => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:48:59.504968 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 834/1684] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:48:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:48:59.773519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547332f-7fbd-4069-9f44-6d5f38432625 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:48:59.775431 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0547332f-7fbd-4069-9f44-6d5f38432625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:48:59.851871 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:48:59.927482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547332f-7fbd-4069-9f44-6d5f38432625 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:48:59.939774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:48:59.940686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:48:59.940975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:48:59.941534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] PATH_INFO: `/v3/projects/cd4c421db4ba4b8283eaeddc9ae1a204` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:48:59.945622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4c421db4ba4b8283eaeddc9ae1a204)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:48:59.947877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:00.063704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4c421db4ba4b8283eaeddc9ae1a204', 'request_id': 'req-3bf17bcb-2643-4359-8017-cc2468b24307'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.094603 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4c421db4ba4b8283eaeddc9ae1a204', 'request_id': 'req-3bf17bcb-2643-4359-8017-cc2468b24307'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.103852 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4c421db4ba4b8283eaeddc9ae1a204', 'request_id': 'req-3bf17bcb-2643-4359-8017-cc2468b24307'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.144687 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] The token cache is being invalidate because project cd4c421db4ba4b8283eaeddc9ae1a204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:00.147618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.150054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.161203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 851/1685] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:48:59 2022] DELETE /identity/v3/projects/cd4c421db4ba4b8283eaeddc9ae1a204 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:00.162355 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf0695-a236-4860-a6e8-c0d7aa5f3444 service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:00.164083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-b4bf0695-a236-4860-a6e8-c0d7aa5f3444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:00.170676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:00.172423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:00.191914 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf0695-a236-4860-a6e8-c0d7aa5f3444 service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:00.315823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:00.349168 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b274fd-b356-44c2-907b-e6624f945f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:00.350078 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b274fd-b356-44c2-907b-e6624f945f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:00.350364 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b274fd-b356-44c2-907b-e6624f945f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:00.350639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b274fd-b356-44c2-907b-e6624f945f88 admin admin] PATH_INFO: `/v3/users/20f6cef70d424b1dbc20efe43da06363` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:00.352474 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf17bcb-2643-4359-8017-cc2468b24307 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:00.353339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b274fd-b356-44c2-907b-e6624f945f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f6cef70d424b1dbc20efe43da06363)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:00.357698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b274fd-b356-44c2-907b-e6624f945f88 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:00.367287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:00.367287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:00.367287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:00.367618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a admin admin] PATH_INFO: `/v3/projects/2320bbb4a49349c79a2c2e9aade43d51` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:00.374908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2320bbb4a49349c79a2c2e9aade43d51)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:00.380294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:00.489728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d4b274fd-b356-44c2-907b-e6624f945f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f6cef70d424b1dbc20efe43da06363'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.510609 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d4b274fd-b356-44c2-907b-e6624f945f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f6cef70d424b1dbc20efe43da06363'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.519757 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2320bbb4a49349c79a2c2e9aade43d51', 'request_id': 'req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.541438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d4b274fd-b356-44c2-907b-e6624f945f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f6cef70d424b1dbc20efe43da06363'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.541953 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2320bbb4a49349c79a2c2e9aade43d51', 'request_id': 'req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.542202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d4b274fd-b356-44c2-907b-e6624f945f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f6cef70d424b1dbc20efe43da06363'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.544150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d4b274fd-b356-44c2-907b-e6624f945f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f6cef70d424b1dbc20efe43da06363'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.552038 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2320bbb4a49349c79a2c2e9aade43d51', 'request_id': 'req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.555697 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:00.574433 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a admin admin] The token cache is being invalidate because project 2320bbb4a49349c79a2c2e9aade43d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:00.574653 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 835/1686] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:00 2022] DELETE /identity/v3/users/20f6cef70d424b1dbc20efe43da06363 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:00.575208 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.575958 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991e099-187f-48c5-a144-8c72573fcc8e None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:00.576248 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991e099-187f-48c5-a144-8c72573fcc8e None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:00.576528 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991e099-187f-48c5-a144-8c72573fcc8e None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:00.580422 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 836/1687] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jun 30 03:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:49:00.589729 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-51d5af0a-c371-4ee0-bfe0-e81bd3182e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:00.591386 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e1c63-7230-43c5-8ea6-89e3cb151da6 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:00.591747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e1c63-7230-43c5-8ea6-89e3cb151da6 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:00.592238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e1c63-7230-43c5-8ea6-89e3cb151da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:00.593301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 852/1688] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:00 2022] DELETE /identity/v3/projects/2320bbb4a49349c79a2c2e9aade43d51 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:00.598631 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020752a2-1ac6-4fa9-b8c5-ee22a4b3dda6 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:00.599670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020752a2-1ac6-4fa9-b8c5-ee22a4b3dda6 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:00.600272 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020752a2-1ac6-4fa9-b8c5-ee22a4b3dda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:00.685841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-8c0e1c63-7230-43c5-8ea6-89e3cb151da6 None None] MFA Rules not processed for user `b3aa7416101948aba0b45129174cd988`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:00.687259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8c0e1c63-7230-43c5-8ea6-89e3cb151da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:00.688367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-020752a2-1ac6-4fa9-b8c5-ee22a4b3dda6 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:00.689957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-020752a2-1ac6-4fa9-b8c5-ee22a4b3dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:00.815196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 837/1689] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:49:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:00.816079 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e1c63-7230-43c5-8ea6-89e3cb151da6 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:00.817426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8c0e1c63-7230-43c5-8ea6-89e3cb151da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:00.866777 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 853/1690] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:00.867948 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020752a2-1ac6-4fa9-b8c5-ee22a4b3dda6 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:00.874107 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-020752a2-1ac6-4fa9-b8c5-ee22a4b3dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:00.916117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020752a2-1ac6-4fa9-b8c5-ee22a4b3dda6 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:00.931120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62410d2-b4bc-4190-acd9-4177aa8023d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:00.934693 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62410d2-b4bc-4190-acd9-4177aa8023d1 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:00.935197 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62410d2-b4bc-4190-acd9-4177aa8023d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:00.936453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62410d2-b4bc-4190-acd9-4177aa8023d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:00.956037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:00.966285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62410d2-b4bc-4190-acd9-4177aa8023d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:00.967600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e1c63-7230-43c5-8ea6-89e3cb151da6 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:00.971378 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62410d2-b4bc-4190-acd9-4177aa8023d1 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:00.978901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:00.979949 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:00.980921 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:00.983842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476 admin admin] PATH_INFO: `/v3/projects/be6743e7f9c24f248f9298757bb66d93` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:00.986809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6743e7f9c24f248f9298757bb66d93)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:00.993763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:01.004331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 854/1691] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:01.005090 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84a7c7-4ba5-481e-9fca-e8ff588e5e57 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:01.007773 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84a7c7-4ba5-481e-9fca-e8ff588e5e57 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:01.008896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84a7c7-4ba5-481e-9fca-e8ff588e5e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:01.066675 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-5b84a7c7-4ba5-481e-9fca-e8ff588e5e57 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:01.070427 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5b84a7c7-4ba5-481e-9fca-e8ff588e5e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:01.095958 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 855/1692] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:01.100666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84a7c7-4ba5-481e-9fca-e8ff588e5e57 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:01.119873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6743e7f9c24f248f9298757bb66d93', 'request_id': 'req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:01.139415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84a7c7-4ba5-481e-9fca-e8ff588e5e57 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:01.140374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6743e7f9c24f248f9298757bb66d93', 'request_id': 'req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:01.160460 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6743e7f9c24f248f9298757bb66d93', 'request_id': 'req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:01.192329 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476 admin admin] The token cache is being invalidate because project be6743e7f9c24f248f9298757bb66d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:01.192989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:01.193350 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f2c3ae70-89c1-43d8-85e5-507f8d9c7476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:01.195020 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 838/1693] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:00 2022] DELETE /identity/v3/projects/be6743e7f9c24f248f9298757bb66d93 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:01.199991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77314034-9e48-4e4b-bc06-24ac7564e657 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:01.200257 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77314034-9e48-4e4b-bc06-24ac7564e657 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:01.200875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77314034-9e48-4e4b-bc06-24ac7564e657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:01.259465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-77314034-9e48-4e4b-bc06-24ac7564e657 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:01.264826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-77314034-9e48-4e4b-bc06-24ac7564e657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:01.331924 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eca6e-be90-4a68-8cae-2f6652a6ac2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:01.332788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eca6e-be90-4a68-8cae-2f6652a6ac2e admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:01.333356 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eca6e-be90-4a68-8cae-2f6652a6ac2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:01.333356 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eca6e-be90-4a68-8cae-2f6652a6ac2e admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:01.334120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22eca6e-be90-4a68-8cae-2f6652a6ac2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:01.334430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22eca6e-be90-4a68-8cae-2f6652a6ac2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:01.344868 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22eca6e-be90-4a68-8cae-2f6652a6ac2e admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:01.389562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 856/1694] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:49:01.394292 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eca6e-be90-4a68-8cae-2f6652a6ac2e admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:01.398914 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c22eca6e-be90-4a68-8cae-2f6652a6ac2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:01.430635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eca6e-be90-4a68-8cae-2f6652a6ac2e admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:01.440447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 839/1695] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:01.443840 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bff29-1d0d-4ac6-88be-4a052de74c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:01.444903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bff29-1d0d-4ac6-88be-4a052de74c65 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:01.445383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bff29-1d0d-4ac6-88be-4a052de74c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:01.445922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bff29-1d0d-4ac6-88be-4a052de74c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:01.446861 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bff29-1d0d-4ac6-88be-4a052de74c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:01.448220 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e567fe-172f-44dd-83fb-7246445dd47f None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:01.449028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e567fe-172f-44dd-83fb-7246445dd47f None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:01.449028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e567fe-172f-44dd-83fb-7246445dd47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:01.452436 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bff29-1d0d-4ac6-88be-4a052de74c65 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:01.487926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-81e567fe-172f-44dd-83fb-7246445dd47f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:01.491159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-81e567fe-172f-44dd-83fb-7246445dd47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:01.530356 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 840/1696] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:01.532250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e567fe-172f-44dd-83fb-7246445dd47f None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:01.552908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 857/1697] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:01 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:49:01.556842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bff29-1d0d-4ac6-88be-4a052de74c65 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:01.557086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e567fe-172f-44dd-83fb-7246445dd47f None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:01.679883 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:01.726613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bff29-1d0d-4ac6-88be-4a052de74c65 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:01.729972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97822848-972d-4a0a-8618-01776d96b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:01.730670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97822848-972d-4a0a-8618-01776d96b13a admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:01.732008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97822848-972d-4a0a-8618-01776d96b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:01.732948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97822848-972d-4a0a-8618-01776d96b13a admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:01.733735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97822848-972d-4a0a-8618-01776d96b13a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:01.734051 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97822848-972d-4a0a-8618-01776d96b13a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:01.736486 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80105c9-00d0-48c6-8f35-dd6aff3aaaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:01.737610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80105c9-00d0-48c6-8f35-dd6aff3aaaea admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:01.738046 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80105c9-00d0-48c6-8f35-dd6aff3aaaea admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:01.738722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80105c9-00d0-48c6-8f35-dd6aff3aaaea admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:01.739759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80105c9-00d0-48c6-8f35-dd6aff3aaaea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:01.741009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97822848-972d-4a0a-8618-01776d96b13a admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:01.742647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80105c9-00d0-48c6-8f35-dd6aff3aaaea admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:01.773397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 841/1698] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:01.780375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97822848-972d-4a0a-8618-01776d96b13a admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:01.783291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 858/1699] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:01 2022] POST /identity/v3/users => generated 302 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:01.787727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80105c9-00d0-48c6-8f35-dd6aff3aaaea admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:01.814653 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97822848-972d-4a0a-8618-01776d96b13a admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:01.815401 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80105c9-00d0-48c6-8f35-dd6aff3aaaea admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:01.823996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3eb948-7bdb-4c49-a061-f9de8489ae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:01.825451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3eb948-7bdb-4c49-a061-f9de8489ae09 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:01.826439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3eb948-7bdb-4c49-a061-f9de8489ae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:01.826439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3eb948-7bdb-4c49-a061-f9de8489ae09 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:01.827639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3eb948-7bdb-4c49-a061-f9de8489ae09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:01.827792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68c050-faf0-402e-806a-8e64fc879d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:01.828481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68c050-faf0-402e-806a-8e64fc879d52 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:01.828821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68c050-faf0-402e-806a-8e64fc879d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:01.829103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68c050-faf0-402e-806a-8e64fc879d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:01.829810 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68c050-faf0-402e-806a-8e64fc879d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:01.830108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3eb948-7bdb-4c49-a061-f9de8489ae09 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:01.832464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68c050-faf0-402e-806a-8e64fc879d52 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:01.883597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:01.899687 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 859/1700] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:01.913564 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3eb948-7bdb-4c49-a061-f9de8489ae09 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:01.913749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 842/1701] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:01 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:01.914713 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68c050-faf0-402e-806a-8e64fc879d52 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:01.933231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3eb948-7bdb-4c49-a061-f9de8489ae09 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:02.123919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88253876-7afa-487c-aec4-3c2babe58b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:02.124633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88253876-7afa-487c-aec4-3c2babe58b3a admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:02.124920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88253876-7afa-487c-aec4-3c2babe58b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:02.125198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88253876-7afa-487c-aec4-3c2babe58b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:02.126012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88253876-7afa-487c-aec4-3c2babe58b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:02.127614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88253876-7afa-487c-aec4-3c2babe58b3a admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:02.131957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68c050-faf0-402e-806a-8e64fc879d52 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:02.154727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8404e88-2e02-4095-9a86-890df4f8323c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:02.156558 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8404e88-2e02-4095-9a86-890df4f8323c admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:02.156993 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8404e88-2e02-4095-9a86-890df4f8323c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:02.157404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8404e88-2e02-4095-9a86-890df4f8323c admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:02.158284 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8404e88-2e02-4095-9a86-890df4f8323c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:02.160062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 860/1702] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:02.160988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88253876-7afa-487c-aec4-3c2babe58b3a admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:02.161579 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8404e88-2e02-4095-9a86-890df4f8323c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:02.190744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88253876-7afa-487c-aec4-3c2babe58b3a admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:02.196678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383610b-7c1a-439d-bd20-8de628a020ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:02.197605 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383610b-7c1a-439d-bd20-8de628a020ff admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:02.197891 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383610b-7c1a-439d-bd20-8de628a020ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:02.198166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383610b-7c1a-439d-bd20-8de628a020ff admin admin] PATH_INFO: `/v3/projects/5044b630ac8f48dbbe91f4bd36873923/users/c71558a38e3d4e10a11227099fedf216/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:02.217756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 843/1703] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:01 2022] POST /identity/v3/users => generated 282 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:49:02.219089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8404e88-2e02-4095-9a86-890df4f8323c admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:02.246835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8404e88-2e02-4095-9a86-890df4f8323c admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:02.257186 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383610b-7c1a-439d-bd20-8de628a020ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5044b630ac8f48dbbe91f4bd36873923, user_id=c71558a38e3d4e10a11227099fedf216, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:02.260534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d184a-3929-434e-bf34-29448dc7b538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:02.261296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d184a-3929-434e-bf34-29448dc7b538 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:02.261636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d184a-3929-434e-bf34-29448dc7b538 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:02.261758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383610b-7c1a-439d-bd20-8de628a020ff admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:02.261917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d184a-3929-434e-bf34-29448dc7b538 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:02.262704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d184a-3929-434e-bf34-29448dc7b538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:02.264654 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d184a-3929-434e-bf34-29448dc7b538 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:02.303125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 844/1705] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:02.304412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 861/1705] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:02 2022] PUT /identity/v3/projects/5044b630ac8f48dbbe91f4bd36873923/users/c71558a38e3d4e10a11227099fedf216/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:02.305223 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db8dcb-32ae-4222-b06e-996e3528aa10 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:02.305521 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db8dcb-32ae-4222-b06e-996e3528aa10 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:02.305812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db8dcb-32ae-4222-b06e-996e3528aa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:02.306809 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383610b-7c1a-439d-bd20-8de628a020ff admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:02.380775 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-40db8dcb-32ae-4222-b06e-996e3528aa10 None None] MFA Rules not processed for user `c71558a38e3d4e10a11227099fedf216`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:02.382741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-40db8dcb-32ae-4222-b06e-996e3528aa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:02.448419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383610b-7c1a-439d-bd20-8de628a020ff admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:02.456517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fae0f3-b4cc-4854-98c6-5b86d862e14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:02.457286 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fae0f3-b4cc-4854-98c6-5b86d862e14b admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:02.457645 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fae0f3-b4cc-4854-98c6-5b86d862e14b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:02.457989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fae0f3-b4cc-4854-98c6-5b86d862e14b admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:02.458832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fae0f3-b4cc-4854-98c6-5b86d862e14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:02.463141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fae0f3-b4cc-4854-98c6-5b86d862e14b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:02.494414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 862/1706] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:02.498620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fae0f3-b4cc-4854-98c6-5b86d862e14b admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:02.508997 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fae0f3-b4cc-4854-98c6-5b86d862e14b admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:02.529511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5817ce-359c-4daa-ad27-c8a165c5c201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:02.530510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5817ce-359c-4daa-ad27-c8a165c5c201 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:02.530891 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5817ce-359c-4daa-ad27-c8a165c5c201 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:02.531239 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5817ce-359c-4daa-ad27-c8a165c5c201 admin admin] PATH_INFO: `/v3/projects/afa9898f707c43cc8d35c24b3279a565/users/c5618086481a4f809f7d80818474e831/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:02.548397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 845/1707] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:02.549564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db8dcb-32ae-4222-b06e-996e3528aa10 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:02.565105 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5817ce-359c-4daa-ad27-c8a165c5c201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa9898f707c43cc8d35c24b3279a565, user_id=c5618086481a4f809f7d80818474e831, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:02.565945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db8dcb-32ae-4222-b06e-996e3528aa10 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:02.568070 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5817ce-359c-4daa-ad27-c8a165c5c201 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:02.585374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f5918-2291-4e5a-9cab-f2c60eb35cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:02.586273 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f5918-2291-4e5a-9cab-f2c60eb35cbd admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:02.586784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f5918-2291-4e5a-9cab-f2c60eb35cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:02.587132 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f5918-2291-4e5a-9cab-f2c60eb35cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:02.587928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f5918-2291-4e5a-9cab-f2c60eb35cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:02.591185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f5918-2291-4e5a-9cab-f2c60eb35cbd admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:02.599872 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 863/1708] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:02 2022] PUT /identity/v3/projects/afa9898f707c43cc8d35c24b3279a565/users/c5618086481a4f809f7d80818474e831/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:02.617342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997b6f-8196-4e0a-9e39-bc9ec7960253 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:02.617785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997b6f-8196-4e0a-9e39-bc9ec7960253 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:02.618367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997b6f-8196-4e0a-9e39-bc9ec7960253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:02.631267 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:02.634659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 846/1709] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:02 2022] POST /identity/v3/projects => generated 403 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:02.639813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f5918-2291-4e5a-9cab-f2c60eb35cbd admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:02.686755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-a0997b6f-8196-4e0a-9e39-bc9ec7960253 None None] MFA Rules not processed for user `c5618086481a4f809f7d80818474e831`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:02.689545 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a0997b6f-8196-4e0a-9e39-bc9ec7960253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:02.807326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:02.880203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f5918-2291-4e5a-9cab-f2c60eb35cbd admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:02.913536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8336b-bc2d-40d2-aef7-55cf717a41d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:02.914338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8336b-bc2d-40d2-aef7-55cf717a41d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:02.914624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8336b-bc2d-40d2-aef7-55cf717a41d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:02.914937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8336b-bc2d-40d2-aef7-55cf717a41d0 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:02.921009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8336b-bc2d-40d2-aef7-55cf717a41d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:02.925441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8336b-bc2d-40d2-aef7-55cf717a41d0 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:02.969222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 864/1710] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:02.974898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0997b6f-8196-4e0a-9e39-bc9ec7960253 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:02.979145 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 847/1711] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:02 2022] POST /identity/v3/users => generated 308 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:02.984359 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8336b-bc2d-40d2-aef7-55cf717a41d0 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:03.001094 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0997b6f-8196-4e0a-9e39-bc9ec7960253 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:03.015550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8336b-bc2d-40d2-aef7-55cf717a41d0 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:03.032161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8de8c0-6f80-448c-b538-9bcd4abc7f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:03.032862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8de8c0-6f80-448c-b538-9bcd4abc7f16 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:03.033180 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8de8c0-6f80-448c-b538-9bcd4abc7f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:03.033418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8de8c0-6f80-448c-b538-9bcd4abc7f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:03.034160 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8de8c0-6f80-448c-b538-9bcd4abc7f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:03.035821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8de8c0-6f80-448c-b538-9bcd4abc7f16 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:03.036827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c8e38-ab93-46de-a8d1-47cf82bb30c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:03.039062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c8e38-ab93-46de-a8d1-47cf82bb30c6 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:03.041944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c8e38-ab93-46de-a8d1-47cf82bb30c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:03.042471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c8e38-ab93-46de-a8d1-47cf82bb30c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:03.043701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c8e38-ab93-46de-a8d1-47cf82bb30c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:03.047590 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c8e38-ab93-46de-a8d1-47cf82bb30c6 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:03.069473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 848/1712] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:03.071284 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8de8c0-6f80-448c-b538-9bcd4abc7f16 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:03.095124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8de8c0-6f80-448c-b538-9bcd4abc7f16 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:03.117520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b5c0c-ae38-4c9f-a920-85f36d12eae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:03.118479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b5c0c-ae38-4c9f-a920-85f36d12eae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:03.118758 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b5c0c-ae38-4c9f-a920-85f36d12eae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:03.119063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b5c0c-ae38-4c9f-a920-85f36d12eae8 admin admin] PATH_INFO: `/v3/projects/767e5b4018be4026a057734522e62eab/users/f85b4904fe6c4764aa6c8964d4fbaa13/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:03.177973 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b5c0c-ae38-4c9f-a920-85f36d12eae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767e5b4018be4026a057734522e62eab, user_id=f85b4904fe6c4764aa6c8964d4fbaa13, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:03.188255 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b5c0c-ae38-4c9f-a920-85f36d12eae8 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:03.210710 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 865/1713] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:02 2022] POST /identity/v3/projects => generated 363 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:03.215547 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c8e38-ab93-46de-a8d1-47cf82bb30c6 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:03.223725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-450c8e38-ab93-46de-a8d1-47cf82bb30c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:03.232737 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 849/1714] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:03 2022] PUT /identity/v3/projects/767e5b4018be4026a057734522e62eab/users/f85b4904fe6c4764aa6c8964d4fbaa13/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:03.233604 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b5c0c-ae38-4c9f-a920-85f36d12eae8 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:03.432255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c8e38-ab93-46de-a8d1-47cf82bb30c6 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:03.458659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b5c0c-ae38-4c9f-a920-85f36d12eae8 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:03.469999 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ca2d0-ced9-44a4-86d1-4c93fb265b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:03.470617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca2d0-ced9-44a4-86d1-4c93fb265b96 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:03.470934 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca2d0-ced9-44a4-86d1-4c93fb265b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:03.471209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca2d0-ced9-44a4-86d1-4c93fb265b96 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:03.471922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ca2d0-ced9-44a4-86d1-4c93fb265b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:03.477831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ca2d0-ced9-44a4-86d1-4c93fb265b96 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:03.534199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 850/1715] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:03 2022] POST /identity/v3/users => generated 288 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:03.534199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ca2d0-ced9-44a4-86d1-4c93fb265b96 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:03.555198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ca2d0-ced9-44a4-86d1-4c93fb265b96 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:03.570393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ff6d5-332b-4baa-bcfd-39bf535c17da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:03.571129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ff6d5-332b-4baa-bcfd-39bf535c17da admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:03.571411 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ff6d5-332b-4baa-bcfd-39bf535c17da admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:03.571683 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ff6d5-332b-4baa-bcfd-39bf535c17da admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:03.572422 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ff6d5-332b-4baa-bcfd-39bf535c17da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:03.578336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ff6d5-332b-4baa-bcfd-39bf535c17da admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:03.593858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:03.594825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:03.595086 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:03.595360 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] PATH_INFO: `/v3/projects/219c3fcf4faa4acf94b7bb253e9b5f9c` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:03.595498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 851/1716] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:03.596280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ff6d5-332b-4baa-bcfd-39bf535c17da admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:03.598816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=219c3fcf4faa4acf94b7bb253e9b5f9c)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:03.600367 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-db2ff6d5-332b-4baa-bcfd-39bf535c17da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:03.601064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:03.632962 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ff6d5-332b-4baa-bcfd-39bf535c17da admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:03.648047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e4a3b-ae5f-4ce2-9a07-f426db3e75bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:03.649373 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e4a3b-ae5f-4ce2-9a07-f426db3e75bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:03.650134 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e4a3b-ae5f-4ce2-9a07-f426db3e75bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:03.650547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e4a3b-ae5f-4ce2-9a07-f426db3e75bd admin admin] PATH_INFO: `/v3/users/27d6ba1d18d844e99ae2c5e5e09be462` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:03.653122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e4a3b-ae5f-4ce2-9a07-f426db3e75bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d6ba1d18d844e99ae2c5e5e09be462)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:03.655536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e4a3b-ae5f-4ce2-9a07-f426db3e75bd admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:03.666379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:03.718529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219c3fcf4faa4acf94b7bb253e9b5f9c', 'request_id': 'req-7713ef5d-6407-4a73-8829-e5421f6959ed'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:03.740786 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219c3fcf4faa4acf94b7bb253e9b5f9c', 'request_id': 'req-7713ef5d-6407-4a73-8829-e5421f6959ed'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:03.752713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219c3fcf4faa4acf94b7bb253e9b5f9c', 'request_id': 'req-7713ef5d-6407-4a73-8829-e5421f6959ed'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:03.787339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] The token cache is being invalidate because project 219c3fcf4faa4acf94b7bb253e9b5f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:03.789254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:03.793928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:03.796178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 866/1717] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:03 2022] DELETE /identity/v3/projects/219c3fcf4faa4acf94b7bb253e9b5f9c => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:03.800333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:03.804039 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:03.805598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-077e4a3b-ae5f-4ce2-9a07-f426db3e75bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d6ba1d18d844e99ae2c5e5e09be462'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:03.841306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-077e4a3b-ae5f-4ce2-9a07-f426db3e75bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d6ba1d18d844e99ae2c5e5e09be462'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:03.845971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=84,keystone:INSERT=7,keystone:DELETE=9 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:03.863008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-077e4a3b-ae5f-4ce2-9a07-f426db3e75bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d6ba1d18d844e99ae2c5e5e09be462'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:03.863741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-077e4a3b-ae5f-4ce2-9a07-f426db3e75bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d6ba1d18d844e99ae2c5e5e09be462'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:03.867001 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-077e4a3b-ae5f-4ce2-9a07-f426db3e75bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d6ba1d18d844e99ae2c5e5e09be462'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:03.921415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 852/1718] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:03 2022] DELETE /identity/v3/users/27d6ba1d18d844e99ae2c5e5e09be462 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:03.921415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e4a3b-ae5f-4ce2-9a07-f426db3e75bd admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:03.925910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-077e4a3b-ae5f-4ce2-9a07-f426db3e75bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:03.987826 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713ef5d-6407-4a73-8829-e5421f6959ed admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:04.068407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e4a3b-ae5f-4ce2-9a07-f426db3e75bd admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:04.092627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f282248-69f3-495a-896b-977a7839ee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:04.093327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f282248-69f3-495a-896b-977a7839ee47 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:04.093613 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f282248-69f3-495a-896b-977a7839ee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:04.093886 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f282248-69f3-495a-896b-977a7839ee47 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:04.094634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f282248-69f3-495a-896b-977a7839ee47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:04.106182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f282248-69f3-495a-896b-977a7839ee47 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:04.136926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 853/1719] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:04.137838 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f282248-69f3-495a-896b-977a7839ee47 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:04.143594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2f282248-69f3-495a-896b-977a7839ee47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:04.172801 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f282248-69f3-495a-896b-977a7839ee47 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:04.187362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e728814-2383-4426-b3bf-0255427b3505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:04.188452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728814-2383-4426-b3bf-0255427b3505 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:04.188736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728814-2383-4426-b3bf-0255427b3505 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:04.189010 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728814-2383-4426-b3bf-0255427b3505 admin admin] PATH_INFO: `/v3/projects/767e5b4018be4026a057734522e62eab/users/f85b4904fe6c4764aa6c8964d4fbaa13/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:04.194219 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e728814-2383-4426-b3bf-0255427b3505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767e5b4018be4026a057734522e62eab, user_id=f85b4904fe6c4764aa6c8964d4fbaa13, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:04.196989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e728814-2383-4426-b3bf-0255427b3505 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:04.203049 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15715dcb-d767-45a0-b960-22f70ad2d6c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13562e65139b44ab931fb8fdb41a61b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:04.203730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715dcb-d767-45a0-b960-22f70ad2d6c4 service placement] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:04.204013 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715dcb-d767-45a0-b960-22f70ad2d6c4 service placement] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:04.204285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715dcb-d767-45a0-b960-22f70ad2d6c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:04.212112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-15715dcb-d767-45a0-b960-22f70ad2d6c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:04.214413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 854/1720] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:04 2022] PUT /identity/v3/projects/767e5b4018be4026a057734522e62eab/users/f85b4904fe6c4764aa6c8964d4fbaa13/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:04.215906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666bc5e-38cb-4f45-be8c-32b307b45bda None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:04.216187 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666bc5e-38cb-4f45-be8c-32b307b45bda None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:04.216905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666bc5e-38cb-4f45-be8c-32b307b45bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:04.240313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15715dcb-d767-45a0-b960-22f70ad2d6c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:04.242051 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15715dcb-d767-45a0-b960-22f70ad2d6c4 service placement] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:04.258992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-7666bc5e-38cb-4f45-be8c-32b307b45bda None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:04.265439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7666bc5e-38cb-4f45-be8c-32b307b45bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:04.274561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 867/1721] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:04.276452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699b552-57e5-47bd-bc83-aeba16dff21f None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:04.281139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699b552-57e5-47bd-bc83-aeba16dff21f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:04.281537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699b552-57e5-47bd-bc83-aeba16dff21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:04.337425 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6699b552-57e5-47bd-bc83-aeba16dff21f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:04.344990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6699b552-57e5-47bd-bc83-aeba16dff21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:04.427829 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 855/1722] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:04.429679 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666bc5e-38cb-4f45-be8c-32b307b45bda None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:04.444656 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666bc5e-38cb-4f45-be8c-32b307b45bda None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:04.445710 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:04.454930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec94d3-3c59-48b5-9284-4ad095be941e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:04.456382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec94d3-3c59-48b5-9284-4ad095be941e admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:04.456872 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec94d3-3c59-48b5-9284-4ad095be941e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:04.457359 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec94d3-3c59-48b5-9284-4ad095be941e admin admin] PATH_INFO: `/v3/projects/a072a5f37dfb401eadc1f02ae174d76c/users/e9629c5352f04380955b154b23e7e3e2/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:04.491617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec94d3-3c59-48b5-9284-4ad095be941e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a072a5f37dfb401eadc1f02ae174d76c, user_id=e9629c5352f04380955b154b23e7e3e2, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:04.497913 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec94d3-3c59-48b5-9284-4ad095be941e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:04.502023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 868/1723] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:04.502023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23190ea3-886b-4fa0-b366-22d5d0189172 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:04.502023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23190ea3-886b-4fa0-b366-22d5d0189172 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:04.502023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23190ea3-886b-4fa0-b366-22d5d0189172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:04.534230 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 856/1724] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:04 2022] PUT /identity/v3/projects/a072a5f37dfb401eadc1f02ae174d76c/users/e9629c5352f04380955b154b23e7e3e2/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:04.535802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5821774-eea9-40c5-ada7-52fd1f4956e8 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:04.536095 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5821774-eea9-40c5-ada7-52fd1f4956e8 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:04.539056 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5821774-eea9-40c5-ada7-52fd1f4956e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:04.576983 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-23190ea3-886b-4fa0-b366-22d5d0189172 None None] MFA Rules not processed for user `f85b4904fe6c4764aa6c8964d4fbaa13`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:04.579154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-23190ea3-886b-4fa0-b366-22d5d0189172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:04.581157 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-d5821774-eea9-40c5-ada7-52fd1f4956e8 None None] MFA Rules not processed for user `f6dd88c437b74acfb3b54e4b8fd47e89`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:04.582578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d5821774-eea9-40c5-ada7-52fd1f4956e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:04.649732 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:04.790680 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 857/1725] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:04.792289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f369837-178a-4370-9b68-7a7778f2350c None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:04.792930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f369837-178a-4370-9b68-7a7778f2350c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:04.793337 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f369837-178a-4370-9b68-7a7778f2350c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:04.858015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6f369837-178a-4370-9b68-7a7778f2350c None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:04.859438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6f369837-178a-4370-9b68-7a7778f2350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:04.863617 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 869/1726] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:04 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:04.870517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23190ea3-886b-4fa0-b366-22d5d0189172 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:04.880713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-23190ea3-886b-4fa0-b366-22d5d0189172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:05.011984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 858/1727] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:05.017188 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f369837-178a-4370-9b68-7a7778f2350c None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:05.028516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23190ea3-886b-4fa0-b366-22d5d0189172 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:05.029432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f369837-178a-4370-9b68-7a7778f2350c None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:05.039613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53576e2-0dd0-4cdd-862c-51e2da7e4213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:05.040304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53576e2-0dd0-4cdd-862c-51e2da7e4213 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:05.040584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53576e2-0dd0-4cdd-862c-51e2da7e4213 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:05.040860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53576e2-0dd0-4cdd-862c-51e2da7e4213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:05.046295 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b6b92-aa7c-4688-bde6-6ec5f35e282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:05.047321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b6b92-aa7c-4688-bde6-6ec5f35e282f admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:05.047813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b6b92-aa7c-4688-bde6-6ec5f35e282f admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:05.048271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b6b92-aa7c-4688-bde6-6ec5f35e282f admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:05.049203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b6b92-aa7c-4688-bde6-6ec5f35e282f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:05.054562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b6b92-aa7c-4688-bde6-6ec5f35e282f admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:05.074745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53576e2-0dd0-4cdd-862c-51e2da7e4213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:05.077628 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53576e2-0dd0-4cdd-862c-51e2da7e4213 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:05.088046 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 859/1728] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:05.092287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b6b92-aa7c-4688-bde6-6ec5f35e282f admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:05.096749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 870/1729] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:05.097713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53576e2-0dd0-4cdd-862c-51e2da7e4213 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:05.098410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-975b6b92-aa7c-4688-bde6-6ec5f35e282f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:05.101950 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f53576e2-0dd0-4cdd-862c-51e2da7e4213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:05.242475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53576e2-0dd0-4cdd-862c-51e2da7e4213 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:05.248352 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61855ecd-a819-4d34-970f-99316b3e6d9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:05.249590 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61855ecd-a819-4d34-970f-99316b3e6d9b service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:05.250036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61855ecd-a819-4d34-970f-99316b3e6d9b service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:05.250487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61855ecd-a819-4d34-970f-99316b3e6d9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:05.287602 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b6b92-aa7c-4688-bde6-6ec5f35e282f admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:05.295385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6592d6-620c-46af-932d-1628cb3f1b03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:05.296315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6592d6-620c-46af-932d-1628cb3f1b03 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:05.296483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6592d6-620c-46af-932d-1628cb3f1b03 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:05.296791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6592d6-620c-46af-932d-1628cb3f1b03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:05.308760 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61855ecd-a819-4d34-970f-99316b3e6d9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:05.308926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6592d6-620c-46af-932d-1628cb3f1b03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:05.310306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61855ecd-a819-4d34-970f-99316b3e6d9b service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:05.311065 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6592d6-620c-46af-932d-1628cb3f1b03 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:05.330093 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 860/1730] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:05.332363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6592d6-620c-46af-932d-1628cb3f1b03 service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:05.335162 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 871/1731] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:05.337444 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61855ecd-a819-4d34-970f-99316b3e6d9b service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:05.371626 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6592d6-620c-46af-932d-1628cb3f1b03 service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:05.414517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61855ecd-a819-4d34-970f-99316b3e6d9b service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:05.431777 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113e21f-6a53-4355-a6e5-6885806d46f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:05.432480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e21f-6a53-4355-a6e5-6885806d46f1 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:05.432764 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e21f-6a53-4355-a6e5-6885806d46f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:05.433043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e21f-6a53-4355-a6e5-6885806d46f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:05.433808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113e21f-6a53-4355-a6e5-6885806d46f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:05.434123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113e21f-6a53-4355-a6e5-6885806d46f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:05.451485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea63ef2-1ece-4069-a14a-6dcc4eaab672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:05.451690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113e21f-6a53-4355-a6e5-6885806d46f1 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:05.451840 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea63ef2-1ece-4069-a14a-6dcc4eaab672 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:05.451840 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea63ef2-1ece-4069-a14a-6dcc4eaab672 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:05.451840 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea63ef2-1ece-4069-a14a-6dcc4eaab672 admin admin] PATH_INFO: `/v3/projects/a072a5f37dfb401eadc1f02ae174d76c/users/e9629c5352f04380955b154b23e7e3e2/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:05.455603 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea63ef2-1ece-4069-a14a-6dcc4eaab672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a072a5f37dfb401eadc1f02ae174d76c, user_id=e9629c5352f04380955b154b23e7e3e2, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:05.466162 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea63ef2-1ece-4069-a14a-6dcc4eaab672 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:05.535528 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 861/1732] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:05.540459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6536a1f-1359-4bef-8f19-351051b91a8c None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:05.543060 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6536a1f-1359-4bef-8f19-351051b91a8c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:05.543368 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6536a1f-1359-4bef-8f19-351051b91a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:05.549858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 872/1733] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:05 2022] PUT /identity/v3/projects/a072a5f37dfb401eadc1f02ae174d76c/users/e9629c5352f04380955b154b23e7e3e2/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:05.552921 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea63ef2-1ece-4069-a14a-6dcc4eaab672 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:05.561211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:05.676893 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-c6536a1f-1359-4bef-8f19-351051b91a8c None None] MFA Rules not processed for user `aa8ee32c5d484363b8af1898d2603e90`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:05.678443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-c6536a1f-1359-4bef-8f19-351051b91a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:05.797721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:05.999038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 862/1734] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:06.005212 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377c798-7b75-4653-8030-ee689e45dfa5 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:06.005506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377c798-7b75-4653-8030-ee689e45dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:06.008717 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377c798-7b75-4653-8030-ee689e45dfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:06.076725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-3377c798-7b75-4653-8030-ee689e45dfa5 None None] MFA Rules not processed for user `e9629c5352f04380955b154b23e7e3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:06.078407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3377c798-7b75-4653-8030-ee689e45dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:06.112457 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea63ef2-1ece-4069-a14a-6dcc4eaab672 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:06.124965 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb6314-6261-4f69-8857-8da19de59012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:06.125654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb6314-6261-4f69-8857-8da19de59012 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:06.125934 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb6314-6261-4f69-8857-8da19de59012 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:06.126318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb6314-6261-4f69-8857-8da19de59012 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:06.126918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb6314-6261-4f69-8857-8da19de59012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:06.128832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb6314-6261-4f69-8857-8da19de59012 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:06.211196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 873/1735] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:05 2022] POST /identity/v3/projects => generated 377 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:06.216523 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb6314-6261-4f69-8857-8da19de59012 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:06.306705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 863/1736] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:06 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:06.306705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377c798-7b75-4653-8030-ee689e45dfa5 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:06.348416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb6314-6261-4f69-8857-8da19de59012 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:06.361510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820b516-f846-409c-925c-314d1afa2811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:06.362435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820b516-f846-409c-925c-314d1afa2811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:06.362709 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820b516-f846-409c-925c-314d1afa2811 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:06.363024 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820b516-f846-409c-925c-314d1afa2811 admin admin] PATH_INFO: `/v3/users/c71558a38e3d4e10a11227099fedf216` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:06.371827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820b516-f846-409c-925c-314d1afa2811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71558a38e3d4e10a11227099fedf216)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:06.374244 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820b516-f846-409c-925c-314d1afa2811 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:06.470119 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377c798-7b75-4653-8030-ee689e45dfa5 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:06.477721 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-2820b516-f846-409c-925c-314d1afa2811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71558a38e3d4e10a11227099fedf216'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:06.493468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-2820b516-f846-409c-925c-314d1afa2811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71558a38e3d4e10a11227099fedf216'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:06.494222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-2820b516-f846-409c-925c-314d1afa2811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71558a38e3d4e10a11227099fedf216'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:06.503400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-2820b516-f846-409c-925c-314d1afa2811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71558a38e3d4e10a11227099fedf216'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:06.504480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-2820b516-f846-409c-925c-314d1afa2811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71558a38e3d4e10a11227099fedf216'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:06.546086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:06.550241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 874/1737] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:06 2022] DELETE /identity/v3/users/c71558a38e3d4e10a11227099fedf216 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:06.550241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820b516-f846-409c-925c-314d1afa2811 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:06.554869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2820b516-f846-409c-925c-314d1afa2811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:06.572393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989472c-22ac-43aa-9e9f-9a14b4a98310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:06.573390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989472c-22ac-43aa-9e9f-9a14b4a98310 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:06.573744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989472c-22ac-43aa-9e9f-9a14b4a98310 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:06.574078 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989472c-22ac-43aa-9e9f-9a14b4a98310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:06.576264 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-f989472c-22ac-43aa-9e9f-9a14b4a98310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:06.583122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:06.749730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820b516-f846-409c-925c-314d1afa2811 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:06.764463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae29d1-3017-4507-9ae6-ac567035a46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:06.765265 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae29d1-3017-4507-9ae6-ac567035a46b admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:06.765646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae29d1-3017-4507-9ae6-ac567035a46b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:06.766000 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae29d1-3017-4507-9ae6-ac567035a46b admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:06.766805 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae29d1-3017-4507-9ae6-ac567035a46b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:06.767684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989472c-22ac-43aa-9e9f-9a14b4a98310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:06.769484 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae29d1-3017-4507-9ae6-ac567035a46b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:06.773898 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989472c-22ac-43aa-9e9f-9a14b4a98310 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:06.804796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 864/1738] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:06.819239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989472c-22ac-43aa-9e9f-9a14b4a98310 service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:06.825909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 875/1739] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:06 2022] POST /identity/v3/users => generated 289 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:06.826156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-f989472c-22ac-43aa-9e9f-9a14b4a98310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:06.830758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e4e3-0c58-4f41-94c8-192f0aea5aab None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:06.831079 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e4e3-0c58-4f41-94c8-192f0aea5aab None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:06.831364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e4e3-0c58-4f41-94c8-192f0aea5aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:06.901948 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-7717e4e3-0c58-4f41-94c8-192f0aea5aab None None] MFA Rules not processed for user `4067f36996a348f39b50fd88f223c87b`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:06.903511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-7717e4e3-0c58-4f41-94c8-192f0aea5aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:06.963412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989472c-22ac-43aa-9e9f-9a14b4a98310 service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:07.067260 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5a4b3-96e5-4848-80a0-73646ab5f4e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:07.067901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5a4b3-96e5-4848-80a0-73646ab5f4e7 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:07.068221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5a4b3-96e5-4848-80a0-73646ab5f4e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:07.068501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5a4b3-96e5-4848-80a0-73646ab5f4e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:07.070634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-88b5a4b3-96e5-4848-80a0-73646ab5f4e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:07.112301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 876/1740] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:07.113749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd28a2-8f21-4550-b85a-f00a4d6c4ca1 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:07.114314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd28a2-8f21-4550-b85a-f00a4d6c4ca1 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:07.114404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd28a2-8f21-4550-b85a-f00a4d6c4ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:07.155635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:07.188475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-68dd28a2-8f21-4550-b85a-f00a4d6c4ca1 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:07.189879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-68dd28a2-8f21-4550-b85a-f00a4d6c4ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:07.196129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5a4b3-96e5-4848-80a0-73646ab5f4e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:07.198669 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5a4b3-96e5-4848-80a0-73646ab5f4e7 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:07.218143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 877/1741] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:07.219254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd28a2-8f21-4550-b85a-f00a4d6c4ca1 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:07.221990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-68dd28a2-8f21-4550-b85a-f00a4d6c4ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:07.232300 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 865/1742] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:06 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:07.239343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5a4b3-96e5-4848-80a0-73646ab5f4e7 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:07.255920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd28a2-8f21-4550-b85a-f00a4d6c4ca1 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:07.267602 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:07.267841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5a4b3-96e5-4848-80a0-73646ab5f4e7 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:07.268513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:07.268799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:07.271759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] PATH_INFO: `/v3/projects/aadf2d89a9594ff4bcd296fad9dc3b74` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:07.273779 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aadf2d89a9594ff4bcd296fad9dc3b74)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:07.281970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:07.282555 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71839c-435b-402a-81c0-2e98c4733e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:07.288506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71839c-435b-402a-81c0-2e98c4733e2b admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:07.289120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71839c-435b-402a-81c0-2e98c4733e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:07.289434 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71839c-435b-402a-81c0-2e98c4733e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:07.290943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71839c-435b-402a-81c0-2e98c4733e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:07.297251 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71839c-435b-402a-81c0-2e98c4733e2b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:07.340543 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 866/1743] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:07.341564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71839c-435b-402a-81c0-2e98c4733e2b admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:07.349397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7b71839c-435b-402a-81c0-2e98c4733e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:07.476778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aadf2d89a9594ff4bcd296fad9dc3b74', 'request_id': 'req-850a2785-fb04-4fc9-8139-e746d6cddf85'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:07.504874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aadf2d89a9594ff4bcd296fad9dc3b74', 'request_id': 'req-850a2785-fb04-4fc9-8139-e746d6cddf85'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:07.520066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aadf2d89a9594ff4bcd296fad9dc3b74', 'request_id': 'req-850a2785-fb04-4fc9-8139-e746d6cddf85'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:07.560364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] The token cache is being invalidate because project aadf2d89a9594ff4bcd296fad9dc3b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:07.562302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71839c-435b-402a-81c0-2e98c4733e2b admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:07.564734 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:07.566180 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:07.570147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 878/1744] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:07 2022] DELETE /identity/v3/projects/aadf2d89a9594ff4bcd296fad9dc3b74 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:07.576869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:07.585106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:07.602206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:07.724899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a2785-fb04-4fc9-8139-e746d6cddf85 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:07.729802 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa520ef2-c883-4361-88eb-f6438b7b8663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:07.730534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa520ef2-c883-4361-88eb-f6438b7b8663 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:07.731011 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa520ef2-c883-4361-88eb-f6438b7b8663 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:07.731708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa520ef2-c883-4361-88eb-f6438b7b8663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:07.735245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-fa520ef2-c883-4361-88eb-f6438b7b8663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:07.736195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc7ca5-e770-4f78-9191-c163e051de0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:07.737104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7ca5-e770-4f78-9191-c163e051de0c service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:07.739609 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7ca5-e770-4f78-9191-c163e051de0c service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:07.741111 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7ca5-e770-4f78-9191-c163e051de0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:07.746245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-92cc7ca5-e770-4f78-9191-c163e051de0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:07.822615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa520ef2-c883-4361-88eb-f6438b7b8663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:07.824557 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa520ef2-c883-4361-88eb-f6438b7b8663 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:07.837447 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 879/1745] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:07.839345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa520ef2-c883-4361-88eb-f6438b7b8663 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:07.840389 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-fa520ef2-c883-4361-88eb-f6438b7b8663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:07.853714 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa520ef2-c883-4361-88eb-f6438b7b8663 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:07.860090 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dc133-3fb2-4f28-acb3-dfbb54e70537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:07.860784 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc133-3fb2-4f28-acb3-dfbb54e70537 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:07.865968 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc133-3fb2-4f28-acb3-dfbb54e70537 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:07.866254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc133-3fb2-4f28-acb3-dfbb54e70537 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:07.867058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dc133-3fb2-4f28-acb3-dfbb54e70537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:07.869121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dc133-3fb2-4f28-acb3-dfbb54e70537 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:07.892839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 880/1746] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:07.893574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dc133-3fb2-4f28-acb3-dfbb54e70537 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:07.895353 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c39dc133-3fb2-4f28-acb3-dfbb54e70537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:07.906456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc7ca5-e770-4f78-9191-c163e051de0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:07.908850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc7ca5-e770-4f78-9191-c163e051de0c service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:07.929529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 867/1747] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:07.933376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc7ca5-e770-4f78-9191-c163e051de0c service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:07.936019 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-92cc7ca5-e770-4f78-9191-c163e051de0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:07.965394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc7ca5-e770-4f78-9191-c163e051de0c service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:08.018564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ca142-32fa-4975-9089-d61071f52e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:08.023129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ca142-32fa-4975-9089-d61071f52e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:08.023420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ca142-32fa-4975-9089-d61071f52e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:08.027892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ca142-32fa-4975-9089-d61071f52e5e admin admin] PATH_INFO: `/v3/users/6f8e6c72dc204ced943138048435ae30` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:08.038858 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ca142-32fa-4975-9089-d61071f52e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8e6c72dc204ced943138048435ae30)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:08.041616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ca142-32fa-4975-9089-d61071f52e5e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:08.077904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dc133-3fb2-4f28-acb3-dfbb54e70537 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:08.099254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323781e-bd2d-4840-a101-57d81b9d44fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:08.100017 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323781e-bd2d-4840-a101-57d81b9d44fb service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:08.100306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323781e-bd2d-4840-a101-57d81b9d44fb service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:08.100633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323781e-bd2d-4840-a101-57d81b9d44fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:08.101220 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:08.110183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-7323781e-bd2d-4840-a101-57d81b9d44fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:08.215027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-577ca142-32fa-4975-9089-d61071f52e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8e6c72dc204ced943138048435ae30'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:08.261962 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-577ca142-32fa-4975-9089-d61071f52e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8e6c72dc204ced943138048435ae30'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:08.282367 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-577ca142-32fa-4975-9089-d61071f52e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8e6c72dc204ced943138048435ae30'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:08.284285 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-577ca142-32fa-4975-9089-d61071f52e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8e6c72dc204ced943138048435ae30'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:08.286936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-577ca142-32fa-4975-9089-d61071f52e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8e6c72dc204ced943138048435ae30'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:08.305007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:08.323576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323781e-bd2d-4840-a101-57d81b9d44fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:08.326889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323781e-bd2d-4840-a101-57d81b9d44fb service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:08.333871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 868/1748] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:07 2022] DELETE /identity/v3/users/6f8e6c72dc204ced943138048435ae30 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:08.334872 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ca142-32fa-4975-9089-d61071f52e5e admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:08.336255 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-577ca142-32fa-4975-9089-d61071f52e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:08.358035 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 881/1749] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:07 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:08.361144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2019e-08e5-47c7-8a8c-17cd9c60f46c None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:08.361435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2019e-08e5-47c7-8a8c-17cd9c60f46c None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:08.361711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2019e-08e5-47c7-8a8c-17cd9c60f46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:08.405917 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-81d2019e-08e5-47c7-8a8c-17cd9c60f46c None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:08.409965 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-81d2019e-08e5-47c7-8a8c-17cd9c60f46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:08.550191 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ca142-32fa-4975-9089-d61071f52e5e admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:08.562032 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e90e29-31eb-4be3-ab3e-7912531aefd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:08.566102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e90e29-31eb-4be3-ab3e-7912531aefd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:08.568664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e90e29-31eb-4be3-ab3e-7912531aefd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:08.569012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e90e29-31eb-4be3-ab3e-7912531aefd9 admin admin] PATH_INFO: `/v3/projects/0cb9ab6432974f93837e353cd78805ac/users/ec24e2f00de34eb498b14b09308b0938/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:08.574725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 882/1750] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:49:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:08.640353 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e90e29-31eb-4be3-ab3e-7912531aefd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb9ab6432974f93837e353cd78805ac, user_id=ec24e2f00de34eb498b14b09308b0938, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:08.653746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e90e29-31eb-4be3-ab3e-7912531aefd9 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:08.721998 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 869/1751] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:08 2022] PUT /identity/v3/projects/0cb9ab6432974f93837e353cd78805ac/users/ec24e2f00de34eb498b14b09308b0938/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:08.732876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d34d5-f0e8-4636-bc94-0aa0e0d3c8b5 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:08.733402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d34d5-f0e8-4636-bc94-0aa0e0d3c8b5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:08.733836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d34d5-f0e8-4636-bc94-0aa0e0d3c8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:08.795161 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-558d34d5-f0e8-4636-bc94-0aa0e0d3c8b5 None None] MFA Rules not processed for user `ec24e2f00de34eb498b14b09308b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:08.796416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-558d34d5-f0e8-4636-bc94-0aa0e0d3c8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:08.904425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e90e29-31eb-4be3-ab3e-7912531aefd9 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:08.906447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-00e90e29-31eb-4be3-ab3e-7912531aefd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:09.036333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 883/1752] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:09.041042 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d34d5-f0e8-4636-bc94-0aa0e0d3c8b5 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:09.170423 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e90e29-31eb-4be3-ab3e-7912531aefd9 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:09.176872 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7acecb-f73b-43e9-a240-47b96688c1db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:09.177711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7acecb-f73b-43e9-a240-47b96688c1db service swift] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:09.177995 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7acecb-f73b-43e9-a240-47b96688c1db service swift] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:09.178270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7acecb-f73b-43e9-a240-47b96688c1db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:09.213774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:09.277185 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d34d5-f0e8-4636-bc94-0aa0e0d3c8b5 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:09.290970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004a48f-33c5-48c7-b331-cd4f87ea0ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:09.291723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004a48f-33c5-48c7-b331-cd4f87ea0ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:09.294412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004a48f-33c5-48c7-b331-cd4f87ea0ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:09.294897 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004a48f-33c5-48c7-b331-cd4f87ea0ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:09.296911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004a48f-33c5-48c7-b331-cd4f87ea0ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:09.304385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004a48f-33c5-48c7-b331-cd4f87ea0ca7 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:09.371855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 884/1753] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:09 2022] POST /identity/v3/projects => generated 377 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:09.376609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004a48f-33c5-48c7-b331-cd4f87ea0ca7 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:09.381205 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7acecb-f73b-43e9-a240-47b96688c1db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:09.390126 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7acecb-f73b-43e9-a240-47b96688c1db service swift] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:09.418561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 870/1754] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:49:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 30 03:49:09.424289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7acecb-f73b-43e9-a240-47b96688c1db service swift] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:09.424754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:09.432148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-0f7acecb-f73b-43e9-a240-47b96688c1db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:09.500114 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7acecb-f73b-43e9-a240-47b96688c1db service swift] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:09.545713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004a48f-33c5-48c7-b331-cd4f87ea0ca7 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:09.564423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bb672-efb3-4b4d-bd98-aa32b9a4bc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:09.565397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bb672-efb3-4b4d-bd98-aa32b9a4bc90 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:09.567314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bb672-efb3-4b4d-bd98-aa32b9a4bc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:09.567644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bb672-efb3-4b4d-bd98-aa32b9a4bc90 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:09.571430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bb672-efb3-4b4d-bd98-aa32b9a4bc90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:09.581766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bb672-efb3-4b4d-bd98-aa32b9a4bc90 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:09.658141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:09.669480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:09.669480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:09.669480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] PATH_INFO: `/v3/projects/5044b630ac8f48dbbe91f4bd36873923` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:09.669480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5044b630ac8f48dbbe91f4bd36873923)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:09.669480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:09.692095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 885/1755] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:09 2022] POST /identity/v3/users => generated 289 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:09.697445 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bb672-efb3-4b4d-bd98-aa32b9a4bc90 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:09.759234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bb672-efb3-4b4d-bd98-aa32b9a4bc90 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:09.793414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a41ff8-dc74-4b62-ae41-7c66c627b8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:09.795108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a41ff8-dc74-4b62-ae41-7c66c627b8ef admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:09.795326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a41ff8-dc74-4b62-ae41-7c66c627b8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:09.795565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a41ff8-dc74-4b62-ae41-7c66c627b8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:09.796326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a41ff8-dc74-4b62-ae41-7c66c627b8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:09.798054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a41ff8-dc74-4b62-ae41-7c66c627b8ef admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:09.811317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5044b630ac8f48dbbe91f4bd36873923', 'request_id': 'req-df6c17e1-1a50-46a5-b513-1a319e5371ee'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:09.827720 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5044b630ac8f48dbbe91f4bd36873923', 'request_id': 'req-df6c17e1-1a50-46a5-b513-1a319e5371ee'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:09.835373 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5044b630ac8f48dbbe91f4bd36873923', 'request_id': 'req-df6c17e1-1a50-46a5-b513-1a319e5371ee'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:09.852202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] The token cache is being invalidate because project 5044b630ac8f48dbbe91f4bd36873923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:09.852739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:09.854498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:09.857696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 871/1756] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:09 2022] DELETE /identity/v3/projects/5044b630ac8f48dbbe91f4bd36873923 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:09.862792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:09.865431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:09.886638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 886/1757] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:49:09.894654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a41ff8-dc74-4b62-ae41-7c66c627b8ef admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:09.902879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b8a41ff8-dc74-4b62-ae41-7c66c627b8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:09.971879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a41ff8-dc74-4b62-ae41-7c66c627b8ef admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:10.003427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:10.065426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c17e1-1a50-46a5-b513-1a319e5371ee admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:10.089175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd22e5-48ff-42f6-a3cd-e2bf15141cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:10.091897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd22e5-48ff-42f6-a3cd-e2bf15141cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:10.093668 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd22e5-48ff-42f6-a3cd-e2bf15141cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:10.094712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd22e5-48ff-42f6-a3cd-e2bf15141cc8 admin admin] PATH_INFO: `/v3/users/f85b4904fe6c4764aa6c8964d4fbaa13` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:10.098545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd22e5-48ff-42f6-a3cd-e2bf15141cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85b4904fe6c4764aa6c8964d4fbaa13)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:10.102247 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd22e5-48ff-42f6-a3cd-e2bf15141cc8 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:10.224765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142cdb7-09c5-4b20-9cda-a50f3c478f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:10.225593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142cdb7-09c5-4b20-9cda-a50f3c478f76 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:10.235225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142cdb7-09c5-4b20-9cda-a50f3c478f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:10.235685 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142cdb7-09c5-4b20-9cda-a50f3c478f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:10.236643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142cdb7-09c5-4b20-9cda-a50f3c478f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:10.238386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142cdb7-09c5-4b20-9cda-a50f3c478f76 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:10.275080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 887/1758] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:10.279532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142cdb7-09c5-4b20-9cda-a50f3c478f76 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:10.287216 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-43dd22e5-48ff-42f6-a3cd-e2bf15141cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85b4904fe6c4764aa6c8964d4fbaa13'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:10.313222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142cdb7-09c5-4b20-9cda-a50f3c478f76 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:10.333072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc8c3d-84b9-4358-a5c9-6e77ab4bec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:10.334136 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8c3d-84b9-4358-a5c9-6e77ab4bec2c admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:10.334543 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8c3d-84b9-4358-a5c9-6e77ab4bec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:10.334845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8c3d-84b9-4358-a5c9-6e77ab4bec2c admin admin] PATH_INFO: `/v3/projects/627791738e4f412fb3e083645cadef3e/users/91d5350c8ea74c88be829c8274c04b12/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:10.366559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-43dd22e5-48ff-42f6-a3cd-e2bf15141cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85b4904fe6c4764aa6c8964d4fbaa13'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:10.388109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc8c3d-84b9-4358-a5c9-6e77ab4bec2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=627791738e4f412fb3e083645cadef3e, user_id=91d5350c8ea74c88be829c8274c04b12, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:10.391064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc8c3d-84b9-4358-a5c9-6e77ab4bec2c admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:10.404721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-43dd22e5-48ff-42f6-a3cd-e2bf15141cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85b4904fe6c4764aa6c8964d4fbaa13'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:10.408027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-43dd22e5-48ff-42f6-a3cd-e2bf15141cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85b4904fe6c4764aa6c8964d4fbaa13'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:10.409344 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-43dd22e5-48ff-42f6-a3cd-e2bf15141cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85b4904fe6c4764aa6c8964d4fbaa13'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:10.433664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 888/1759] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:10 2022] PUT /identity/v3/projects/627791738e4f412fb3e083645cadef3e/users/91d5350c8ea74c88be829c8274c04b12/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:10.448937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998c996-07b8-4acd-8c24-1da9b5996da0 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:10.449460 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998c996-07b8-4acd-8c24-1da9b5996da0 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:10.449775 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998c996-07b8-4acd-8c24-1da9b5996da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:10.463562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 872/1760] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:09 2022] DELETE /identity/v3/users/f85b4904fe6c4764aa6c8964d4fbaa13 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:10.567870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-0998c996-07b8-4acd-8c24-1da9b5996da0 None None] MFA Rules not processed for user `91d5350c8ea74c88be829c8274c04b12`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:10.569121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0998c996-07b8-4acd-8c24-1da9b5996da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:10.750123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:10.788237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 889/1761] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:10.798921 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd22e5-48ff-42f6-a3cd-e2bf15141cc8 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:10.800588 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-43dd22e5-48ff-42f6-a3cd-e2bf15141cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:11.051038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd22e5-48ff-42f6-a3cd-e2bf15141cc8 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:11.077439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f8717-4e6e-4ee0-9e01-536b8aa4468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:11.078099 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f8717-4e6e-4ee0-9e01-536b8aa4468c admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:11.078444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f8717-4e6e-4ee0-9e01-536b8aa4468c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:11.078638 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f8717-4e6e-4ee0-9e01-536b8aa4468c admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:11.086716 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f8717-4e6e-4ee0-9e01-536b8aa4468c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:11.092880 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f8717-4e6e-4ee0-9e01-536b8aa4468c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:11.222245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 873/1762] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:10 2022] POST /identity/v3/projects => generated 379 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:49:11.227002 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998c996-07b8-4acd-8c24-1da9b5996da0 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:11.242226 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998c996-07b8-4acd-8c24-1da9b5996da0 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:11.454115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36426ba6-c80a-4ba6-bffc-444060eff17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:11.456062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36426ba6-c80a-4ba6-bffc-444060eff17f admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:11.456934 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36426ba6-c80a-4ba6-bffc-444060eff17f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:11.458054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36426ba6-c80a-4ba6-bffc-444060eff17f admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:11.459896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36426ba6-c80a-4ba6-bffc-444060eff17f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:11.463890 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36426ba6-c80a-4ba6-bffc-444060eff17f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:11.495135 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 890/1763] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:11 2022] POST /identity/v3/users => generated 296 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:11.500201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f8717-4e6e-4ee0-9e01-536b8aa4468c admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:11.530491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f8717-4e6e-4ee0-9e01-536b8aa4468c admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:11.542731 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8836724-6d57-40d8-a89f-3f9c6a2cc2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:11.545532 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8836724-6d57-40d8-a89f-3f9c6a2cc2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:11.546053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8836724-6d57-40d8-a89f-3f9c6a2cc2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:11.547211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8836724-6d57-40d8-a89f-3f9c6a2cc2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:11.549652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8836724-6d57-40d8-a89f-3f9c6a2cc2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:11.551612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8836724-6d57-40d8-a89f-3f9c6a2cc2e2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:11.571195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 874/1764] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:49:11.576414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36426ba6-c80a-4ba6-bffc-444060eff17f admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:11.594705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36426ba6-c80a-4ba6-bffc-444060eff17f admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:11.600036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37608736-10e3-4cb2-9433-fb760db1f58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:11.600960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37608736-10e3-4cb2-9433-fb760db1f58d admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:11.601242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37608736-10e3-4cb2-9433-fb760db1f58d admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:11.601509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37608736-10e3-4cb2-9433-fb760db1f58d admin admin] PATH_INFO: `/v3/projects/e3ca2a2e426a452495ae99a4ac3d5248/users/03dfcb05f66c48a29026a8ee720b8cfc/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:11.643931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37608736-10e3-4cb2-9433-fb760db1f58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ca2a2e426a452495ae99a4ac3d5248, user_id=03dfcb05f66c48a29026a8ee720b8cfc, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:11.649735 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37608736-10e3-4cb2-9433-fb760db1f58d admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:11.679394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8836724-6d57-40d8-a89f-3f9c6a2cc2e2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:11.680633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d8836724-6d57-40d8-a89f-3f9c6a2cc2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:11.710158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 891/1765] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:11 2022] PUT /identity/v3/projects/e3ca2a2e426a452495ae99a4ac3d5248/users/03dfcb05f66c48a29026a8ee720b8cfc/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:11.714909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37608736-10e3-4cb2-9433-fb760db1f58d admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:11.724487 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8836724-6d57-40d8-a89f-3f9c6a2cc2e2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:11.879800 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37608736-10e3-4cb2-9433-fb760db1f58d admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:11.903855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:11.910154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de04a60-2059-4b9b-9d1e-7fc221c8236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:11.915726 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de04a60-2059-4b9b-9d1e-7fc221c8236b admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:11.916227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de04a60-2059-4b9b-9d1e-7fc221c8236b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:11.916669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de04a60-2059-4b9b-9d1e-7fc221c8236b admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:11.926102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de04a60-2059-4b9b-9d1e-7fc221c8236b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:11.930902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de04a60-2059-4b9b-9d1e-7fc221c8236b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:11.975448 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 892/1766] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:11.977715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de04a60-2059-4b9b-9d1e-7fc221c8236b admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:12.025022 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de04a60-2059-4b9b-9d1e-7fc221c8236b admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:12.030644 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:12.031911 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:12.032495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:12.033658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd admin admin] PATH_INFO: `/v3/projects/ab7bca48db194fc5ad3fd093c2fe0709` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:12.043310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b34694-90b3-4182-b3c4-e5738ac2f6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:12.044398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b34694-90b3-4182-b3c4-e5738ac2f6b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:12.044697 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b34694-90b3-4182-b3c4-e5738ac2f6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:12.045031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7bca48db194fc5ad3fd093c2fe0709)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:12.045135 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b34694-90b3-4182-b3c4-e5738ac2f6b7 admin admin] PATH_INFO: `/v3/projects/e3ca2a2e426a452495ae99a4ac3d5248/users/03dfcb05f66c48a29026a8ee720b8cfc/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:12.060436 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b34694-90b3-4182-b3c4-e5738ac2f6b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ca2a2e426a452495ae99a4ac3d5248, user_id=03dfcb05f66c48a29026a8ee720b8cfc, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:12.060657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:12.063238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b34694-90b3-4182-b3c4-e5738ac2f6b7 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:12.135662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 893/1767] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:11 2022] PUT /identity/v3/projects/e3ca2a2e426a452495ae99a4ac3d5248/users/03dfcb05f66c48a29026a8ee720b8cfc/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:12.141370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a4994-da66-440c-995d-218665e8c9da None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:12.141887 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a4994-da66-440c-995d-218665e8c9da None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:12.142071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a4994-da66-440c-995d-218665e8c9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:12.265041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7bca48db194fc5ad3fd093c2fe0709', 'request_id': 'req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:12.280372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-b51a4994-da66-440c-995d-218665e8c9da None None] MFA Rules not processed for user `03dfcb05f66c48a29026a8ee720b8cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:12.283358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7bca48db194fc5ad3fd093c2fe0709', 'request_id': 'req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:12.284654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b51a4994-da66-440c-995d-218665e8c9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:12.301797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7bca48db194fc5ad3fd093c2fe0709', 'request_id': 'req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:12.386877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd admin admin] The token cache is being invalidate because project ab7bca48db194fc5ad3fd093c2fe0709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:12.390282 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:12.395113 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-fa1b8061-8877-42d9-8882-ad6f1a1bbfbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:12.409043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 875/1768] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:11 2022] DELETE /identity/v3/projects/ab7bca48db194fc5ad3fd093c2fe0709 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:12.415223 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fe76f-0a8c-45f3-ac07-fdb547d59921 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:12.415669 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fe76f-0a8c-45f3-ac07-fdb547d59921 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:12.416085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fe76f-0a8c-45f3-ac07-fdb547d59921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:12.434331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:12.465608 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e30fe76f-0a8c-45f3-ac07-fdb547d59921 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:12.469167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e30fe76f-0a8c-45f3-ac07-fdb547d59921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:12.603345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 876/1769] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:12.605462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 894/1770] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:12.628047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a4994-da66-440c-995d-218665e8c9da None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:12.629790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b51a4994-da66-440c-995d-218665e8c9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:12.632462 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b23ca-0c5f-473d-ba13-5b53e67b6f45 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:12.633868 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b23ca-0c5f-473d-ba13-5b53e67b6f45 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:12.634179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b23ca-0c5f-473d-ba13-5b53e67b6f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:12.737885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-a90b23ca-0c5f-473d-ba13-5b53e67b6f45 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:12.749049 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a90b23ca-0c5f-473d-ba13-5b53e67b6f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:12.790611 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 877/1771] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:12.813598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b23ca-0c5f-473d-ba13-5b53e67b6f45 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:12.860547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b23ca-0c5f-473d-ba13-5b53e67b6f45 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:12.879961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89253bc3-9dcd-4fdc-9665-57ca673c9324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:12.879961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89253bc3-9dcd-4fdc-9665-57ca673c9324 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:12.879961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89253bc3-9dcd-4fdc-9665-57ca673c9324 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:12.879961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89253bc3-9dcd-4fdc-9665-57ca673c9324 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:12.880374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89253bc3-9dcd-4fdc-9665-57ca673c9324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:12.880374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89253bc3-9dcd-4fdc-9665-57ca673c9324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:12.895614 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89253bc3-9dcd-4fdc-9665-57ca673c9324 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:12.919363 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a4994-da66-440c-995d-218665e8c9da None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:12.929533 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f0cf9-9d5d-41db-91d3-4bd6b88eb834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:12.931991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f0cf9-9d5d-41db-91d3-4bd6b88eb834 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:12.933091 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 878/1772] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:12.936982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f0cf9-9d5d-41db-91d3-4bd6b88eb834 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:12.937498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f0cf9-9d5d-41db-91d3-4bd6b88eb834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:12.939657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89253bc3-9dcd-4fdc-9665-57ca673c9324 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:12.943737 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-89253bc3-9dcd-4fdc-9665-57ca673c9324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:12.963823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f0cf9-9d5d-41db-91d3-4bd6b88eb834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:12.969435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f0cf9-9d5d-41db-91d3-4bd6b88eb834 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:12.975745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89253bc3-9dcd-4fdc-9665-57ca673c9324 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:12.990598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:12.992632 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:12.992918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:12.995496 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] PATH_INFO: `/v3/projects/767e5b4018be4026a057734522e62eab` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:12.997682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 895/1773] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:13.013967 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] RBAC: Authorizing `identity:delete_project(project_id=767e5b4018be4026a057734522e62eab)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:13.014076 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f0cf9-9d5d-41db-91d3-4bd6b88eb834 service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:13.014752 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:13.016135 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4b2f0cf9-9d5d-41db-91d3-4bd6b88eb834 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:13.050925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f0cf9-9d5d-41db-91d3-4bd6b88eb834 service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:13.065568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023a232-d61e-45e4-bf02-ba3b88f413a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:13.066656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023a232-d61e-45e4-bf02-ba3b88f413a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:13.077693 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023a232-d61e-45e4-bf02-ba3b88f413a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:13.090830 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023a232-d61e-45e4-bf02-ba3b88f413a8 admin admin] PATH_INFO: `/v3/users/c5618086481a4f809f7d80818474e831` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:13.102421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023a232-d61e-45e4-bf02-ba3b88f413a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5618086481a4f809f7d80818474e831)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:13.104781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023a232-d61e-45e4-bf02-ba3b88f413a8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:13.160570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:13.188149 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767e5b4018be4026a057734522e62eab', 'request_id': 'req-ace90f60-1529-49fa-8d66-e57208c4623d'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:13.212595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767e5b4018be4026a057734522e62eab', 'request_id': 'req-ace90f60-1529-49fa-8d66-e57208c4623d'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:13.225536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767e5b4018be4026a057734522e62eab', 'request_id': 'req-ace90f60-1529-49fa-8d66-e57208c4623d'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:13.250271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7023a232-d61e-45e4-bf02-ba3b88f413a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5618086481a4f809f7d80818474e831'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:13.252395 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] The token cache is being invalidate because project 767e5b4018be4026a057734522e62eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:13.252691 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:13.253390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:13.265720 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 879/1774] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:12 2022] DELETE /identity/v3/projects/767e5b4018be4026a057734522e62eab => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:13.266742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:13.268277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:13.280529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7023a232-d61e-45e4-bf02-ba3b88f413a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5618086481a4f809f7d80818474e831'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:13.281648 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7023a232-d61e-45e4-bf02-ba3b88f413a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5618086481a4f809f7d80818474e831'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:13.299324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7023a232-d61e-45e4-bf02-ba3b88f413a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5618086481a4f809f7d80818474e831'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:13.300635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7023a232-d61e-45e4-bf02-ba3b88f413a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5618086481a4f809f7d80818474e831'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:13.326336 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 896/1775] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:12 2022] DELETE /identity/v3/users/c5618086481a4f809f7d80818474e831 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:13.328288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155be01-b63e-4645-a226-7198dcc1787b None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:13.328811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155be01-b63e-4645-a226-7198dcc1787b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:13.329271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155be01-b63e-4645-a226-7198dcc1787b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:13.381177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace90f60-1529-49fa-8d66-e57208c4623d admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:13.383057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-f155be01-b63e-4645-a226-7198dcc1787b None None] MFA Rules not processed for user `b3aa7416101948aba0b45129174cd988`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:13.384804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f155be01-b63e-4645-a226-7198dcc1787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:13.475157 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f002dd1-eee6-4dcd-bc5b-27c376e0391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:13.475939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f002dd1-eee6-4dcd-bc5b-27c376e0391c admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:13.476225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f002dd1-eee6-4dcd-bc5b-27c376e0391c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:13.476503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f002dd1-eee6-4dcd-bc5b-27c376e0391c admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:13.477214 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f002dd1-eee6-4dcd-bc5b-27c376e0391c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:13.479881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f002dd1-eee6-4dcd-bc5b-27c376e0391c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:13.483235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:13.515685 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 897/1776] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Jun 30 03:49:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:13.517491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155be01-b63e-4645-a226-7198dcc1787b None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:13.522807 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f155be01-b63e-4645-a226-7198dcc1787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:13.523427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 880/1777] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:13 2022] POST /identity/v3/projects => generated 369 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:13.528944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971b595-b354-4053-8624-b3be5f4c3e7b None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:13.530673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971b595-b354-4053-8624-b3be5f4c3e7b None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:13.530985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971b595-b354-4053-8624-b3be5f4c3e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:13.576686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-c971b595-b354-4053-8624-b3be5f4c3e7b None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:13.581866 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-c971b595-b354-4053-8624-b3be5f4c3e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:13.687759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155be01-b63e-4645-a226-7198dcc1787b None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:13.755276 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 881/1778] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:13.756755 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c3355-e285-4523-849b-8112f9640bae None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:13.757066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c3355-e285-4523-849b-8112f9640bae None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:13.757327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c3355-e285-4523-849b-8112f9640bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:13.786629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:13.815967 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ed8c3355-e285-4523-849b-8112f9640bae None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:13.819888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ed8c3355-e285-4523-849b-8112f9640bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:13.827495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c78079-dbbf-4442-8cf9-241b27215b0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:13.829188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c78079-dbbf-4442-8cf9-241b27215b0a service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:13.830575 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c78079-dbbf-4442-8cf9-241b27215b0a service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:13.832284 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c78079-dbbf-4442-8cf9-241b27215b0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:13.835944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-56c78079-dbbf-4442-8cf9-241b27215b0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:13.838955 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 882/1779] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:13.840270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c3355-e285-4523-849b-8112f9640bae None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:13.844645 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ed8c3355-e285-4523-849b-8112f9640bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:13.871834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c3355-e285-4523-849b-8112f9640bae None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:13.884430 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cdf6b-838d-4609-9109-3410ec755664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:13.891157 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cdf6b-838d-4609-9109-3410ec755664 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:13.891595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cdf6b-838d-4609-9109-3410ec755664 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:13.891881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cdf6b-838d-4609-9109-3410ec755664 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:13.892642 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cdf6b-838d-4609-9109-3410ec755664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:13.894641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cdf6b-838d-4609-9109-3410ec755664 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:13.961388 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 883/1780] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:13 2022] POST /identity/v3/users => generated 285 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:13.964413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cdf6b-838d-4609-9109-3410ec755664 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:13.976786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-4d8cdf6b-838d-4609-9109-3410ec755664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:14.024346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c78079-dbbf-4442-8cf9-241b27215b0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:14.025858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c78079-dbbf-4442-8cf9-241b27215b0a service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:14.058152 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 898/1781] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:14.067049 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79518b3-bc6f-4e9c-b975-d320096f7401 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:14.067412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79518b3-bc6f-4e9c-b975-d320096f7401 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:14.067659 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79518b3-bc6f-4e9c-b975-d320096f7401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:14.142376 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-f79518b3-bc6f-4e9c-b975-d320096f7401 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:14.159472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f79518b3-bc6f-4e9c-b975-d320096f7401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:14.183821 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 899/1782] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:14.189438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79518b3-bc6f-4e9c-b975-d320096f7401 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:14.191427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cdf6b-838d-4609-9109-3410ec755664 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:14.206261 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae086e9-c457-44e3-b9df-d53694e2088c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:14.207006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae086e9-c457-44e3-b9df-d53694e2088c service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:14.207273 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae086e9-c457-44e3-b9df-d53694e2088c service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:14.207548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae086e9-c457-44e3-b9df-d53694e2088c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:14.218688 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79518b3-bc6f-4e9c-b975-d320096f7401 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:14.222406 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae086e9-c457-44e3-b9df-d53694e2088c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:14.225085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae086e9-c457-44e3-b9df-d53694e2088c service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:14.230677 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b070b-875a-473f-b542-712858df611e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:14.231582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b070b-875a-473f-b542-712858df611e service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:14.232131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b070b-875a-473f-b542-712858df611e service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:14.232131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b070b-875a-473f-b542-712858df611e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:14.247022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 884/1783] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:14.248708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae086e9-c457-44e3-b9df-d53694e2088c service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:14.250213 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b070b-875a-473f-b542-712858df611e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:14.251727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b070b-875a-473f-b542-712858df611e service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:14.271103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae086e9-c457-44e3-b9df-d53694e2088c service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:14.273803 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 900/1784] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:14.275418 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3873ef-d73d-4335-983a-bb8aa615e1a5 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:14.275708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3873ef-d73d-4335-983a-bb8aa615e1a5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:14.275990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3873ef-d73d-4335-983a-bb8aa615e1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:14.283320 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6a3f1-016a-42d9-81f8-0ac09652af17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:14.284007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6a3f1-016a-42d9-81f8-0ac09652af17 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:14.284292 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6a3f1-016a-42d9-81f8-0ac09652af17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:14.284571 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6a3f1-016a-42d9-81f8-0ac09652af17 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:14.285316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6a3f1-016a-42d9-81f8-0ac09652af17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:14.291544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6a3f1-016a-42d9-81f8-0ac09652af17 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:14.311601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 885/1785] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:14.312514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6a3f1-016a-42d9-81f8-0ac09652af17 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:14.320172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-cb3873ef-d73d-4335-983a-bb8aa615e1a5 None None] MFA Rules not processed for user `f6dd88c437b74acfb3b54e4b8fd47e89`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:14.321412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-cb3873ef-d73d-4335-983a-bb8aa615e1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:14.346293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6a3f1-016a-42d9-81f8-0ac09652af17 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:14.369564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920744f5-f72e-4fd8-b45c-f91e3dc9ce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:14.370752 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920744f5-f72e-4fd8-b45c-f91e3dc9ce10 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:14.371269 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920744f5-f72e-4fd8-b45c-f91e3dc9ce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:14.372094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920744f5-f72e-4fd8-b45c-f91e3dc9ce10 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:14.373146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920744f5-f72e-4fd8-b45c-f91e3dc9ce10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:14.373981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920744f5-f72e-4fd8-b45c-f91e3dc9ce10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:14.380736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920744f5-f72e-4fd8-b45c-f91e3dc9ce10 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:14.389141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:14.411236 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 886/1786] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:14.411236 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920744f5-f72e-4fd8-b45c-f91e3dc9ce10 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:14.428977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 901/1787] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:14.431114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3873ef-d73d-4335-983a-bb8aa615e1a5 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:14.437327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920744f5-f72e-4fd8-b45c-f91e3dc9ce10 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:14.451790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520d845-94fb-4ae3-966b-1c225576e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:14.453730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520d845-94fb-4ae3-966b-1c225576e4aa admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:14.454150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520d845-94fb-4ae3-966b-1c225576e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:14.455568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520d845-94fb-4ae3-966b-1c225576e4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:14.457422 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520d845-94fb-4ae3-966b-1c225576e4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:14.457602 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3873ef-d73d-4335-983a-bb8aa615e1a5 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:14.465943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520d845-94fb-4ae3-966b-1c225576e4aa admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:14.487444 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563717-da19-458e-ad49-efe1c61ba4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:14.488618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563717-da19-458e-ad49-efe1c61ba4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:14.497546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 887/1788] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:14.502180 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520d845-94fb-4ae3-966b-1c225576e4aa admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:14.514200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563717-da19-458e-ad49-efe1c61ba4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:14.520478 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563717-da19-458e-ad49-efe1c61ba4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:14.524639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520d845-94fb-4ae3-966b-1c225576e4aa admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:14.524792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca563717-da19-458e-ad49-efe1c61ba4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:14.530803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34b1ff-07f5-47f5-b9c5-9fa65a9c9323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:14.532186 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34b1ff-07f5-47f5-b9c5-9fa65a9c9323 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:14.532831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34b1ff-07f5-47f5-b9c5-9fa65a9c9323 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:14.532831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34b1ff-07f5-47f5-b9c5-9fa65a9c9323 admin admin] PATH_INFO: `/v3/projects/f4d9578661da4465a4d8e5d9b4e63797/users/4136a1bfabde41469cad173f51bd01d2/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:14.541826 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca563717-da19-458e-ad49-efe1c61ba4b8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:14.553289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34b1ff-07f5-47f5-b9c5-9fa65a9c9323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d9578661da4465a4d8e5d9b4e63797, user_id=4136a1bfabde41469cad173f51bd01d2, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:14.556520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34b1ff-07f5-47f5-b9c5-9fa65a9c9323 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:14.587247 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 888/1789] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:14 2022] PUT /identity/v3/projects/f4d9578661da4465a4d8e5d9b4e63797/users/4136a1bfabde41469cad173f51bd01d2/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:14.592683 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9d4da-ec73-424f-8987-c043439bf982 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:14.593268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9d4da-ec73-424f-8987-c043439bf982 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:14.593664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9d4da-ec73-424f-8987-c043439bf982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:14.642924 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-7de9d4da-ec73-424f-8987-c043439bf982 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:14.644646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7de9d4da-ec73-424f-8987-c043439bf982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:14.673310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 902/1790] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:14 2022] POST /identity/v3/projects => generated 367 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:14.675330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563717-da19-458e-ad49-efe1c61ba4b8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:14.935220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563717-da19-458e-ad49-efe1c61ba4b8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:14.969673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737b605-deed-46f8-9a1e-247adf37fa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:14.972931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737b605-deed-46f8-9a1e-247adf37fa7f admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:14.975292 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737b605-deed-46f8-9a1e-247adf37fa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:14.976542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737b605-deed-46f8-9a1e-247adf37fa7f admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:14.978624 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737b605-deed-46f8-9a1e-247adf37fa7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:15.001349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737b605-deed-46f8-9a1e-247adf37fa7f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:15.010643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 889/1791] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:15.095133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9d4da-ec73-424f-8987-c043439bf982 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:15.099186 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 903/1792] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:14 2022] POST /identity/v3/users => generated 284 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:15.107219 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae0245-f73a-4f50-a84f-f233f5a86531 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:15.107504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae0245-f73a-4f50-a84f-f233f5a86531 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:15.107786 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae0245-f73a-4f50-a84f-f233f5a86531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:15.115552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9d4da-ec73-424f-8987-c043439bf982 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:15.142732 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-32ae0245-f73a-4f50-a84f-f233f5a86531 None None] MFA Rules not processed for user `aa8ee32c5d484363b8af1898d2603e90`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:15.144235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-32ae0245-f73a-4f50-a84f-f233f5a86531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:15.144670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae24cc-9c43-45c3-850a-ad97914a5d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:15.151117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae24cc-9c43-45c3-850a-ad97914a5d4e admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:15.152684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae24cc-9c43-45c3-850a-ad97914a5d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:15.153877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae24cc-9c43-45c3-850a-ad97914a5d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:15.156705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae24cc-9c43-45c3-850a-ad97914a5d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:15.163869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae24cc-9c43-45c3-850a-ad97914a5d4e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:15.227139 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 890/1793] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:49:15.228272 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae24cc-9c43-45c3-850a-ad97914a5d4e admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:15.233002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-edae24cc-9c43-45c3-850a-ad97914a5d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:15.272389 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 904/1794] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:15.273751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae0245-f73a-4f50-a84f-f233f5a86531 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:15.296687 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae0245-f73a-4f50-a84f-f233f5a86531 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:15.299000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:15.313788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba790a-34b9-4310-8dbe-e4ba0a80185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:15.314650 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba790a-34b9-4310-8dbe-e4ba0a80185e admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:15.315324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba790a-34b9-4310-8dbe-e4ba0a80185e admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:15.315561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba790a-34b9-4310-8dbe-e4ba0a80185e admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:15.317301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba790a-34b9-4310-8dbe-e4ba0a80185e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:15.328799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba790a-34b9-4310-8dbe-e4ba0a80185e admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:15.366545 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 905/1795] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:15.370657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba790a-34b9-4310-8dbe-e4ba0a80185e admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:15.391523 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba790a-34b9-4310-8dbe-e4ba0a80185e admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:15.415393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c6643-3568-43d3-b18d-20a3c9007703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:15.416308 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c6643-3568-43d3-b18d-20a3c9007703 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:15.416589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c6643-3568-43d3-b18d-20a3c9007703 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:15.416999 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c6643-3568-43d3-b18d-20a3c9007703 admin admin] PATH_INFO: `/v3/projects/c093ae2fbd824e6f800f9a47dbdec97c/users/bdda6a1aee94499989f42c02a3d0acff/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:15.443838 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae24cc-9c43-45c3-850a-ad97914a5d4e admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:15.448230 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c6643-3568-43d3-b18d-20a3c9007703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c093ae2fbd824e6f800f9a47dbdec97c, user_id=bdda6a1aee94499989f42c02a3d0acff, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:15.448393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded21a66-2345-499b-b6d5-fbb28e37ef6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:15.449016 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded21a66-2345-499b-b6d5-fbb28e37ef6e service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:15.449328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded21a66-2345-499b-b6d5-fbb28e37ef6e service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:15.449643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded21a66-2345-499b-b6d5-fbb28e37ef6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:15.453367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c6643-3568-43d3-b18d-20a3c9007703 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:15.477442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 906/1796] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:15 2022] PUT /identity/v3/projects/c093ae2fbd824e6f800f9a47dbdec97c/users/bdda6a1aee94499989f42c02a3d0acff/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:15.489964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc2e52-adcd-400e-b233-e14c5bc62e32 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:15.490750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded21a66-2345-499b-b6d5-fbb28e37ef6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:15.491091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc2e52-adcd-400e-b233-e14c5bc62e32 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:15.491698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc2e52-adcd-400e-b233-e14c5bc62e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:15.492515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded21a66-2345-499b-b6d5-fbb28e37ef6e service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:15.514458 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 891/1797] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:15.565094 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-b7cc2e52-adcd-400e-b233-e14c5bc62e32 None None] MFA Rules not processed for user `bdda6a1aee94499989f42c02a3d0acff`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:15.569037 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b7cc2e52-adcd-400e-b233-e14c5bc62e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:15.616592 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:15.800491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 907/1798] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:15.806915 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded21a66-2345-499b-b6d5-fbb28e37ef6e service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:15.820252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded21a66-2345-499b-b6d5-fbb28e37ef6e service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:16.026923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d71eb-e443-473f-8051-64bb323a8f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:16.027805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d71eb-e443-473f-8051-64bb323a8f80 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:16.028004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d71eb-e443-473f-8051-64bb323a8f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:16.028282 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d71eb-e443-473f-8051-64bb323a8f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:16.037534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d71eb-e443-473f-8051-64bb323a8f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:16.041676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d71eb-e443-473f-8051-64bb323a8f80 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:16.098896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 892/1799] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:15 2022] POST /identity/v3/projects => generated 367 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:16.099867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc2e52-adcd-400e-b233-e14c5bc62e32 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:16.120505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc2e52-adcd-400e-b233-e14c5bc62e32 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:16.346840 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118dcc1-494a-42d3-bd9c-1bcbd2d4e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:16.347670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118dcc1-494a-42d3-bd9c-1bcbd2d4e5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:16.347959 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118dcc1-494a-42d3-bd9c-1bcbd2d4e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:16.348447 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118dcc1-494a-42d3-bd9c-1bcbd2d4e5e5 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:16.350018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118dcc1-494a-42d3-bd9c-1bcbd2d4e5e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:16.352279 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118dcc1-494a-42d3-bd9c-1bcbd2d4e5e5 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:16.400267 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 908/1800] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:16 2022] POST /identity/v3/users => generated 290 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:49:16.406251 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d71eb-e443-473f-8051-64bb323a8f80 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:16.464306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d71eb-e443-473f-8051-64bb323a8f80 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:16.483947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f96bc-a7f0-4508-8d43-ab738f8fe5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:16.484838 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f96bc-a7f0-4508-8d43-ab738f8fe5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:16.485124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f96bc-a7f0-4508-8d43-ab738f8fe5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:16.485405 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f96bc-a7f0-4508-8d43-ab738f8fe5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:16.486178 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f96bc-a7f0-4508-8d43-ab738f8fe5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:16.487881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f96bc-a7f0-4508-8d43-ab738f8fe5a5 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:16.537703 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 893/1801] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:16.540138 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118dcc1-494a-42d3-bd9c-1bcbd2d4e5e5 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:16.558502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118dcc1-494a-42d3-bd9c-1bcbd2d4e5e5 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:16.591918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946ff66-7eb9-4db0-bf56-1ff074d1538b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:16.596892 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946ff66-7eb9-4db0-bf56-1ff074d1538b admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:16.597390 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946ff66-7eb9-4db0-bf56-1ff074d1538b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:16.599239 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946ff66-7eb9-4db0-bf56-1ff074d1538b admin admin] PATH_INFO: `/v3/projects/7060c8d1270e4ebd854f280554829907/users/f6e9cc9ebf5f4fe1938d35fcb49d8b20/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:16.690654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946ff66-7eb9-4db0-bf56-1ff074d1538b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7060c8d1270e4ebd854f280554829907, user_id=f6e9cc9ebf5f4fe1938d35fcb49d8b20, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:16.690654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946ff66-7eb9-4db0-bf56-1ff074d1538b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:16.743229 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 909/1802] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:16 2022] PUT /identity/v3/projects/7060c8d1270e4ebd854f280554829907/users/f6e9cc9ebf5f4fe1938d35fcb49d8b20/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:16.745246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f96bc-a7f0-4508-8d43-ab738f8fe5a5 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:16.773785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f96bc-a7f0-4508-8d43-ab738f8fe5a5 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:16.971838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946ff66-7eb9-4db0-bf56-1ff074d1538b admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:16.974875 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4946ff66-7eb9-4db0-bf56-1ff074d1538b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:16.986311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8496ff-975e-4131-a80a-87792664b553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:16.994652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8496ff-975e-4131-a80a-87792664b553 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:16.995427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8496ff-975e-4131-a80a-87792664b553 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:16.995960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8496ff-975e-4131-a80a-87792664b553 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:17.001295 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8496ff-975e-4131-a80a-87792664b553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:17.007122 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8496ff-975e-4131-a80a-87792664b553 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:17.029659 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946ff66-7eb9-4db0-bf56-1ff074d1538b admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:17.053018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:17.062804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:17.063913 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 894/1803] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:17.067956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8496ff-975e-4131-a80a-87792664b553 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:17.069358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:17.070975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] PATH_INFO: `/v3/projects/afa9898f707c43cc8d35c24b3279a565` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:17.079032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa9898f707c43cc8d35c24b3279a565)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:17.092055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:17.128001 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8496ff-975e-4131-a80a-87792664b553 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:17.149244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79eb28-8056-45aa-8a6e-bc8a55d4b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:17.150178 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79eb28-8056-45aa-8a6e-bc8a55d4b98d admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:17.150463 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79eb28-8056-45aa-8a6e-bc8a55d4b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:17.156855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79eb28-8056-45aa-8a6e-bc8a55d4b98d admin admin] PATH_INFO: `/v3/projects/7060c8d1270e4ebd854f280554829907/users/f6e9cc9ebf5f4fe1938d35fcb49d8b20/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:17.167660 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79eb28-8056-45aa-8a6e-bc8a55d4b98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7060c8d1270e4ebd854f280554829907, user_id=f6e9cc9ebf5f4fe1938d35fcb49d8b20, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:17.178259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79eb28-8056-45aa-8a6e-bc8a55d4b98d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:17.228720 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 895/1804] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:17 2022] PUT /identity/v3/projects/7060c8d1270e4ebd854f280554829907/users/f6e9cc9ebf5f4fe1938d35fcb49d8b20/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:17.233013 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad54d9-5516-4584-a4fc-bcbb85d50d7e None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:17.233702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad54d9-5516-4584-a4fc-bcbb85d50d7e None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:17.234057 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad54d9-5516-4584-a4fc-bcbb85d50d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:17.297420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:17.345726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-77ad54d9-5516-4584-a4fc-bcbb85d50d7e None None] MFA Rules not processed for user `f6e9cc9ebf5f4fe1938d35fcb49d8b20`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:17.349769 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-77ad54d9-5516-4584-a4fc-bcbb85d50d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:17.361630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa9898f707c43cc8d35c24b3279a565', 'request_id': 'req-42234a7c-a232-46d1-bf91-b3164c25df7b'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:17.425477 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa9898f707c43cc8d35c24b3279a565', 'request_id': 'req-42234a7c-a232-46d1-bf91-b3164c25df7b'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:17.479526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa9898f707c43cc8d35c24b3279a565', 'request_id': 'req-42234a7c-a232-46d1-bf91-b3164c25df7b'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:17.507665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] The token cache is being invalidate because project afa9898f707c43cc8d35c24b3279a565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:17.507877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:17.508538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:17.513011 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 910/1805] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:16 2022] DELETE /identity/v3/projects/afa9898f707c43cc8d35c24b3279a565 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:17.520332 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:17.521827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:17.533959 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:17.679874 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 896/1806] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:17 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:17.692970 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad54d9-5516-4584-a4fc-bcbb85d50d7e None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:17.694409 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-77ad54d9-5516-4584-a4fc-bcbb85d50d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:17.781743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42234a7c-a232-46d1-bf91-b3164c25df7b admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:17.811268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2fd8d-bee1-4906-a4e3-11cc894d6494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:17.816531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2fd8d-bee1-4906-a4e3-11cc894d6494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:17.816817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2fd8d-bee1-4906-a4e3-11cc894d6494 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:17.817096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2fd8d-bee1-4906-a4e3-11cc894d6494 admin admin] PATH_INFO: `/v3/users/e9629c5352f04380955b154b23e7e3e2` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:17.823096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2fd8d-bee1-4906-a4e3-11cc894d6494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9629c5352f04380955b154b23e7e3e2)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:17.829250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2fd8d-bee1-4906-a4e3-11cc894d6494 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:17.993619 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad54d9-5516-4584-a4fc-bcbb85d50d7e None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:18.020461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56ad37-f089-4fb6-960a-c97ff47906a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:18.021159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56ad37-f089-4fb6-960a-c97ff47906a3 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:18.021447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56ad37-f089-4fb6-960a-c97ff47906a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:18.034180 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56ad37-f089-4fb6-960a-c97ff47906a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:18.064742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d8f2fd8d-bee1-4906-a4e3-11cc894d6494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9629c5352f04380955b154b23e7e3e2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:18.069868 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56ad37-f089-4fb6-960a-c97ff47906a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:18.072504 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56ad37-f089-4fb6-960a-c97ff47906a3 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:18.119297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d8f2fd8d-bee1-4906-a4e3-11cc894d6494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9629c5352f04380955b154b23e7e3e2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:18.123102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d8f2fd8d-bee1-4906-a4e3-11cc894d6494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9629c5352f04380955b154b23e7e3e2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:18.148848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d8f2fd8d-bee1-4906-a4e3-11cc894d6494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9629c5352f04380955b154b23e7e3e2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:18.149683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d8f2fd8d-bee1-4906-a4e3-11cc894d6494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9629c5352f04380955b154b23e7e3e2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:18.161457 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 897/1807] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:17 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:18.188542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 911/1808] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:17 2022] DELETE /identity/v3/users/e9629c5352f04380955b154b23e7e3e2 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:18.409647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803a5da-8e6d-4e7f-a949-c6884b053e3c None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:18.410571 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803a5da-8e6d-4e7f-a949-c6884b053e3c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:18.411147 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803a5da-8e6d-4e7f-a949-c6884b053e3c None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:18.431606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 898/1809] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jun 30 03:49:18 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:49:18.446635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b704cb-1bef-4131-b33a-7ba35a4d6c55 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:18.447489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b704cb-1bef-4131-b33a-7ba35a4d6c55 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:18.447489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b704cb-1bef-4131-b33a-7ba35a4d6c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:18.517127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-44b704cb-1bef-4131-b33a-7ba35a4d6c55 None None] MFA Rules not processed for user `b3aa7416101948aba0b45129174cd988`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:18.518387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-44b704cb-1bef-4131-b33a-7ba35a4d6c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:18.700802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803a5da-8e6d-4e7f-a949-c6884b053e3c None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:18.704410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3803a5da-8e6d-4e7f-a949-c6884b053e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:18.733763 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 912/1810] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:49:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:18.862608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b704cb-1bef-4131-b33a-7ba35a4d6c55 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:18.864132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-44b704cb-1bef-4131-b33a-7ba35a4d6c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:18.912918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b704cb-1bef-4131-b33a-7ba35a4d6c55 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:18.922343 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82bf2b-9d6a-4e54-bea5-f1459b38a848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:18.923224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82bf2b-9d6a-4e54-bea5-f1459b38a848 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:18.944153 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82bf2b-9d6a-4e54-bea5-f1459b38a848 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:18.946524 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82bf2b-9d6a-4e54-bea5-f1459b38a848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:18.990190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82bf2b-9d6a-4e54-bea5-f1459b38a848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:18.991692 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82bf2b-9d6a-4e54-bea5-f1459b38a848 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:19.014795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 913/1811] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:19.022737 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803a5da-8e6d-4e7f-a949-c6884b053e3c None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:19.027776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aab7db-7dbd-4938-8f22-f408e415e249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:19.028833 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aab7db-7dbd-4938-8f22-f408e415e249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:19.029118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aab7db-7dbd-4938-8f22-f408e415e249 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:19.029393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aab7db-7dbd-4938-8f22-f408e415e249 admin admin] PATH_INFO: `/v3/users/ec24e2f00de34eb498b14b09308b0938` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:19.031290 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aab7db-7dbd-4938-8f22-f408e415e249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec24e2f00de34eb498b14b09308b0938)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:19.033311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aab7db-7dbd-4938-8f22-f408e415e249 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:19.193740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:19.230541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-14aab7db-7dbd-4938-8f22-f408e415e249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec24e2f00de34eb498b14b09308b0938'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:19.297593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-14aab7db-7dbd-4938-8f22-f408e415e249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec24e2f00de34eb498b14b09308b0938'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:19.307782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5976ee-4655-4837-b622-4d6fddab5405 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:19.307922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5976ee-4655-4837-b622-4d6fddab5405 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:19.308254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5976ee-4655-4837-b622-4d6fddab5405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:19.325548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-14aab7db-7dbd-4938-8f22-f408e415e249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec24e2f00de34eb498b14b09308b0938'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:19.329334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-14aab7db-7dbd-4938-8f22-f408e415e249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec24e2f00de34eb498b14b09308b0938'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:19.330427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-14aab7db-7dbd-4938-8f22-f408e415e249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec24e2f00de34eb498b14b09308b0938'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:19.353523 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-9d5976ee-4655-4837-b622-4d6fddab5405 None None] MFA Rules not processed for user `4067f36996a348f39b50fd88f223c87b`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:19.369115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9d5976ee-4655-4837-b622-4d6fddab5405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:19.372249 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 899/1812] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:18 2022] DELETE /identity/v3/users/ec24e2f00de34eb498b14b09308b0938 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:19.380088 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a8fb7-e929-4f7d-9f5a-2ef56ce12760 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:19.381878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a8fb7-e929-4f7d-9f5a-2ef56ce12760 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:19.382508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a8fb7-e929-4f7d-9f5a-2ef56ce12760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:19.429564 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:19.480088 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-553a8fb7-e929-4f7d-9f5a-2ef56ce12760 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:19.481911 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-553a8fb7-e929-4f7d-9f5a-2ef56ce12760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:19.547334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 914/1813] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:19.578676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d15c30-91f4-46cd-8049-7238be2f7c6b None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:19.579381 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d15c30-91f4-46cd-8049-7238be2f7c6b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:19.579919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d15c30-91f4-46cd-8049-7238be2f7c6b None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:19.582254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 915/1814] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 03:49:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:49:19.636223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d290a4e-0bfa-4853-95d8-618dc6ff0d79 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:19.637393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d290a4e-0bfa-4853-95d8-618dc6ff0d79 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:19.638043 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d290a4e-0bfa-4853-95d8-618dc6ff0d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:19.691469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 900/1815] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:19.745057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-2d290a4e-0bfa-4853-95d8-618dc6ff0d79 None None] MFA Rules not processed for user `758b152c320e4a94921bb96541cbea98`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:19.751464 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2d290a4e-0bfa-4853-95d8-618dc6ff0d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:19.785609 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a8fb7-e929-4f7d-9f5a-2ef56ce12760 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:19.787206 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-553a8fb7-e929-4f7d-9f5a-2ef56ce12760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:20.018024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a8fb7-e929-4f7d-9f5a-2ef56ce12760 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:20.035936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a8cad-2099-4e6d-aed4-ad4ab6eb59bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:20.038584 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8cad-2099-4e6d-aed4-ad4ab6eb59bf service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:20.039022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8cad-2099-4e6d-aed4-ad4ab6eb59bf service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:20.040440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8cad-2099-4e6d-aed4-ad4ab6eb59bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:20.066959 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 916/1816] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 03:49:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:20.081392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a8cad-2099-4e6d-aed4-ad4ab6eb59bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:20.085841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a8cad-2099-4e6d-aed4-ad4ab6eb59bf service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:20.128427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 901/1817] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:49:21.007314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1c83-8712-44cb-96e9-8d772c1e7f21 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:21.008297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1c83-8712-44cb-96e9-8d772c1e7f21 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:21.008775 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1c83-8712-44cb-96e9-8d772c1e7f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:21.082672 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e0ff1c83-8712-44cb-96e9-8d772c1e7f21 None None] MFA Rules not processed for user `4136a1bfabde41469cad173f51bd01d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:21.086347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e0ff1c83-8712-44cb-96e9-8d772c1e7f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:21.161347 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a8cad-2099-4e6d-aed4-ad4ab6eb59bf service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:21.163552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ee1a8cad-2099-4e6d-aed4-ad4ab6eb59bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:21.207298 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a8cad-2099-4e6d-aed4-ad4ab6eb59bf service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:21.222688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:21.223536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:21.227716 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:21.228679 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e admin admin] PATH_INFO: `/v3/projects/a072a5f37dfb401eadc1f02ae174d76c` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:21.234123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a072a5f37dfb401eadc1f02ae174d76c)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:21.240855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:21.285274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 917/1818] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:21.297788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff1c83-8712-44cb-96e9-8d772c1e7f21 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:21.299741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e0ff1c83-8712-44cb-96e9-8d772c1e7f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:21.342298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff1c83-8712-44cb-96e9-8d772c1e7f21 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:21.366159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a072a5f37dfb401eadc1f02ae174d76c', 'request_id': 'req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:21.384887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a072a5f37dfb401eadc1f02ae174d76c', 'request_id': 'req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:21.387253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:21.397685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a072a5f37dfb401eadc1f02ae174d76c', 'request_id': 'req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:21.434217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e admin admin] The token cache is being invalidate because project a072a5f37dfb401eadc1f02ae174d76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:21.435709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:21.436501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-5e4f02c5-f0eb-4087-9415-ab2703b26d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:21.446585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 902/1819] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:21 2022] DELETE /identity/v3/projects/a072a5f37dfb401eadc1f02ae174d76c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:21.451398 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe46d75-f56e-48e1-92f4-dfbffc319740 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:21.452447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe46d75-f56e-48e1-92f4-dfbffc319740 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:21.453564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe46d75-f56e-48e1-92f4-dfbffc319740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:21.495934 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:21.527960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-7fe46d75-f56e-48e1-92f4-dfbffc319740 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:21.529928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7fe46d75-f56e-48e1-92f4-dfbffc319740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:21.547102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452d8b3-6cde-4dc6-bf2f-88a7e70de69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:21.549611 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452d8b3-6cde-4dc6-bf2f-88a7e70de69c admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:21.555239 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452d8b3-6cde-4dc6-bf2f-88a7e70de69c admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:21.555534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452d8b3-6cde-4dc6-bf2f-88a7e70de69c admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:21.561287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452d8b3-6cde-4dc6-bf2f-88a7e70de69c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:21.567056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452d8b3-6cde-4dc6-bf2f-88a7e70de69c admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:21.569767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 903/1820] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:21.593267 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d021177-36d1-415d-b557-b6492170fbbf None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:21.593617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d021177-36d1-415d-b557-b6492170fbbf None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:21.593903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d021177-36d1-415d-b557-b6492170fbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:21.679816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-8d021177-36d1-415d-b557-b6492170fbbf None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:21.688254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8d021177-36d1-415d-b557-b6492170fbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:21.693121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 918/1821] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:21 2022] POST /identity/v3/projects => generated 371 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:21.703142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452d8b3-6cde-4dc6-bf2f-88a7e70de69c admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:21.724671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a452d8b3-6cde-4dc6-bf2f-88a7e70de69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:21.938052 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 904/1822] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:21.939172 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d021177-36d1-415d-b557-b6492170fbbf None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:21.940564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8d021177-36d1-415d-b557-b6492170fbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:21.944385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452d8b3-6cde-4dc6-bf2f-88a7e70de69c admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:21.957582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cb129-0acf-4940-b3a3-05d5bde81298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:21.958741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb129-0acf-4940-b3a3-05d5bde81298 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:21.959499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb129-0acf-4940-b3a3-05d5bde81298 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:21.959784 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb129-0acf-4940-b3a3-05d5bde81298 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:21.961120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cb129-0acf-4940-b3a3-05d5bde81298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:21.969392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cb129-0acf-4940-b3a3-05d5bde81298 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:21.987256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d021177-36d1-415d-b557-b6492170fbbf None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:22.049414 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6414d42-aa08-4bda-ad7a-b3aafd1348dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:22.050329 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 919/1823] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:21 2022] POST /identity/v3/users => generated 292 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:22.052289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6414d42-aa08-4bda-ad7a-b3aafd1348dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:22.052742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6414d42-aa08-4bda-ad7a-b3aafd1348dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:22.052861 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cb129-0acf-4940-b3a3-05d5bde81298 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:22.055355 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6414d42-aa08-4bda-ad7a-b3aafd1348dd admin admin] PATH_INFO: `/v3/users/bdda6a1aee94499989f42c02a3d0acff` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:22.059612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6414d42-aa08-4bda-ad7a-b3aafd1348dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdda6a1aee94499989f42c02a3d0acff)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:22.065963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6414d42-aa08-4bda-ad7a-b3aafd1348dd admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:22.069894 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cb129-0acf-4940-b3a3-05d5bde81298 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:22.080387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8a60-3ecd-4fc1-ac6b-c2a85a11f450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:22.085532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8a60-3ecd-4fc1-ac6b-c2a85a11f450 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:22.086077 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8a60-3ecd-4fc1-ac6b-c2a85a11f450 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:22.086355 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8a60-3ecd-4fc1-ac6b-c2a85a11f450 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:22.088499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8a60-3ecd-4fc1-ac6b-c2a85a11f450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:22.088821 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8a60-3ecd-4fc1-ac6b-c2a85a11f450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:22.092705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8a60-3ecd-4fc1-ac6b-c2a85a11f450 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:22.161844 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 920/1824] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:22.163050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8a60-3ecd-4fc1-ac6b-c2a85a11f450 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:22.205114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8a60-3ecd-4fc1-ac6b-c2a85a11f450 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:22.213123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-c6414d42-aa08-4bda-ad7a-b3aafd1348dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdda6a1aee94499989f42c02a3d0acff'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:22.218866 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2adc6e-383a-4432-a464-46463097e3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:22.220035 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2adc6e-383a-4432-a464-46463097e3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:22.220522 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2adc6e-383a-4432-a464-46463097e3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:22.221008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2adc6e-383a-4432-a464-46463097e3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:22.222137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2adc6e-383a-4432-a464-46463097e3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:22.226848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2adc6e-383a-4432-a464-46463097e3d1 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:22.251007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 921/1825] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:22.252094 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2adc6e-383a-4432-a464-46463097e3d1 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:22.279280 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2adc6e-383a-4432-a464-46463097e3d1 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:22.283878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-c6414d42-aa08-4bda-ad7a-b3aafd1348dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdda6a1aee94499989f42c02a3d0acff'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:22.292867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2bed7-7184-48e2-8ed0-9c843c63af03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:22.294353 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2bed7-7184-48e2-8ed0-9c843c63af03 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:22.294954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2bed7-7184-48e2-8ed0-9c843c63af03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:22.295245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2bed7-7184-48e2-8ed0-9c843c63af03 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:22.295977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2bed7-7184-48e2-8ed0-9c843c63af03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:22.299779 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2bed7-7184-48e2-8ed0-9c843c63af03 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:22.304910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-c6414d42-aa08-4bda-ad7a-b3aafd1348dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdda6a1aee94499989f42c02a3d0acff'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:22.307977 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-c6414d42-aa08-4bda-ad7a-b3aafd1348dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdda6a1aee94499989f42c02a3d0acff'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:22.311700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-c6414d42-aa08-4bda-ad7a-b3aafd1348dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdda6a1aee94499989f42c02a3d0acff'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:22.350800 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 905/1826] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:21 2022] DELETE /identity/v3/users/bdda6a1aee94499989f42c02a3d0acff => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:22.354607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6414d42-aa08-4bda-ad7a-b3aafd1348dd admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:22.358362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-c6414d42-aa08-4bda-ad7a-b3aafd1348dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:22.387729 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 922/1827] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:22 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:22.388932 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49b351-00ba-4fc7-8acb-b29eefef8f08 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:22.389230 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49b351-00ba-4fc7-8acb-b29eefef8f08 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:22.389510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49b351-00ba-4fc7-8acb-b29eefef8f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:22.466885 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-7e49b351-00ba-4fc7-8acb-b29eefef8f08 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:22.479576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-7e49b351-00ba-4fc7-8acb-b29eefef8f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:22.596974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:22.644083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6414d42-aa08-4bda-ad7a-b3aafd1348dd admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:22.693057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 923/1828] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:22.701655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49b351-00ba-4fc7-8acb-b29eefef8f08 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:22.705115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-7e49b351-00ba-4fc7-8acb-b29eefef8f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:22.750682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49b351-00ba-4fc7-8acb-b29eefef8f08 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:22.764807 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b832d-8acb-4b26-b763-24a099e77556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:22.766059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b832d-8acb-4b26-b763-24a099e77556 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:22.766851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b832d-8acb-4b26-b763-24a099e77556 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:22.767274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b832d-8acb-4b26-b763-24a099e77556 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:22.770223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b832d-8acb-4b26-b763-24a099e77556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:22.772511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37ab70-6366-4bf9-886f-8e3801e5d414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:22.774512 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37ab70-6366-4bf9-886f-8e3801e5d414 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:22.776088 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37ab70-6366-4bf9-886f-8e3801e5d414 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:22.776429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37ab70-6366-4bf9-886f-8e3801e5d414 admin admin] PATH_INFO: `/v3/projects/b9685eccbcce4d099f0cdc83228d202a/users/9133f5861cbd4b359f4b38e2c9d836df/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:22.776669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b832d-8acb-4b26-b763-24a099e77556 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:22.811156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:22.828802 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 924/1829] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:22 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:22.830403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b832d-8acb-4b26-b763-24a099e77556 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:22.832014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37ab70-6366-4bf9-886f-8e3801e5d414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9685eccbcce4d099f0cdc83228d202a, user_id=9133f5861cbd4b359f4b38e2c9d836df, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:22.835811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6e4b832d-8acb-4b26-b763-24a099e77556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:22.849252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37ab70-6366-4bf9-886f-8e3801e5d414 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:22.889515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 906/1830] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:22 2022] PUT /identity/v3/projects/b9685eccbcce4d099f0cdc83228d202a/users/9133f5861cbd4b359f4b38e2c9d836df/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:22.889515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37ab70-6366-4bf9-886f-8e3801e5d414 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:22.984512 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b832d-8acb-4b26-b763-24a099e77556 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:23.094465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37ab70-6366-4bf9-886f-8e3801e5d414 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:23.153715 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec17aa-dd98-4015-9544-a91cd9fe959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:23.157586 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec17aa-dd98-4015-9544-a91cd9fe959e admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:23.158116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec17aa-dd98-4015-9544-a91cd9fe959e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:23.160938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec17aa-dd98-4015-9544-a91cd9fe959e admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:23.171265 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a7fb3-08c5-46dc-83cd-58e34ac641fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:23.172071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a7fb3-08c5-46dc-83cd-58e34ac641fa service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:23.172359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a7fb3-08c5-46dc-83cd-58e34ac641fa service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:23.172771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a7fb3-08c5-46dc-83cd-58e34ac641fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:23.175746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec17aa-dd98-4015-9544-a91cd9fe959e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:23.179645 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec17aa-dd98-4015-9544-a91cd9fe959e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:23.193553 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 907/1831] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:23.194333 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec17aa-dd98-4015-9544-a91cd9fe959e admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:23.204466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a7fb3-08c5-46dc-83cd-58e34ac641fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:23.206756 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a7fb3-08c5-46dc-83cd-58e34ac641fa service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:23.207696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec17aa-dd98-4015-9544-a91cd9fe959e admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:23.239010 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1b6d-6253-4316-8c9e-58fa04ccff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:23.239796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1b6d-6253-4316-8c9e-58fa04ccff4a admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:23.240074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1b6d-6253-4316-8c9e-58fa04ccff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:23.240419 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1b6d-6253-4316-8c9e-58fa04ccff4a admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:23.241324 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce1b6d-6253-4316-8c9e-58fa04ccff4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:23.241798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 925/1832] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:23.242942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a7fb3-08c5-46dc-83cd-58e34ac641fa service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:23.243674 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce1b6d-6253-4316-8c9e-58fa04ccff4a admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:23.244748 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-7c3a7fb3-08c5-46dc-83cd-58e34ac641fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:23.265193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 908/1833] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:23.270425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1b6d-6253-4316-8c9e-58fa04ccff4a admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:23.294522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1b6d-6253-4316-8c9e-58fa04ccff4a admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:23.326023 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb831d4-eb67-41d3-be12-7c97139141d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:23.331187 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb831d4-eb67-41d3-be12-7c97139141d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:23.331644 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb831d4-eb67-41d3-be12-7c97139141d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:23.332084 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb831d4-eb67-41d3-be12-7c97139141d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:23.335924 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb831d4-eb67-41d3-be12-7c97139141d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:23.339050 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb831d4-eb67-41d3-be12-7c97139141d8 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:23.371176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 909/1834] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:23.372419 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb831d4-eb67-41d3-be12-7c97139141d8 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:23.412064 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb831d4-eb67-41d3-be12-7c97139141d8 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:23.422030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d514a6-1f2f-47e4-beaf-4215daae2bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:23.423160 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d514a6-1f2f-47e4-beaf-4215daae2bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:23.436161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d514a6-1f2f-47e4-beaf-4215daae2bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:23.436648 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d514a6-1f2f-47e4-beaf-4215daae2bdf admin admin] PATH_INFO: `/v3/projects/b9685eccbcce4d099f0cdc83228d202a/users/9133f5861cbd4b359f4b38e2c9d836df/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:23.439299 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d514a6-1f2f-47e4-beaf-4215daae2bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9685eccbcce4d099f0cdc83228d202a, user_id=9133f5861cbd4b359f4b38e2c9d836df, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:23.444324 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d514a6-1f2f-47e4-beaf-4215daae2bdf admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:23.473343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 910/1835] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:23 2022] PUT /identity/v3/projects/b9685eccbcce4d099f0cdc83228d202a/users/9133f5861cbd4b359f4b38e2c9d836df/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:23.474428 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d514a6-1f2f-47e4-beaf-4215daae2bdf admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:23.476221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-64d514a6-1f2f-47e4-beaf-4215daae2bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:23.516865 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a7fb3-08c5-46dc-83cd-58e34ac641fa service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:23.673792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:23.687104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:23.716723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b97fb-2215-4ff5-9da4-465bef8f74f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:23.717410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b97fb-2215-4ff5-9da4-465bef8f74f1 service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:23.717700 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b97fb-2215-4ff5-9da4-465bef8f74f1 service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:23.717983 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b97fb-2215-4ff5-9da4-465bef8f74f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:23.725424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8f2b97fb-2215-4ff5-9da4-465bef8f74f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:23.768505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b97fb-2215-4ff5-9da4-465bef8f74f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:23.773633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b97fb-2215-4ff5-9da4-465bef8f74f1 service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:23.779306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d514a6-1f2f-47e4-beaf-4215daae2bdf admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:23.803974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cfee7-407a-4838-88a2-adb0b441ee1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:23.806420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cfee7-407a-4838-88a2-adb0b441ee1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:23.806789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cfee7-407a-4838-88a2-adb0b441ee1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:23.807113 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cfee7-407a-4838-88a2-adb0b441ee1c admin admin] PATH_INFO: `/v3/projects/0cb9ab6432974f93837e353cd78805ac` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:23.809000 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 926/1836] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:23.813889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cfee7-407a-4838-88a2-adb0b441ee1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb9ab6432974f93837e353cd78805ac)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:23.823517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b97fb-2215-4ff5-9da4-465bef8f74f1 service nova] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:23.827446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cfee7-407a-4838-88a2-adb0b441ee1c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:23.884946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b97fb-2215-4ff5-9da4-465bef8f74f1 service nova] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:23.902963 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b314d37-98b0-4d6c-94ec-69010ea47432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:23.903891 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b314d37-98b0-4d6c-94ec-69010ea47432 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:23.904150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b314d37-98b0-4d6c-94ec-69010ea47432 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:23.904496 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b314d37-98b0-4d6c-94ec-69010ea47432 admin admin] PATH_INFO: `/v3/projects/d6f3a1fe486f48629dedad69c9babb9f/users/ed0956716ad94254932bffb350824263/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:23.973910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b314d37-98b0-4d6c-94ec-69010ea47432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f3a1fe486f48629dedad69c9babb9f, user_id=ed0956716ad94254932bffb350824263, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:23.977017 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b314d37-98b0-4d6c-94ec-69010ea47432 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:24.015899 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-5b1cfee7-407a-4838-88a2-adb0b441ee1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb9ab6432974f93837e353cd78805ac', 'request_id': 'req-5b1cfee7-407a-4838-88a2-adb0b441ee1c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.016744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 927/1837] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:23 2022] PUT /identity/v3/projects/d6f3a1fe486f48629dedad69c9babb9f/users/ed0956716ad94254932bffb350824263/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:24.017663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b314d37-98b0-4d6c-94ec-69010ea47432 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:24.029635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3b314d37-98b0-4d6c-94ec-69010ea47432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:24.038028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-5b1cfee7-407a-4838-88a2-adb0b441ee1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb9ab6432974f93837e353cd78805ac', 'request_id': 'req-5b1cfee7-407a-4838-88a2-adb0b441ee1c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.060526 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-5b1cfee7-407a-4838-88a2-adb0b441ee1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb9ab6432974f93837e353cd78805ac', 'request_id': 'req-5b1cfee7-407a-4838-88a2-adb0b441ee1c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.103006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-5b1cfee7-407a-4838-88a2-adb0b441ee1c admin admin] The token cache is being invalidate because project 0cb9ab6432974f93837e353cd78805ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:24.103405 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-5b1cfee7-407a-4838-88a2-adb0b441ee1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.105472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-5b1cfee7-407a-4838-88a2-adb0b441ee1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.115281 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 911/1838] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:23 2022] DELETE /identity/v3/projects/0cb9ab6432974f93837e353cd78805ac => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:24.123202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1420c9-9e62-4129-bf49-9e1586f5172c None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:24.123202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1420c9-9e62-4129-bf49-9e1586f5172c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:24.123444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1420c9-9e62-4129-bf49-9e1586f5172c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:24.224585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-db1420c9-9e62-4129-bf49-9e1586f5172c None None] MFA Rules not processed for user `ed0956716ad94254932bffb350824263`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:24.226432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-db1420c9-9e62-4129-bf49-9e1586f5172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:24.241455 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b314d37-98b0-4d6c-94ec-69010ea47432 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:24.247413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:24.254902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:24.256200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:24.258463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] PATH_INFO: `/v3/projects/c093ae2fbd824e6f800f9a47dbdec97c` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:24.262300 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c093ae2fbd824e6f800f9a47dbdec97c)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:24.264395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:24.347914 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c093ae2fbd824e6f800f9a47dbdec97c', 'request_id': 'req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.350610 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 912/1839] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:24.351613 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1420c9-9e62-4129-bf49-9e1586f5172c None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:24.356641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-db1420c9-9e62-4129-bf49-9e1586f5172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:24.364144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c093ae2fbd824e6f800f9a47dbdec97c', 'request_id': 'req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.373795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c093ae2fbd824e6f800f9a47dbdec97c', 'request_id': 'req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.385259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1420c9-9e62-4129-bf49-9e1586f5172c None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:24.389157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] The token cache is being invalidate because project c093ae2fbd824e6f800f9a47dbdec97c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:24.389860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.390816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.392843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 928/1840] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:24 2022] DELETE /identity/v3/projects/c093ae2fbd824e6f800f9a47dbdec97c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:24.397156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:24.400025 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:24.464424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:24.482877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5e48b-2c07-42e3-b787-4ccbbb2a42b8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:24.484443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1865f8-15bb-4104-b5e3-62e2f0ad75d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:24.485600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1865f8-15bb-4104-b5e3-62e2f0ad75d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:24.486034 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1865f8-15bb-4104-b5e3-62e2f0ad75d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:24.486440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1865f8-15bb-4104-b5e3-62e2f0ad75d5 admin admin] PATH_INFO: `/v3/users/91d5350c8ea74c88be829c8274c04b12` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:24.487975 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1865f8-15bb-4104-b5e3-62e2f0ad75d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d5350c8ea74c88be829c8274c04b12)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:24.488454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd69c3e-687c-4727-a411-837e58e52c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:24.489205 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69c3e-687c-4727-a411-837e58e52c83 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:24.489552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69c3e-687c-4727-a411-837e58e52c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:24.489898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69c3e-687c-4727-a411-837e58e52c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:24.490703 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd69c3e-687c-4727-a411-837e58e52c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:24.491904 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1865f8-15bb-4104-b5e3-62e2f0ad75d5 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:24.492778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd69c3e-687c-4727-a411-837e58e52c83 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:24.495367 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:24.524976 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 929/1841] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:24 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:24.529454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd69c3e-687c-4727-a411-837e58e52c83 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:24.531764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2bd69c3e-687c-4727-a411-837e58e52c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:24.576979 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-bd1865f8-15bb-4104-b5e3-62e2f0ad75d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d5350c8ea74c88be829c8274c04b12'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.604222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-bd1865f8-15bb-4104-b5e3-62e2f0ad75d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d5350c8ea74c88be829c8274c04b12'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.608622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd69c3e-687c-4727-a411-837e58e52c83 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:24.612969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-bd1865f8-15bb-4104-b5e3-62e2f0ad75d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d5350c8ea74c88be829c8274c04b12'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.613784 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0e035-27cd-4a36-9827-34ad4082d6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:24.614160 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-bd1865f8-15bb-4104-b5e3-62e2f0ad75d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d5350c8ea74c88be829c8274c04b12'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.615112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0e035-27cd-4a36-9827-34ad4082d6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:24.615247 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-bd1865f8-15bb-4104-b5e3-62e2f0ad75d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d5350c8ea74c88be829c8274c04b12'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.615530 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0e035-27cd-4a36-9827-34ad4082d6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:24.615885 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0e035-27cd-4a36-9827-34ad4082d6cc admin admin] PATH_INFO: `/v3/users/f6e9cc9ebf5f4fe1938d35fcb49d8b20` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:24.617424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0e035-27cd-4a36-9827-34ad4082d6cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e9cc9ebf5f4fe1938d35fcb49d8b20)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:24.619647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0e035-27cd-4a36-9827-34ad4082d6cc admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:24.660495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 913/1842] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:24 2022] DELETE /identity/v3/users/91d5350c8ea74c88be829c8274c04b12 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:24.662096 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1865f8-15bb-4104-b5e3-62e2f0ad75d5 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:24.664019 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-bd1865f8-15bb-4104-b5e3-62e2f0ad75d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:24.709342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-75e0e035-27cd-4a36-9827-34ad4082d6cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e9cc9ebf5f4fe1938d35fcb49d8b20'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.738043 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-75e0e035-27cd-4a36-9827-34ad4082d6cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e9cc9ebf5f4fe1938d35fcb49d8b20'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.739115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-75e0e035-27cd-4a36-9827-34ad4082d6cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e9cc9ebf5f4fe1938d35fcb49d8b20'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.755312 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-75e0e035-27cd-4a36-9827-34ad4082d6cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e9cc9ebf5f4fe1938d35fcb49d8b20'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.758023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-75e0e035-27cd-4a36-9827-34ad4082d6cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e9cc9ebf5f4fe1938d35fcb49d8b20'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:24.768372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1865f8-15bb-4104-b5e3-62e2f0ad75d5 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:24.781820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5685dc-9d31-479e-97c4-1731f95ac950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:24.781820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5685dc-9d31-479e-97c4-1731f95ac950 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:24.781820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5685dc-9d31-479e-97c4-1731f95ac950 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:24.782313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5685dc-9d31-479e-97c4-1731f95ac950 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:24.782753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 930/1843] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:24 2022] DELETE /identity/v3/users/f6e9cc9ebf5f4fe1938d35fcb49d8b20 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:24.783153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5685dc-9d31-479e-97c4-1731f95ac950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:24.785743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5685dc-9d31-479e-97c4-1731f95ac950 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:24.817051 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 914/1844] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:24 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:24.821203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0e035-27cd-4a36-9827-34ad4082d6cc admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:24.823581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-75e0e035-27cd-4a36-9827-34ad4082d6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:24.904922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:24.921435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0e035-27cd-4a36-9827-34ad4082d6cc admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:24.928970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb59459-03a7-4cf8-b42a-2b6bdc73b085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:24.929958 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb59459-03a7-4cf8-b42a-2b6bdc73b085 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:24.930798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb59459-03a7-4cf8-b42a-2b6bdc73b085 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:24.931289 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb59459-03a7-4cf8-b42a-2b6bdc73b085 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:24.932672 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb59459-03a7-4cf8-b42a-2b6bdc73b085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:24.935362 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb59459-03a7-4cf8-b42a-2b6bdc73b085 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:24.987486 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 931/1845] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:24.991778 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5685dc-9d31-479e-97c4-1731f95ac950 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:25.010287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5685dc-9d31-479e-97c4-1731f95ac950 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:25.020863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64121943-2a24-4e55-8358-92ffed3f49c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:25.021733 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64121943-2a24-4e55-8358-92ffed3f49c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:25.022031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64121943-2a24-4e55-8358-92ffed3f49c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:25.022315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64121943-2a24-4e55-8358-92ffed3f49c4 admin admin] PATH_INFO: `/v3/projects/e549786aceb0477382f9cd811fadd3ef/users/bd5625fff2e2400b8a19f579d426e0ee/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:25.055353 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64121943-2a24-4e55-8358-92ffed3f49c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e549786aceb0477382f9cd811fadd3ef, user_id=bd5625fff2e2400b8a19f579d426e0ee, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:25.061548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64121943-2a24-4e55-8358-92ffed3f49c4 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:25.093330 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 915/1846] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:24 2022] PUT /identity/v3/projects/e549786aceb0477382f9cd811fadd3ef/users/bd5625fff2e2400b8a19f579d426e0ee/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:25.098938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb59459-03a7-4cf8-b42a-2b6bdc73b085 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:25.122943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb59459-03a7-4cf8-b42a-2b6bdc73b085 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:25.213086 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fce1d4-816e-4797-af4c-4981d279ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:25.213424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fce1d4-816e-4797-af4c-4981d279ace7 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:25.213710 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fce1d4-816e-4797-af4c-4981d279ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:25.214356 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fce1d4-816e-4797-af4c-4981d279ace7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:25.215244 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fce1d4-816e-4797-af4c-4981d279ace7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:25.217342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fce1d4-816e-4797-af4c-4981d279ace7 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:25.229766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 932/1847] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:25.234145 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64121943-2a24-4e55-8358-92ffed3f49c4 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:25.250637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64121943-2a24-4e55-8358-92ffed3f49c4 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:25.257171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92fb75-80a9-4dce-9486-145b5f413db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:25.258143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92fb75-80a9-4dce-9486-145b5f413db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:25.258517 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92fb75-80a9-4dce-9486-145b5f413db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:25.258803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92fb75-80a9-4dce-9486-145b5f413db2 admin admin] PATH_INFO: `/v3/projects/e549786aceb0477382f9cd811fadd3ef/users/bd5625fff2e2400b8a19f579d426e0ee/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:25.261190 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92fb75-80a9-4dce-9486-145b5f413db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e549786aceb0477382f9cd811fadd3ef, user_id=bd5625fff2e2400b8a19f579d426e0ee, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:25.264797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92fb75-80a9-4dce-9486-145b5f413db2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:25.282876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 916/1848] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:25 2022] PUT /identity/v3/projects/e549786aceb0477382f9cd811fadd3ef/users/bd5625fff2e2400b8a19f579d426e0ee/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:25.286954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d75c7-021b-401c-976e-62e2a6f8368f None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:25.287436 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d75c7-021b-401c-976e-62e2a6f8368f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:25.287523 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d75c7-021b-401c-976e-62e2a6f8368f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:25.325800 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-089d75c7-021b-401c-976e-62e2a6f8368f None None] MFA Rules not processed for user `bd5625fff2e2400b8a19f579d426e0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:25.327729 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-089d75c7-021b-401c-976e-62e2a6f8368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:25.429532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 933/1849] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:25.441483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92fb75-80a9-4dce-9486-145b5f413db2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:25.443636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9f92fb75-80a9-4dce-9486-145b5f413db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:25.515482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=6 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:25.535270 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d75c7-021b-401c-976e-62e2a6f8368f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:25.537665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-089d75c7-021b-401c-976e-62e2a6f8368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:25.567571 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92fb75-80a9-4dce-9486-145b5f413db2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:25.577685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb333ab-c364-4d79-835b-2454f8a3af3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:25.578442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb333ab-c364-4d79-835b-2454f8a3af3e service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:25.578816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb333ab-c364-4d79-835b-2454f8a3af3e service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:25.579174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb333ab-c364-4d79-835b-2454f8a3af3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:25.581230 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-1fb333ab-c364-4d79-835b-2454f8a3af3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:25.645537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d75c7-021b-401c-976e-62e2a6f8368f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:25.654363 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:25.657337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:25.657634 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:25.657925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] PATH_INFO: `/v3/projects/627791738e4f412fb3e083645cadef3e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:25.661835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=627791738e4f412fb3e083645cadef3e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:25.662232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb333ab-c364-4d79-835b-2454f8a3af3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:25.664726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb333ab-c364-4d79-835b-2454f8a3af3e service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:25.665651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:25.698414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:25.703916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 917/1850] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:25.757983 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627791738e4f412fb3e083645cadef3e', 'request_id': 'req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:25.776502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627791738e4f412fb3e083645cadef3e', 'request_id': 'req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:25.788965 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627791738e4f412fb3e083645cadef3e', 'request_id': 'req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:25.807753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] The token cache is being invalidate because project 627791738e4f412fb3e083645cadef3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:25.809907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:25.810816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:25.817126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 934/1851] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:25 2022] DELETE /identity/v3/projects/627791738e4f412fb3e083645cadef3e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:25.817672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb333ab-c364-4d79-835b-2454f8a3af3e service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:25.838280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb333ab-c364-4d79-835b-2454f8a3af3e service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:25.945029 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:25.947141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:26.023451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388f0a4-dc38-4be3-8753-aa174a13c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:26.023451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388f0a4-dc38-4be3-8753-aa174a13c60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:26.023451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388f0a4-dc38-4be3-8753-aa174a13c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:26.023451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388f0a4-dc38-4be3-8753-aa174a13c60f admin admin] PATH_INFO: `/v3/users/03dfcb05f66c48a29026a8ee720b8cfc` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:26.024450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388f0a4-dc38-4be3-8753-aa174a13c60f admin admin] RBAC: Authorizing `identity:delete_user(user_id=03dfcb05f66c48a29026a8ee720b8cfc)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:26.027220 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388f0a4-dc38-4be3-8753-aa174a13c60f admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:26.109509 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1388f0a4-dc38-4be3-8753-aa174a13c60f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03dfcb05f66c48a29026a8ee720b8cfc'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:26.134186 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1388f0a4-dc38-4be3-8753-aa174a13c60f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03dfcb05f66c48a29026a8ee720b8cfc'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:26.155395 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1388f0a4-dc38-4be3-8753-aa174a13c60f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03dfcb05f66c48a29026a8ee720b8cfc'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:26.157374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1388f0a4-dc38-4be3-8753-aa174a13c60f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03dfcb05f66c48a29026a8ee720b8cfc'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:26.168283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-1388f0a4-dc38-4be3-8753-aa174a13c60f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03dfcb05f66c48a29026a8ee720b8cfc'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:26.203085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 918/1852] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:25 2022] DELETE /identity/v3/users/03dfcb05f66c48a29026a8ee720b8cfc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:26.208181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091e284-b688-4aee-8a69-8fd01a93c314 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:26.209868 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091e284-b688-4aee-8a69-8fd01a93c314 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:26.213110 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091e284-b688-4aee-8a69-8fd01a93c314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:26.219210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb092e3-b13a-4eae-8691-dc3d6d9e34b0 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:26.252076 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:26.331885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-2091e284-b688-4aee-8a69-8fd01a93c314 None None] MFA Rules not processed for user `9133f5861cbd4b359f4b38e2c9d836df`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:26.333367 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2091e284-b688-4aee-8a69-8fd01a93c314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:26.408194 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:26.412589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:26.412885 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:26.413181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085 admin admin] PATH_INFO: `/v3/projects/7060c8d1270e4ebd854f280554829907` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:26.415303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7060c8d1270e4ebd854f280554829907)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:26.421155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:26.499350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:26.501324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7060c8d1270e4ebd854f280554829907', 'request_id': 'req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:26.522381 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7060c8d1270e4ebd854f280554829907', 'request_id': 'req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:26.534102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7060c8d1270e4ebd854f280554829907', 'request_id': 'req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:26.548083 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085 admin admin] The token cache is being invalidate because project 7060c8d1270e4ebd854f280554829907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:26.548387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:26.549103 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c3493ebd-60c1-41c4-9b3e-fbe6ff421085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:26.550726 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 935/1853] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:25 2022] DELETE /identity/v3/projects/7060c8d1270e4ebd854f280554829907 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:26.568907 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 919/1854] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:26.573023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a602f0-b746-435f-97d1-03612ab52258 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:26.573633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a602f0-b746-435f-97d1-03612ab52258 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:26.576730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a602f0-b746-435f-97d1-03612ab52258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:26.579266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4eba4f-d9a2-49a1-a253-19fabe509aad None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:26.579681 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4eba4f-d9a2-49a1-a253-19fabe509aad None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:26.580045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4eba4f-d9a2-49a1-a253-19fabe509aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:26.633164 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-45a602f0-b746-435f-97d1-03612ab52258 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:26.644059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-45a602f0-b746-435f-97d1-03612ab52258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:26.764704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-fc4eba4f-d9a2-49a1-a253-19fabe509aad None None] MFA Rules not processed for user `4136a1bfabde41469cad173f51bd01d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:26.766565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-fc4eba4f-d9a2-49a1-a253-19fabe509aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:26.840766 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 920/1855] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:26.853210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 936/1856] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:26.859207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4eba4f-d9a2-49a1-a253-19fabe509aad None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:26.859207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-fc4eba4f-d9a2-49a1-a253-19fabe509aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:26.862284 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d24d21-5d47-4848-abe7-787cebac621d None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:26.863210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d24d21-5d47-4848-abe7-787cebac621d None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:26.863810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d24d21-5d47-4848-abe7-787cebac621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:26.894458 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-f2d24d21-5d47-4848-abe7-787cebac621d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:26.896072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f2d24d21-5d47-4848-abe7-787cebac621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:26.925233 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 937/1857] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:26.926236 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d24d21-5d47-4848-abe7-787cebac621d None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:26.937654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d24d21-5d47-4848-abe7-787cebac621d None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:26.943807 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa094332-4841-4f3e-be91-009498d1e2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:26.944816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094332-4841-4f3e-be91-009498d1e2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:26.945170 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094332-4841-4f3e-be91-009498d1e2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:26.945364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094332-4841-4f3e-be91-009498d1e2d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:26.946190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa094332-4841-4f3e-be91-009498d1e2d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:26.946652 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa094332-4841-4f3e-be91-009498d1e2d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:26.948880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa094332-4841-4f3e-be91-009498d1e2d6 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:26.966497 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 938/1858] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:26.970883 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa094332-4841-4f3e-be91-009498d1e2d6 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:26.984980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa094332-4841-4f3e-be91-009498d1e2d6 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:26.986071 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4eba4f-d9a2-49a1-a253-19fabe509aad None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:26.990432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c9f42-226f-4698-a82f-cea36bc514be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:26.991161 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c9f42-226f-4698-a82f-cea36bc514be admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:26.991495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c9f42-226f-4698-a82f-cea36bc514be admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:26.991773 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c9f42-226f-4698-a82f-cea36bc514be admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:26.992626 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c9f42-226f-4698-a82f-cea36bc514be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:26.994643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51109bf6-7e74-40bd-a15d-beec1cd90697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:26.994913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c9f42-226f-4698-a82f-cea36bc514be admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:26.996781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109bf6-7e74-40bd-a15d-beec1cd90697 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:26.997172 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109bf6-7e74-40bd-a15d-beec1cd90697 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:26.997881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109bf6-7e74-40bd-a15d-beec1cd90697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:27.000038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-51109bf6-7e74-40bd-a15d-beec1cd90697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:27.018394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51109bf6-7e74-40bd-a15d-beec1cd90697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:27.020651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51109bf6-7e74-40bd-a15d-beec1cd90697 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:27.036731 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 921/1859] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:27.055585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 939/1860] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:26 2022] POST /identity/v3/projects => generated 391 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:49:27.056285 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51109bf6-7e74-40bd-a15d-beec1cd90697 service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:27.077721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51109bf6-7e74-40bd-a15d-beec1cd90697 service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:27.117728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:27.175370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeeccb-bb6e-4367-8286-acdbeee5684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:27.176258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeeccb-bb6e-4367-8286-acdbeee5684a admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:27.176695 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeeccb-bb6e-4367-8286-acdbeee5684a admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:27.177066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeeccb-bb6e-4367-8286-acdbeee5684a admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:27.178702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aeeccb-bb6e-4367-8286-acdbeee5684a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:27.181168 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aeeccb-bb6e-4367-8286-acdbeee5684a admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:27.233162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 922/1861] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:27 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:27.237749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c9f42-226f-4698-a82f-cea36bc514be admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:27.254736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c9f42-226f-4698-a82f-cea36bc514be admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:27.263042 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912820b2-c077-4a73-a1d8-3931bee40517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:27.263928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912820b2-c077-4a73-a1d8-3931bee40517 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:27.264295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912820b2-c077-4a73-a1d8-3931bee40517 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:27.264648 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912820b2-c077-4a73-a1d8-3931bee40517 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:27.265549 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912820b2-c077-4a73-a1d8-3931bee40517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:27.267897 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912820b2-c077-4a73-a1d8-3931bee40517 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:27.282007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 940/1862] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:27.286866 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeeccb-bb6e-4367-8286-acdbeee5684a admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:27.299687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeeccb-bb6e-4367-8286-acdbeee5684a admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:27.306805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26543d15-044c-463a-b9de-c6f515e5787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:27.307614 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26543d15-044c-463a-b9de-c6f515e5787b admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:27.307960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26543d15-044c-463a-b9de-c6f515e5787b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:27.308289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26543d15-044c-463a-b9de-c6f515e5787b admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:27.309232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26543d15-044c-463a-b9de-c6f515e5787b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:27.310925 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26543d15-044c-463a-b9de-c6f515e5787b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:27.326791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 923/1863] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:27.328816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912820b2-c077-4a73-a1d8-3931bee40517 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:27.342745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912820b2-c077-4a73-a1d8-3931bee40517 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:27.349600 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08417e-dc57-4b00-8710-dc6c69ff92b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:27.350716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08417e-dc57-4b00-8710-dc6c69ff92b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:27.351175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08417e-dc57-4b00-8710-dc6c69ff92b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:27.351618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08417e-dc57-4b00-8710-dc6c69ff92b4 admin admin] PATH_INFO: `/v3/projects/33692bedceb541958d19a8aa1e040982/users/bc1f55762b4d43cf96f664336b1bf4a5/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:27.375293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08417e-dc57-4b00-8710-dc6c69ff92b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33692bedceb541958d19a8aa1e040982, user_id=bc1f55762b4d43cf96f664336b1bf4a5, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:27.379156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08417e-dc57-4b00-8710-dc6c69ff92b4 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:27.397342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 941/1864] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:27 2022] PUT /identity/v3/projects/33692bedceb541958d19a8aa1e040982/users/bc1f55762b4d43cf96f664336b1bf4a5/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:27.409127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91487b-eede-4a33-8c92-bca8792ade46 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:27.409453 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91487b-eede-4a33-8c92-bca8792ade46 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:27.409682 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91487b-eede-4a33-8c92-bca8792ade46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:27.440171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-2e91487b-eede-4a33-8c92-bca8792ade46 None None] MFA Rules not processed for user `bc1f55762b4d43cf96f664336b1bf4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:27.441560 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2e91487b-eede-4a33-8c92-bca8792ade46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:27.548745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 924/1865] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:27.550706 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08417e-dc57-4b00-8710-dc6c69ff92b4 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:27.701124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08417e-dc57-4b00-8710-dc6c69ff92b4 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:27.724792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c38db-e05f-4773-a426-c50bd855274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:27.726621 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c38db-e05f-4773-a426-c50bd855274c admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:27.726621 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c38db-e05f-4773-a426-c50bd855274c admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:27.726621 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c38db-e05f-4773-a426-c50bd855274c admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:27.727344 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c38db-e05f-4773-a426-c50bd855274c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:27.729852 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c38db-e05f-4773-a426-c50bd855274c admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:27.735387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:27.776553 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91487b-eede-4a33-8c92-bca8792ade46 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:27.779532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 942/1866] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:27 2022] POST /identity/v3/projects => generated 391 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:27.790879 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91487b-eede-4a33-8c92-bca8792ade46 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:27.929265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981cc7e-8d4f-4f75-8217-f95accf40a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:27.931080 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981cc7e-8d4f-4f75-8217-f95accf40a6b admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:27.931583 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981cc7e-8d4f-4f75-8217-f95accf40a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:27.931851 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981cc7e-8d4f-4f75-8217-f95accf40a6b admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:27.932686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981cc7e-8d4f-4f75-8217-f95accf40a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:27.935249 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981cc7e-8d4f-4f75-8217-f95accf40a6b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:27.964737 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 925/1867] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:27 2022] POST /identity/v3/users => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:27.971260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c38db-e05f-4773-a426-c50bd855274c admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:27.974630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981cc7e-8d4f-4f75-8217-f95accf40a6b admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:27.978071 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-f981cc7e-8d4f-4f75-8217-f95accf40a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:28.007494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c38db-e05f-4773-a426-c50bd855274c admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:28.011028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981cc7e-8d4f-4f75-8217-f95accf40a6b admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:28.031191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f53a23-ae92-45ee-a19d-474e1c0d37ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:28.031894 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6c933-83f5-467f-ae31-9293fcfe7593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:28.032162 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f53a23-ae92-45ee-a19d-474e1c0d37ba admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:28.032593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f53a23-ae92-45ee-a19d-474e1c0d37ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:28.032927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f53a23-ae92-45ee-a19d-474e1c0d37ba admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:28.033837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f53a23-ae92-45ee-a19d-474e1c0d37ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:28.036058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f53a23-ae92-45ee-a19d-474e1c0d37ba admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:28.036341 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c933-83f5-467f-ae31-9293fcfe7593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:28.036605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c933-83f5-467f-ae31-9293fcfe7593 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:28.036956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c933-83f5-467f-ae31-9293fcfe7593 admin admin] PATH_INFO: `/v3/projects/e3ca2a2e426a452495ae99a4ac3d5248` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:28.039553 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6c933-83f5-467f-ae31-9293fcfe7593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ca2a2e426a452495ae99a4ac3d5248)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:28.045987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6c933-83f5-467f-ae31-9293fcfe7593 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:28.054423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 943/1868] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:28.056860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f53a23-ae92-45ee-a19d-474e1c0d37ba admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:28.072584 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:28.080666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f53a23-ae92-45ee-a19d-474e1c0d37ba admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:28.089606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22514a-ec36-49c8-a092-aa3ae99c49c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:28.090669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22514a-ec36-49c8-a092-aa3ae99c49c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:28.091057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22514a-ec36-49c8-a092-aa3ae99c49c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:28.091435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22514a-ec36-49c8-a092-aa3ae99c49c6 admin admin] PATH_INFO: `/v3/projects/1da2b778b4bf4e8db5c30d73230cf60f/users/a3716756415a4833a2d0adf182ae8699/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:28.114148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-41d6c933-83f5-467f-ae31-9293fcfe7593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ca2a2e426a452495ae99a4ac3d5248', 'request_id': 'req-41d6c933-83f5-467f-ae31-9293fcfe7593'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:28.115288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22514a-ec36-49c8-a092-aa3ae99c49c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da2b778b4bf4e8db5c30d73230cf60f, user_id=a3716756415a4833a2d0adf182ae8699, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:28.118512 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22514a-ec36-49c8-a092-aa3ae99c49c6 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:28.127625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-41d6c933-83f5-467f-ae31-9293fcfe7593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ca2a2e426a452495ae99a4ac3d5248', 'request_id': 'req-41d6c933-83f5-467f-ae31-9293fcfe7593'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:28.135172 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-41d6c933-83f5-467f-ae31-9293fcfe7593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ca2a2e426a452495ae99a4ac3d5248', 'request_id': 'req-41d6c933-83f5-467f-ae31-9293fcfe7593'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:28.141049 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 944/1869] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:28 2022] PUT /identity/v3/projects/1da2b778b4bf4e8db5c30d73230cf60f/users/a3716756415a4833a2d0adf182ae8699/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:28.145662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22514a-ec36-49c8-a092-aa3ae99c49c6 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:28.178360 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-41d6c933-83f5-467f-ae31-9293fcfe7593 admin admin] The token cache is being invalidate because project e3ca2a2e426a452495ae99a4ac3d5248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:28.178703 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-41d6c933-83f5-467f-ae31-9293fcfe7593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:28.181674 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-41d6c933-83f5-467f-ae31-9293fcfe7593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:28.185917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 926/1870] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:27 2022] DELETE /identity/v3/projects/e3ca2a2e426a452495ae99a4ac3d5248 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:28.192094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba79c2-5c1e-4911-ae08-1c7a3f9edc02 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:28.192590 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba79c2-5c1e-4911-ae08-1c7a3f9edc02 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:28.193025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba79c2-5c1e-4911-ae08-1c7a3f9edc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:28.244776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-89ba79c2-5c1e-4911-ae08-1c7a3f9edc02 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:28.247697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-89ba79c2-5c1e-4911-ae08-1c7a3f9edc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:28.330903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22514a-ec36-49c8-a092-aa3ae99c49c6 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:28.343156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672be5d1-3dc0-4a5b-9d64-0f8868778f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:28.344072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672be5d1-3dc0-4a5b-9d64-0f8868778f3e admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:28.344417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672be5d1-3dc0-4a5b-9d64-0f8868778f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:28.344766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672be5d1-3dc0-4a5b-9d64-0f8868778f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:28.345667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672be5d1-3dc0-4a5b-9d64-0f8868778f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:28.347659 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672be5d1-3dc0-4a5b-9d64-0f8868778f3e admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:28.363485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 945/1871] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:28.375370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672be5d1-3dc0-4a5b-9d64-0f8868778f3e admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:28.378143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-672be5d1-3dc0-4a5b-9d64-0f8868778f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:28.395573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 927/1872] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:28.397662 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba541c00-12ad-4249-9b5b-cac692419172 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:28.397956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba541c00-12ad-4249-9b5b-cac692419172 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:28.398239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba541c00-12ad-4249-9b5b-cac692419172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:28.404910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672be5d1-3dc0-4a5b-9d64-0f8868778f3e admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:28.410395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd0aa6-6339-475e-8421-cdc7e3f21192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:28.411683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd0aa6-6339-475e-8421-cdc7e3f21192 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:28.412066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd0aa6-6339-475e-8421-cdc7e3f21192 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:28.412437 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd0aa6-6339-475e-8421-cdc7e3f21192 admin admin] PATH_INFO: `/v3/projects/1da2b778b4bf4e8db5c30d73230cf60f/users/a3716756415a4833a2d0adf182ae8699/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:28.414937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd0aa6-6339-475e-8421-cdc7e3f21192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da2b778b4bf4e8db5c30d73230cf60f, user_id=a3716756415a4833a2d0adf182ae8699, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:28.418863 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd0aa6-6339-475e-8421-cdc7e3f21192 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:28.422707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ba541c00-12ad-4249-9b5b-cac692419172 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:28.424479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ba541c00-12ad-4249-9b5b-cac692419172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:28.438419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 946/1873] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:28 2022] PUT /identity/v3/projects/1da2b778b4bf4e8db5c30d73230cf60f/users/a3716756415a4833a2d0adf182ae8699/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:28.449179 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a971a-e88d-4ff5-9197-c0a855e16439 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:28.449469 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a971a-e88d-4ff5-9197-c0a855e16439 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:28.449910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a971a-e88d-4ff5-9197-c0a855e16439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:28.492540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-411a971a-e88d-4ff5-9197-c0a855e16439 None None] MFA Rules not processed for user `a3716756415a4833a2d0adf182ae8699`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:28.494108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-411a971a-e88d-4ff5-9197-c0a855e16439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:28.536106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 928/1874] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:28.543917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba541c00-12ad-4249-9b5b-cac692419172 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:28.557340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba541c00-12ad-4249-9b5b-cac692419172 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:28.570492 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4c4e2-df44-4dab-a49c-598e09562ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:28.571400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c4e2-df44-4dab-a49c-598e09562ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:28.571686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c4e2-df44-4dab-a49c-598e09562ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:28.572058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c4e2-df44-4dab-a49c-598e09562ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:28.586172 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4c4e2-df44-4dab-a49c-598e09562ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:28.586531 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4c4e2-df44-4dab-a49c-598e09562ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:28.600705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4c4e2-df44-4dab-a49c-598e09562ea8 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:28.632934 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 929/1875] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:28.639146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4c4e2-df44-4dab-a49c-598e09562ea8 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:28.669285 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4c4e2-df44-4dab-a49c-598e09562ea8 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:28.678365 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2d0f0-9417-4f96-a436-1f921a35aaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:28.679172 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2d0f0-9417-4f96-a436-1f921a35aaff admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:28.679834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2d0f0-9417-4f96-a436-1f921a35aaff admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:28.679834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2d0f0-9417-4f96-a436-1f921a35aaff admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:28.680484 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2d0f0-9417-4f96-a436-1f921a35aaff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:28.686371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2d0f0-9417-4f96-a436-1f921a35aaff admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:28.691919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 947/1876] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:28.694085 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2e944-0e12-4ce9-851e-ffc805f3530d None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:28.694085 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2e944-0e12-4ce9-851e-ffc805f3530d None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:28.694293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2e944-0e12-4ce9-851e-ffc805f3530d None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:28.696267 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 948/1877] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 03:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:49:28.701826 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2e944-0e12-4ce9-851e-ffc805f3530d None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:28.706123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-52e2e944-0e12-4ce9-851e-ffc805f3530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:28.754175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 930/1878] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:28 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:28.755700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2d0f0-9417-4f96-a436-1f921a35aaff admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:28.756922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:28.778257 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:28.823293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2e944-0e12-4ce9-851e-ffc805f3530d None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:28.897177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2d0f0-9417-4f96-a436-1f921a35aaff admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:28.902609 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993911c-0345-4984-bba7-48af8c370671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:28.903775 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993911c-0345-4984-bba7-48af8c370671 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:28.904773 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993911c-0345-4984-bba7-48af8c370671 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:28.905239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993911c-0345-4984-bba7-48af8c370671 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:28.906205 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993911c-0345-4984-bba7-48af8c370671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:28.908489 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993911c-0345-4984-bba7-48af8c370671 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:28.919518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f760a4b-3e55-46e9-8cb2-bafe8020df0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:28.920235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f760a4b-3e55-46e9-8cb2-bafe8020df0a service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:28.920520 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f760a4b-3e55-46e9-8cb2-bafe8020df0a service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:28.920842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f760a4b-3e55-46e9-8cb2-bafe8020df0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:28.969715 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 931/1879] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:28 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:49:28.975515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a1a6-4583-401d-9f72-b112e5314e62 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:28.977134 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a1a6-4583-401d-9f72-b112e5314e62 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:28.979633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a1a6-4583-401d-9f72-b112e5314e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:29.023879 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ea75a1a6-4583-401d-9f72-b112e5314e62 None None] MFA Rules not processed for user `758b152c320e4a94921bb96541cbea98`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:29.027450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ea75a1a6-4583-401d-9f72-b112e5314e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:29.064396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f760a4b-3e55-46e9-8cb2-bafe8020df0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:29.066529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f760a4b-3e55-46e9-8cb2-bafe8020df0a service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:29.080047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 949/1880] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:29.081409 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f760a4b-3e55-46e9-8cb2-bafe8020df0a service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:29.096816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f760a4b-3e55-46e9-8cb2-bafe8020df0a service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:29.104816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765f43-3b66-4708-9c6f-88aa322b9469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:29.105538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765f43-3b66-4708-9c6f-88aa322b9469 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:29.105821 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765f43-3b66-4708-9c6f-88aa322b9469 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:29.106093 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765f43-3b66-4708-9c6f-88aa322b9469 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:29.107292 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e765f43-3b66-4708-9c6f-88aa322b9469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:29.109931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e765f43-3b66-4708-9c6f-88aa322b9469 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:29.132890 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 950/1881] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:29.133810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765f43-3b66-4708-9c6f-88aa322b9469 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:29.138910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9e765f43-3b66-4708-9c6f-88aa322b9469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:29.153310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765f43-3b66-4708-9c6f-88aa322b9469 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:29.158680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e70419-de1f-475e-990f-1a6d6235f3bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:29.159506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70419-de1f-475e-990f-1a6d6235f3bb service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:29.159888 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70419-de1f-475e-990f-1a6d6235f3bb service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:29.160419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70419-de1f-475e-990f-1a6d6235f3bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:29.161091 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 932/1882] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 03:49:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:29.164270 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d6e70419-de1f-475e-990f-1a6d6235f3bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:29.165474 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75a1a6-4583-401d-9f72-b112e5314e62 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:29.195676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75a1a6-4583-401d-9f72-b112e5314e62 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:29.215268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eb604-f1ae-42ce-887f-1b0ff50f6ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:29.217832 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb604-f1ae-42ce-887f-1b0ff50f6ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:29.218119 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb604-f1ae-42ce-887f-1b0ff50f6ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:29.218395 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb604-f1ae-42ce-887f-1b0ff50f6ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:29.222745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8eb604-f1ae-42ce-887f-1b0ff50f6ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:29.227069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8eb604-f1ae-42ce-887f-1b0ff50f6ba6 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:29.256687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 933/1883] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:29.259514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eb604-f1ae-42ce-887f-1b0ff50f6ba6 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:29.286440 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e70419-de1f-475e-990f-1a6d6235f3bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:29.289225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e70419-de1f-475e-990f-1a6d6235f3bb service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:29.289605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eb604-f1ae-42ce-887f-1b0ff50f6ba6 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:29.298502 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017f7f4-85f5-4100-9a42-a5fba10beca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:29.299353 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017f7f4-85f5-4100-9a42-a5fba10beca0 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:29.300431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017f7f4-85f5-4100-9a42-a5fba10beca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:29.300810 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017f7f4-85f5-4100-9a42-a5fba10beca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:29.305353 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3017f7f4-85f5-4100-9a42-a5fba10beca0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:29.328243 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 951/1884] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:29.329489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e70419-de1f-475e-990f-1a6d6235f3bb service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:29.374998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e70419-de1f-475e-990f-1a6d6235f3bb service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:29.387789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f4c15-2d00-414e-9a63-412c1557420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:29.389619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f4c15-2d00-414e-9a63-412c1557420d admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:29.390408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f4c15-2d00-414e-9a63-412c1557420d admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:29.391367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f4c15-2d00-414e-9a63-412c1557420d admin admin] PATH_INFO: `/v3/projects/44ca2d008d5949318b09c1b472e60f67/users/155813f588c74e5388e6e33e151374c2/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:29.398515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:29.435942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f4c15-2d00-414e-9a63-412c1557420d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ca2d008d5949318b09c1b472e60f67, user_id=155813f588c74e5388e6e33e151374c2, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:29.442150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f4c15-2d00-414e-9a63-412c1557420d admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:29.474365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 952/1885] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:29 2022] PUT /identity/v3/projects/44ca2d008d5949318b09c1b472e60f67/users/155813f588c74e5388e6e33e151374c2/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:29.488352 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eb162-73ff-45fb-9d8b-fa2498a3fb00 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:29.488731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eb162-73ff-45fb-9d8b-fa2498a3fb00 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:29.489136 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eb162-73ff-45fb-9d8b-fa2498a3fb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:29.500853 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017f7f4-85f5-4100-9a42-a5fba10beca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:29.502331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017f7f4-85f5-4100-9a42-a5fba10beca0 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:29.531828 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 934/1886] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:29.571724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-152eb162-73ff-45fb-9d8b-fa2498a3fb00 None None] MFA Rules not processed for user `155813f588c74e5388e6e33e151374c2`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:29.572939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-152eb162-73ff-45fb-9d8b-fa2498a3fb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:29.734615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 953/1887] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:29.735783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017f7f4-85f5-4100-9a42-a5fba10beca0 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:29.752113 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017f7f4-85f5-4100-9a42-a5fba10beca0 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:29.786388 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:29.899326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63008953-7924-49ed-a0da-b44bb1e5c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:29.900103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63008953-7924-49ed-a0da-b44bb1e5c3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:29.900471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63008953-7924-49ed-a0da-b44bb1e5c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:29.900839 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63008953-7924-49ed-a0da-b44bb1e5c3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:29.901638 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63008953-7924-49ed-a0da-b44bb1e5c3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:29.903957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63008953-7924-49ed-a0da-b44bb1e5c3f2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:29.946129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 935/1888] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:29 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:29.946543 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152eb162-73ff-45fb-9d8b-fa2498a3fb00 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:29.964163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152eb162-73ff-45fb-9d8b-fa2498a3fb00 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:30.090574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6249c1-b06b-4ab1-833b-c861c33e0d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:30.091479 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6249c1-b06b-4ab1-833b-c861c33e0d99 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:30.091910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6249c1-b06b-4ab1-833b-c861c33e0d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:30.092375 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6249c1-b06b-4ab1-833b-c861c33e0d99 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:30.093187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6249c1-b06b-4ab1-833b-c861c33e0d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:30.095358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6249c1-b06b-4ab1-833b-c861c33e0d99 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:30.127577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 954/1889] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:29 2022] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:30.129286 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63008953-7924-49ed-a0da-b44bb1e5c3f2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:30.141596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63008953-7924-49ed-a0da-b44bb1e5c3f2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:30.150196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dba90b-bc4b-4354-a42f-941c6040d768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:30.150196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dba90b-bc4b-4354-a42f-941c6040d768 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:30.150196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dba90b-bc4b-4354-a42f-941c6040d768 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:30.150196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dba90b-bc4b-4354-a42f-941c6040d768 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:30.150557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dba90b-bc4b-4354-a42f-941c6040d768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:30.159827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6249c1-b06b-4ab1-833b-c861c33e0d99 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:30.160815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dba90b-bc4b-4354-a42f-941c6040d768 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:30.161751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-bf6249c1-b06b-4ab1-833b-c861c33e0d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:30.194283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 936/1890] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:30.199523 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dba90b-bc4b-4354-a42f-941c6040d768 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:30.215065 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dba90b-bc4b-4354-a42f-941c6040d768 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:30.222444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb22f2-2137-4e21-9c15-6cef3c80df28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:30.223676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb22f2-2137-4e21-9c15-6cef3c80df28 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:30.223963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb22f2-2137-4e21-9c15-6cef3c80df28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:30.224356 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb22f2-2137-4e21-9c15-6cef3c80df28 admin admin] PATH_INFO: `/v3/projects/461f4e0ecfbf44b69fba716c5f72eaf0/users/62503c2a5f374103a2bab0a9349bb3eb/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:30.230903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:30.242083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb22f2-2137-4e21-9c15-6cef3c80df28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461f4e0ecfbf44b69fba716c5f72eaf0, user_id=62503c2a5f374103a2bab0a9349bb3eb, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:30.245462 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb22f2-2137-4e21-9c15-6cef3c80df28 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:30.251204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6249c1-b06b-4ab1-833b-c861c33e0d99 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:30.257795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cdbbe-a6a4-4738-968b-7db2a60d4b4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:30.258467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cdbbe-a6a4-4738-968b-7db2a60d4b4f service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:30.258787 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cdbbe-a6a4-4738-968b-7db2a60d4b4f service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:30.259062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cdbbe-a6a4-4738-968b-7db2a60d4b4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:30.262029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 937/1891] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:30 2022] PUT /identity/v3/projects/461f4e0ecfbf44b69fba716c5f72eaf0/users/62503c2a5f374103a2bab0a9349bb3eb/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:30.265990 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb22f2-2137-4e21-9c15-6cef3c80df28 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:30.270079 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cdbbe-a6a4-4738-968b-7db2a60d4b4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:30.272435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cdbbe-a6a4-4738-968b-7db2a60d4b4f service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:30.284084 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 955/1892] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:30.344819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb22f2-2137-4e21-9c15-6cef3c80df28 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:30.350166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da3d22-aa65-4e60-bda8-c3b5088d6a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:30.350939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da3d22-aa65-4e60-bda8-c3b5088d6a57 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:30.351259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da3d22-aa65-4e60-bda8-c3b5088d6a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:30.351569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da3d22-aa65-4e60-bda8-c3b5088d6a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:30.352991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da3d22-aa65-4e60-bda8-c3b5088d6a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:30.356107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da3d22-aa65-4e60-bda8-c3b5088d6a57 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:30.371005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 938/1893] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:49:30.375913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cdbbe-a6a4-4738-968b-7db2a60d4b4f service nova] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:30.390253 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cdbbe-a6a4-4738-968b-7db2a60d4b4f service nova] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:30.414113 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55244d-40b1-46f9-b516-9b8e1437c1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:30.416057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55244d-40b1-46f9-b516-9b8e1437c1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:30.416690 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55244d-40b1-46f9-b516-9b8e1437c1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:30.417282 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55244d-40b1-46f9-b516-9b8e1437c1c2 admin admin] PATH_INFO: `/v3/projects/461f4e0ecfbf44b69fba716c5f72eaf0/users/62503c2a5f374103a2bab0a9349bb3eb/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:30.420229 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55244d-40b1-46f9-b516-9b8e1437c1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461f4e0ecfbf44b69fba716c5f72eaf0, user_id=62503c2a5f374103a2bab0a9349bb3eb, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:30.423639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55244d-40b1-46f9-b516-9b8e1437c1c2 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:30.437912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 956/1894] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:30 2022] PUT /identity/v3/projects/461f4e0ecfbf44b69fba716c5f72eaf0/users/62503c2a5f374103a2bab0a9349bb3eb/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:30.450070 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202425bd-0238-4f14-8de4-dad59938cec5 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:30.450344 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202425bd-0238-4f14-8de4-dad59938cec5 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:30.450641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202425bd-0238-4f14-8de4-dad59938cec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:30.484866 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-202425bd-0238-4f14-8de4-dad59938cec5 None None] MFA Rules not processed for user `62503c2a5f374103a2bab0a9349bb3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:30.486083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-202425bd-0238-4f14-8de4-dad59938cec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:30.553618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:30.579326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 939/1895] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:30.593487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55244d-40b1-46f9-b516-9b8e1437c1c2 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:30.729613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55244d-40b1-46f9-b516-9b8e1437c1c2 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:30.735511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cc4ea-4567-43d9-851d-8c329428d744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:30.736308 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cc4ea-4567-43d9-851d-8c329428d744 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:30.736652 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cc4ea-4567-43d9-851d-8c329428d744 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:30.737053 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cc4ea-4567-43d9-851d-8c329428d744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:30.834449 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cc4ea-4567-43d9-851d-8c329428d744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:30.835932 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cc4ea-4567-43d9-851d-8c329428d744 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:30.847468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 957/1896] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:31.461393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef5370-c59e-4e63-bd85-70e23c31ac9c None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:31.462619 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef5370-c59e-4e63-bd85-70e23c31ac9c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:31.463104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef5370-c59e-4e63-bd85-70e23c31ac9c None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:31.465000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 940/1897] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 03:49:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:49:31.478539 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775e10c-a522-4466-b56f-9fe936a470fe None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:31.478882 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775e10c-a522-4466-b56f-9fe936a470fe None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:31.479687 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775e10c-a522-4466-b56f-9fe936a470fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:31.512087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-2775e10c-a522-4466-b56f-9fe936a470fe None None] MFA Rules not processed for user `758b152c320e4a94921bb96541cbea98`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:31.513295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2775e10c-a522-4466-b56f-9fe936a470fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:31.610680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 958/1898] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 03:49:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:31.630602 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef5370-c59e-4e63-bd85-70e23c31ac9c None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:31.663825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef5370-c59e-4e63-bd85-70e23c31ac9c None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:31.672912 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401f4ac-5fad-4f06-89ee-907d1d9a1eeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:31.674026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401f4ac-5fad-4f06-89ee-907d1d9a1eeb service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:31.675159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401f4ac-5fad-4f06-89ee-907d1d9a1eeb service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:31.675704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401f4ac-5fad-4f06-89ee-907d1d9a1eeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:31.689238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401f4ac-5fad-4f06-89ee-907d1d9a1eeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:31.691118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401f4ac-5fad-4f06-89ee-907d1d9a1eeb service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:31.713686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 941/1899] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:34.028190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775e10c-a522-4466-b56f-9fe936a470fe None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:34.051214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:34.112250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775e10c-a522-4466-b56f-9fe936a470fe None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:34.127769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf644138-e25d-40e1-8977-cc4a1268e7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:34.127769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf644138-e25d-40e1-8977-cc4a1268e7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:34.127769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf644138-e25d-40e1-8977-cc4a1268e7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:34.127769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf644138-e25d-40e1-8977-cc4a1268e7c4 admin admin] PATH_INFO: `/v3/users/bc1f55762b4d43cf96f664336b1bf4a5` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:34.128805 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf644138-e25d-40e1-8977-cc4a1268e7c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1f55762b4d43cf96f664336b1bf4a5)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:34.131051 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf644138-e25d-40e1-8977-cc4a1268e7c4 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:34.188678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-cf644138-e25d-40e1-8977-cc4a1268e7c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1f55762b4d43cf96f664336b1bf4a5'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:34.205361 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-cf644138-e25d-40e1-8977-cc4a1268e7c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1f55762b4d43cf96f664336b1bf4a5'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:34.206606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-cf644138-e25d-40e1-8977-cc4a1268e7c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1f55762b4d43cf96f664336b1bf4a5'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:34.220104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-cf644138-e25d-40e1-8977-cc4a1268e7c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1f55762b4d43cf96f664336b1bf4a5'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:34.221330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-cf644138-e25d-40e1-8977-cc4a1268e7c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1f55762b4d43cf96f664336b1bf4a5'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:34.242392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 959/1900] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:34 2022] DELETE /identity/v3/users/bc1f55762b4d43cf96f664336b1bf4a5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:34.247035 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d606c4-3c35-42f3-8682-f2c0014a4805 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:34.247678 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d606c4-3c35-42f3-8682-f2c0014a4805 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:34.248370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d606c4-3c35-42f3-8682-f2c0014a4805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:34.268986 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-79d606c4-3c35-42f3-8682-f2c0014a4805 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:34.270503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-79d606c4-3c35-42f3-8682-f2c0014a4805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:34.360524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 942/1901] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:34.372301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf644138-e25d-40e1-8977-cc4a1268e7c4 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:34.373973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-cf644138-e25d-40e1-8977-cc4a1268e7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:34.463578 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf644138-e25d-40e1-8977-cc4a1268e7c4 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:34.470950 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd0ca3-a328-4d37-bdb9-031ddd4ad57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:34.471746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd0ca3-a328-4d37-bdb9-031ddd4ad57c service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:34.472035 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd0ca3-a328-4d37-bdb9-031ddd4ad57c service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:34.472821 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd0ca3-a328-4d37-bdb9-031ddd4ad57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:34.487717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd0ca3-a328-4d37-bdb9-031ddd4ad57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:34.489240 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd0ca3-a328-4d37-bdb9-031ddd4ad57c service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:34.519442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 960/1902] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:34.815937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d606c4-3c35-42f3-8682-f2c0014a4805 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:34.818792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-79d606c4-3c35-42f3-8682-f2c0014a4805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:34.833393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d606c4-3c35-42f3-8682-f2c0014a4805 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:34.849201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:34.850626 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:34.851244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:34.851636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] PATH_INFO: `/v3/projects/33692bedceb541958d19a8aa1e040982` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:34.853566 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33692bedceb541958d19a8aa1e040982)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:34.856203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:34.916316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33692bedceb541958d19a8aa1e040982', 'request_id': 'req-e813603f-e586-49ff-82bd-b0c23dc08a59'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:34.927137 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33692bedceb541958d19a8aa1e040982', 'request_id': 'req-e813603f-e586-49ff-82bd-b0c23dc08a59'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:34.934566 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33692bedceb541958d19a8aa1e040982', 'request_id': 'req-e813603f-e586-49ff-82bd-b0c23dc08a59'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:34.951706 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] The token cache is being invalidate because project 33692bedceb541958d19a8aa1e040982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:34.952084 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:34.953227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:34.955624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 943/1903] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:34 2022] DELETE /identity/v3/projects/33692bedceb541958d19a8aa1e040982 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:34.959757 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd0ca3-a328-4d37-bdb9-031ddd4ad57c service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:34.972293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd0ca3-a328-4d37-bdb9-031ddd4ad57c service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:35.034725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:35.066032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f83fc-bb21-42c2-9b83-622ba72858c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:35.068118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f83fc-bb21-42c2-9b83-622ba72858c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:35.068816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f83fc-bb21-42c2-9b83-622ba72858c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:35.070021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f83fc-bb21-42c2-9b83-622ba72858c5 admin admin] PATH_INFO: `/v3/users/a3716756415a4833a2d0adf182ae8699` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:35.071472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f83fc-bb21-42c2-9b83-622ba72858c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3716756415a4833a2d0adf182ae8699)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:35.073797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f83fc-bb21-42c2-9b83-622ba72858c5 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:35.177792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-fb3f83fc-bb21-42c2-9b83-622ba72858c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3716756415a4833a2d0adf182ae8699'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:35.209726 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-fb3f83fc-bb21-42c2-9b83-622ba72858c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3716756415a4833a2d0adf182ae8699'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:35.210719 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-fb3f83fc-bb21-42c2-9b83-622ba72858c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3716756415a4833a2d0adf182ae8699'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:35.223322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-fb3f83fc-bb21-42c2-9b83-622ba72858c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3716756415a4833a2d0adf182ae8699'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:35.224105 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-fb3f83fc-bb21-42c2-9b83-622ba72858c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3716756415a4833a2d0adf182ae8699'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:35.257352 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 961/1904] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:34 2022] DELETE /identity/v3/users/a3716756415a4833a2d0adf182ae8699 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:35.629075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:35.630701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:35.647370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813603f-e586-49ff-82bd-b0c23dc08a59 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:35.677082 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f83fc-bb21-42c2-9b83-622ba72858c5 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:35.680074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-fb3f83fc-bb21-42c2-9b83-622ba72858c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:35.738317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:35.739587 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:35.740030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:35.740607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097 admin admin] PATH_INFO: `/v3/projects/1da2b778b4bf4e8db5c30d73230cf60f` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:35.742058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da2b778b4bf4e8db5c30d73230cf60f)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:35.744160 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:35.746486 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:35.807165 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f83fc-bb21-42c2-9b83-622ba72858c5 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:35.809371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da2b778b4bf4e8db5c30d73230cf60f', 'request_id': 'req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:35.824424 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da2b778b4bf4e8db5c30d73230cf60f', 'request_id': 'req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:35.842562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da2b778b4bf4e8db5c30d73230cf60f', 'request_id': 'req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:35.869835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097 admin admin] The token cache is being invalidate because project 1da2b778b4bf4e8db5c30d73230cf60f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:35.871239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:35.874316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f60d7824-edc8-4a9f-bce1-f6c8dd5bc097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:35.878640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 944/1905] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:35 2022] DELETE /identity/v3/projects/1da2b778b4bf4e8db5c30d73230cf60f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:35.885789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db964b99-f6f3-4f1f-a136-441e95ccdc3a None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:35.886337 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db964b99-f6f3-4f1f-a136-441e95ccdc3a None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:35.887116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db964b99-f6f3-4f1f-a136-441e95ccdc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:35.897665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e58eee-3b69-419a-82d6-f641bf932892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:35.898525 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e58eee-3b69-419a-82d6-f641bf932892 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:35.898913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e58eee-3b69-419a-82d6-f641bf932892 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:35.899275 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e58eee-3b69-419a-82d6-f641bf932892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:35.901613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-18e58eee-3b69-419a-82d6-f641bf932892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:35.944743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:35.949941 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-db964b99-f6f3-4f1f-a136-441e95ccdc3a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:35.951765 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-db964b99-f6f3-4f1f-a136-441e95ccdc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:35.991846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e58eee-3b69-419a-82d6-f641bf932892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:35.993952 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e58eee-3b69-419a-82d6-f641bf932892 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:36.008357 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 962/1906] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:49:36.035852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 945/1907] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:36.043606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f676-77ad-4434-9aa9-547c11ee769e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:36.044737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f676-77ad-4434-9aa9-547c11ee769e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:36.045953 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f676-77ad-4434-9aa9-547c11ee769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:36.072974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6864f676-77ad-4434-9aa9-547c11ee769e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:36.075397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6864f676-77ad-4434-9aa9-547c11ee769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:36.091996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 963/1908] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:36.096780 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db964b99-f6f3-4f1f-a136-441e95ccdc3a None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:36.115767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db964b99-f6f3-4f1f-a136-441e95ccdc3a None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:36.122573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90def703-81f6-43f5-83ef-69f68369477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:36.124068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90def703-81f6-43f5-83ef-69f68369477d admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:36.124493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90def703-81f6-43f5-83ef-69f68369477d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:36.124905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90def703-81f6-43f5-83ef-69f68369477d admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:36.126201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90def703-81f6-43f5-83ef-69f68369477d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:36.126718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90def703-81f6-43f5-83ef-69f68369477d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:36.128693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90def703-81f6-43f5-83ef-69f68369477d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:36.144287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 946/1909] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:49:36.148874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864f676-77ad-4434-9aa9-547c11ee769e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:36.163337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864f676-77ad-4434-9aa9-547c11ee769e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:36.171481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a17653-3906-4534-b13d-713fcf9bc0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:36.174885 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a17653-3906-4534-b13d-713fcf9bc0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:36.175396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a17653-3906-4534-b13d-713fcf9bc0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:36.176783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a17653-3906-4534-b13d-713fcf9bc0d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:36.178041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a17653-3906-4534-b13d-713fcf9bc0d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:36.180336 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a17653-3906-4534-b13d-713fcf9bc0d6 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:36.223410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 964/1910] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:36 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:36.224773 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90def703-81f6-43f5-83ef-69f68369477d admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:36.236991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90def703-81f6-43f5-83ef-69f68369477d admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:36.319131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b0452-f656-4216-a7fc-4f3aa5929cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:36.320095 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b0452-f656-4216-a7fc-4f3aa5929cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:36.320821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b0452-f656-4216-a7fc-4f3aa5929cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:36.321231 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b0452-f656-4216-a7fc-4f3aa5929cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:36.322056 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b0452-f656-4216-a7fc-4f3aa5929cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:36.324629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b0452-f656-4216-a7fc-4f3aa5929cf7 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:36.375447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 947/1911] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:36 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:36.375680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a17653-3906-4534-b13d-713fcf9bc0d6 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:36.389988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a17653-3906-4534-b13d-713fcf9bc0d6 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:36.395175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf1f00-0c81-485d-812b-5362657456ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:36.395940 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf1f00-0c81-485d-812b-5362657456ce admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:36.396241 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf1f00-0c81-485d-812b-5362657456ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:36.396622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf1f00-0c81-485d-812b-5362657456ce admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:36.399170 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf1f00-0c81-485d-812b-5362657456ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:36.401554 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf1f00-0c81-485d-812b-5362657456ce admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:36.423731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 965/1912] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:36.425256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b0452-f656-4216-a7fc-4f3aa5929cf7 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:36.444523 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b0452-f656-4216-a7fc-4f3aa5929cf7 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:36.451762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5086b-640f-43e7-a23e-852cffc70e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:36.452727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5086b-640f-43e7-a23e-852cffc70e05 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:36.452927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5086b-640f-43e7-a23e-852cffc70e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:36.453487 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5086b-640f-43e7-a23e-852cffc70e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:36.454716 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5086b-640f-43e7-a23e-852cffc70e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:36.456842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5086b-640f-43e7-a23e-852cffc70e05 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:36.459197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:36.479835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 948/1913] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:49:36.481973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf1f00-0c81-485d-812b-5362657456ce admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:36.496375 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf1f00-0c81-485d-812b-5362657456ce admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:36.506438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c0b54-b40c-4a9a-a555-cacae7131d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:36.508324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0b54-b40c-4a9a-a555-cacae7131d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:36.508893 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0b54-b40c-4a9a-a555-cacae7131d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:36.509367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0b54-b40c-4a9a-a555-cacae7131d0b admin admin] PATH_INFO: `/v3/projects/0d31bea6692047d09114d62d349de3dd/users/254d4c6546c9489ea2ded6f450ba5319/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:36.531620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c0b54-b40c-4a9a-a555-cacae7131d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d31bea6692047d09114d62d349de3dd, user_id=254d4c6546c9489ea2ded6f450ba5319, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:36.534752 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c0b54-b40c-4a9a-a555-cacae7131d0b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:36.571012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 966/1914] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:36 2022] PUT /identity/v3/projects/0d31bea6692047d09114d62d349de3dd/users/254d4c6546c9489ea2ded6f450ba5319/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:36.577834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185a6c4-488c-4d6a-a127-2ce3e2571035 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:36.578348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185a6c4-488c-4d6a-a127-2ce3e2571035 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:36.579340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185a6c4-488c-4d6a-a127-2ce3e2571035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:36.613412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-8185a6c4-488c-4d6a-a127-2ce3e2571035 None None] MFA Rules not processed for user `254d4c6546c9489ea2ded6f450ba5319`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:36.614637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8185a6c4-488c-4d6a-a127-2ce3e2571035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:36.695889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 949/1915] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:36.700710 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c0b54-b40c-4a9a-a555-cacae7131d0b admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:36.772247 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c0b54-b40c-4a9a-a555-cacae7131d0b admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:36.777851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7e0a1-af9f-4c52-8e8b-a7fdf1e7a9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:36.778629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7e0a1-af9f-4c52-8e8b-a7fdf1e7a9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:36.779198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7e0a1-af9f-4c52-8e8b-a7fdf1e7a9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:36.779562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7e0a1-af9f-4c52-8e8b-a7fdf1e7a9d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:36.780499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7e0a1-af9f-4c52-8e8b-a7fdf1e7a9d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:36.782552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7e0a1-af9f-4c52-8e8b-a7fdf1e7a9d5 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:36.820428 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 967/1916] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:36 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:36.825581 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185a6c4-488c-4d6a-a127-2ce3e2571035 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:36.844343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185a6c4-488c-4d6a-a127-2ce3e2571035 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:36.920758 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4f8be-5c7d-4179-8205-2b02ce893656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:36.921505 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4f8be-5c7d-4179-8205-2b02ce893656 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:36.921785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4f8be-5c7d-4179-8205-2b02ce893656 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:36.922063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4f8be-5c7d-4179-8205-2b02ce893656 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:36.922845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4f8be-5c7d-4179-8205-2b02ce893656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:36.924804 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4f8be-5c7d-4179-8205-2b02ce893656 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:36.950236 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 950/1917] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:36 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:36.954302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7e0a1-af9f-4c52-8e8b-a7fdf1e7a9d5 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:36.967762 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7e0a1-af9f-4c52-8e8b-a7fdf1e7a9d5 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:36.976059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60960c-f3b3-43ed-9d7d-4b0754e57f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:36.976871 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60960c-f3b3-43ed-9d7d-4b0754e57f73 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:36.977783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60960c-f3b3-43ed-9d7d-4b0754e57f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:36.978907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60960c-f3b3-43ed-9d7d-4b0754e57f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:36.980331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60960c-f3b3-43ed-9d7d-4b0754e57f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:36.981868 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60960c-f3b3-43ed-9d7d-4b0754e57f73 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:37.004645 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 968/1918] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:37.008595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4f8be-5c7d-4179-8205-2b02ce893656 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:37.021376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4f8be-5c7d-4179-8205-2b02ce893656 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:37.026117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa8b3d-03bf-41c9-8b52-92631c0a586c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:37.027741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8b3d-03bf-41c9-8b52-92631c0a586c admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:37.028028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8b3d-03bf-41c9-8b52-92631c0a586c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:37.028357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8b3d-03bf-41c9-8b52-92631c0a586c admin admin] PATH_INFO: `/v3/projects/f55fcc4134f041cc825f56932b923aed/users/7b58fc2c30f44a1885a78f3bc1927295/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:37.049967 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa8b3d-03bf-41c9-8b52-92631c0a586c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55fcc4134f041cc825f56932b923aed, user_id=7b58fc2c30f44a1885a78f3bc1927295, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:37.052860 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa8b3d-03bf-41c9-8b52-92631c0a586c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:37.094707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 951/1919] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:37 2022] PUT /identity/v3/projects/f55fcc4134f041cc825f56932b923aed/users/7b58fc2c30f44a1885a78f3bc1927295/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:37.095648 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60960c-f3b3-43ed-9d7d-4b0754e57f73 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:37.107636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60960c-f3b3-43ed-9d7d-4b0754e57f73 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:37.160139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:37.210334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587cf50-2489-46c3-8c56-925bf088de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:37.211522 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587cf50-2489-46c3-8c56-925bf088de81 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:37.212430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587cf50-2489-46c3-8c56-925bf088de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:37.212843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587cf50-2489-46c3-8c56-925bf088de81 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:37.213811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587cf50-2489-46c3-8c56-925bf088de81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:37.216421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587cf50-2489-46c3-8c56-925bf088de81 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:37.231571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 969/1920] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:49:37.235533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa8b3d-03bf-41c9-8b52-92631c0a586c admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:37.249612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa8b3d-03bf-41c9-8b52-92631c0a586c admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:37.256260 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06273a-e9b5-4218-a132-6a502bf0a37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:37.257363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06273a-e9b5-4218-a132-6a502bf0a37d admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:37.257646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06273a-e9b5-4218-a132-6a502bf0a37d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:37.258239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06273a-e9b5-4218-a132-6a502bf0a37d admin admin] PATH_INFO: `/v3/projects/f55fcc4134f041cc825f56932b923aed/users/7b58fc2c30f44a1885a78f3bc1927295/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:37.264497 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06273a-e9b5-4218-a132-6a502bf0a37d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55fcc4134f041cc825f56932b923aed, user_id=7b58fc2c30f44a1885a78f3bc1927295, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:37.267699 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06273a-e9b5-4218-a132-6a502bf0a37d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:37.281454 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 952/1921] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:37 2022] PUT /identity/v3/projects/f55fcc4134f041cc825f56932b923aed/users/7b58fc2c30f44a1885a78f3bc1927295/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:37.292592 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43e40c-3fbc-4d56-81a5-acf0227db6d2 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:37.293163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43e40c-3fbc-4d56-81a5-acf0227db6d2 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:37.293896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43e40c-3fbc-4d56-81a5-acf0227db6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:37.351977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-8a43e40c-3fbc-4d56-81a5-acf0227db6d2 None None] MFA Rules not processed for user `7b58fc2c30f44a1885a78f3bc1927295`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:37.357412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8a43e40c-3fbc-4d56-81a5-acf0227db6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:37.488918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 970/1922] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:37.501084 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06273a-e9b5-4218-a132-6a502bf0a37d admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:37.503519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8c06273a-e9b5-4218-a132-6a502bf0a37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:37.575106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:37.594474 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06273a-e9b5-4218-a132-6a502bf0a37d admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:37.599345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acc66d-1160-4938-a80e-2bc232048217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:37.600135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acc66d-1160-4938-a80e-2bc232048217 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:37.600551 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acc66d-1160-4938-a80e-2bc232048217 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:37.601266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acc66d-1160-4938-a80e-2bc232048217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:37.624983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acc66d-1160-4938-a80e-2bc232048217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:37.624983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acc66d-1160-4938-a80e-2bc232048217 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:37.628348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 953/1923] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:37.888605 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43e40c-3fbc-4d56-81a5-acf0227db6d2 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:37.911519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43e40c-3fbc-4d56-81a5-acf0227db6d2 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:37.925662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0c611-9eae-4b4f-a493-28570244bec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:37.926951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c611-9eae-4b4f-a493-28570244bec5 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:37.927420 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c611-9eae-4b4f-a493-28570244bec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:37.928026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c611-9eae-4b4f-a493-28570244bec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:38.060459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0c611-9eae-4b4f-a493-28570244bec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:38.062121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0c611-9eae-4b4f-a493-28570244bec5 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:38.076201 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 971/1924] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:40.744278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acc66d-1160-4938-a80e-2bc232048217 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:40.832901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acc66d-1160-4938-a80e-2bc232048217 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:40.839373 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a01c6-2063-4474-8b24-359a5db55da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:40.840359 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a01c6-2063-4474-8b24-359a5db55da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:40.840691 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a01c6-2063-4474-8b24-359a5db55da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:40.841034 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a01c6-2063-4474-8b24-359a5db55da4 admin admin] PATH_INFO: `/v3/users/254d4c6546c9489ea2ded6f450ba5319` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:40.842911 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a01c6-2063-4474-8b24-359a5db55da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=254d4c6546c9489ea2ded6f450ba5319)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:40.845264 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a01c6-2063-4474-8b24-359a5db55da4 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:40.923058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ce2a01c6-2063-4474-8b24-359a5db55da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254d4c6546c9489ea2ded6f450ba5319'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:40.938729 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ce2a01c6-2063-4474-8b24-359a5db55da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254d4c6546c9489ea2ded6f450ba5319'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:40.945892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ce2a01c6-2063-4474-8b24-359a5db55da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254d4c6546c9489ea2ded6f450ba5319'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:40.946624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ce2a01c6-2063-4474-8b24-359a5db55da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254d4c6546c9489ea2ded6f450ba5319'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:40.947277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ce2a01c6-2063-4474-8b24-359a5db55da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254d4c6546c9489ea2ded6f450ba5319'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:40.963468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 954/1925] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:40 2022] DELETE /identity/v3/users/254d4c6546c9489ea2ded6f450ba5319 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:40.968273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf756f-8cc2-4f19-90d4-a62653c8e657 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:40.968848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf756f-8cc2-4f19-90d4-a62653c8e657 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:40.968932 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf756f-8cc2-4f19-90d4-a62653c8e657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:40.986553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-0daf756f-8cc2-4f19-90d4-a62653c8e657 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:40.987858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0daf756f-8cc2-4f19-90d4-a62653c8e657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:41.042132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:41.052802 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 972/1926] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:41.063612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a01c6-2063-4474-8b24-359a5db55da4 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:41.065465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ce2a01c6-2063-4474-8b24-359a5db55da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:41.133111 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a01c6-2063-4474-8b24-359a5db55da4 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:41.145529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfe13a-1045-4577-af9d-201444d2d273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:41.146437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfe13a-1045-4577-af9d-201444d2d273 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:41.147002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfe13a-1045-4577-af9d-201444d2d273 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:41.147355 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfe13a-1045-4577-af9d-201444d2d273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:41.169463 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfe13a-1045-4577-af9d-201444d2d273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:41.171264 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfe13a-1045-4577-af9d-201444d2d273 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:41.183086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 955/1927] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:41.223023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf756f-8cc2-4f19-90d4-a62653c8e657 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:41.224489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0daf756f-8cc2-4f19-90d4-a62653c8e657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:41.249967 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf756f-8cc2-4f19-90d4-a62653c8e657 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:41.255774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fc0ff-465b-475d-8b68-b874183048a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:41.257251 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fc0ff-465b-475d-8b68-b874183048a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:41.257540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fc0ff-465b-475d-8b68-b874183048a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:41.258804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fc0ff-465b-475d-8b68-b874183048a1 admin admin] PATH_INFO: `/v3/users/155813f588c74e5388e6e33e151374c2` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:41.260673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fc0ff-465b-475d-8b68-b874183048a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155813f588c74e5388e6e33e151374c2)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:41.262674 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fc0ff-465b-475d-8b68-b874183048a1 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:41.363925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3b4fc0ff-465b-475d-8b68-b874183048a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155813f588c74e5388e6e33e151374c2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:41.379849 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3b4fc0ff-465b-475d-8b68-b874183048a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155813f588c74e5388e6e33e151374c2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:41.380894 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3b4fc0ff-465b-475d-8b68-b874183048a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155813f588c74e5388e6e33e151374c2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:41.391819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3b4fc0ff-465b-475d-8b68-b874183048a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155813f588c74e5388e6e33e151374c2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:41.395190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3b4fc0ff-465b-475d-8b68-b874183048a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155813f588c74e5388e6e33e151374c2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:41.442433 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 973/1928] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:41 2022] DELETE /identity/v3/users/155813f588c74e5388e6e33e151374c2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:41.443283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40e053-9c01-41c1-9a00-cf2815c3d28e None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:41.443572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40e053-9c01-41c1-9a00-cf2815c3d28e None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:41.443845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40e053-9c01-41c1-9a00-cf2815c3d28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:41.451473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:41.465908 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-cf40e053-9c01-41c1-9a00-cf2815c3d28e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:41.467852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cf40e053-9c01-41c1-9a00-cf2815c3d28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:41.555662 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 956/1929] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:41.572158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fc0ff-465b-475d-8b68-b874183048a1 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:41.574493 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3b4fc0ff-465b-475d-8b68-b874183048a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:41.643254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fc0ff-465b-475d-8b68-b874183048a1 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:41.647218 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfaf6b-713b-4a37-89a5-a9abb1404fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:41.648119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfaf6b-713b-4a37-89a5-a9abb1404fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:41.648665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfaf6b-713b-4a37-89a5-a9abb1404fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:41.649051 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfaf6b-713b-4a37-89a5-a9abb1404fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:41.659720 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfaf6b-713b-4a37-89a5-a9abb1404fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:41.660894 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40e053-9c01-41c1-9a00-cf2815c3d28e None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:41.661299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfaf6b-713b-4a37-89a5-a9abb1404fa1 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:41.662673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cf40e053-9c01-41c1-9a00-cf2815c3d28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:41.672654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 974/1930] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:41.691001 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40e053-9c01-41c1-9a00-cf2815c3d28e None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:41.696511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:41.697185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:41.697415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:41.697705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] PATH_INFO: `/v3/projects/0d31bea6692047d09114d62d349de3dd` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:41.699279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d31bea6692047d09114d62d349de3dd)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:41.701386 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:41.756196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d31bea6692047d09114d62d349de3dd', 'request_id': 'req-61517c23-fd0f-429c-bf91-4a1c1b4f787e'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:41.779115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d31bea6692047d09114d62d349de3dd', 'request_id': 'req-61517c23-fd0f-429c-bf91-4a1c1b4f787e'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:41.796403 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d31bea6692047d09114d62d349de3dd', 'request_id': 'req-61517c23-fd0f-429c-bf91-4a1c1b4f787e'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:41.819427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] The token cache is being invalidate because project 0d31bea6692047d09114d62d349de3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:41.819719 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:41.820555 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:41.825582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 957/1931] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:41 2022] DELETE /identity/v3/projects/0d31bea6692047d09114d62d349de3dd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:41.826908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfaf6b-713b-4a37-89a5-a9abb1404fa1 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:41.852322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfaf6b-713b-4a37-89a5-a9abb1404fa1 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:41.989584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a26ca6-040e-4956-a224-9d5885ed2edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:41.992868 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a26ca6-040e-4956-a224-9d5885ed2edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:41.993174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a26ca6-040e-4956-a224-9d5885ed2edb admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:41.993452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a26ca6-040e-4956-a224-9d5885ed2edb admin admin] PATH_INFO: `/v3/users/7b58fc2c30f44a1885a78f3bc1927295` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:41.996511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a26ca6-040e-4956-a224-9d5885ed2edb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b58fc2c30f44a1885a78f3bc1927295)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:42.003074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a26ca6-040e-4956-a224-9d5885ed2edb admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:42.035483 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:42.110139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-80a26ca6-040e-4956-a224-9d5885ed2edb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b58fc2c30f44a1885a78f3bc1927295'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.143083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:42.144207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:42.151198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-80a26ca6-040e-4956-a224-9d5885ed2edb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b58fc2c30f44a1885a78f3bc1927295'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.154156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-80a26ca6-040e-4956-a224-9d5885ed2edb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b58fc2c30f44a1885a78f3bc1927295'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.165412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61517c23-fd0f-429c-bf91-4a1c1b4f787e admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:42.188829 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:42.189535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:42.189824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:42.190119 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] PATH_INFO: `/v3/projects/44ca2d008d5949318b09c1b472e60f67` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:42.190591 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-80a26ca6-040e-4956-a224-9d5885ed2edb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b58fc2c30f44a1885a78f3bc1927295'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.191439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ca2d008d5949318b09c1b472e60f67)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:42.192824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-80a26ca6-040e-4956-a224-9d5885ed2edb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b58fc2c30f44a1885a78f3bc1927295'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.193416 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:42.221856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 975/1932] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:41 2022] DELETE /identity/v3/users/7b58fc2c30f44a1885a78f3bc1927295 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:42.285974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ca2d008d5949318b09c1b472e60f67', 'request_id': 'req-25a93879-bf5b-4ddd-9213-95efabb96a84'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.296761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ca2d008d5949318b09c1b472e60f67', 'request_id': 'req-25a93879-bf5b-4ddd-9213-95efabb96a84'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.307439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ca2d008d5949318b09c1b472e60f67', 'request_id': 'req-25a93879-bf5b-4ddd-9213-95efabb96a84'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.325373 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] The token cache is being invalidate because project 44ca2d008d5949318b09c1b472e60f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:42.327244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.331845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.341485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 958/1933] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:42 2022] DELETE /identity/v3/projects/44ca2d008d5949318b09c1b472e60f67 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:42.341708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a26ca6-040e-4956-a224-9d5885ed2edb admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:42.343579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-80a26ca6-040e-4956-a224-9d5885ed2edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:42.438124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a26ca6-040e-4956-a224-9d5885ed2edb admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:42.516345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc71b8-696e-46f7-9e0f-5cf9e08bd8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:42.518152 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc71b8-696e-46f7-9e0f-5cf9e08bd8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:42.518601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc71b8-696e-46f7-9e0f-5cf9e08bd8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:42.519073 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc71b8-696e-46f7-9e0f-5cf9e08bd8a6 admin admin] PATH_INFO: `/v3/users/62503c2a5f374103a2bab0a9349bb3eb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:42.520632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc71b8-696e-46f7-9e0f-5cf9e08bd8a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62503c2a5f374103a2bab0a9349bb3eb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:42.524399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc71b8-696e-46f7-9e0f-5cf9e08bd8a6 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:42.601822 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:42.609938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f9cc71b8-696e-46f7-9e0f-5cf9e08bd8a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62503c2a5f374103a2bab0a9349bb3eb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.630296 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f9cc71b8-696e-46f7-9e0f-5cf9e08bd8a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62503c2a5f374103a2bab0a9349bb3eb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.631423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f9cc71b8-696e-46f7-9e0f-5cf9e08bd8a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62503c2a5f374103a2bab0a9349bb3eb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.635584 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:42.637507 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:42.680806 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f9cc71b8-696e-46f7-9e0f-5cf9e08bd8a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62503c2a5f374103a2bab0a9349bb3eb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.681617 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f9cc71b8-696e-46f7-9e0f-5cf9e08bd8a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62503c2a5f374103a2bab0a9349bb3eb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.686218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a93879-bf5b-4ddd-9213-95efabb96a84 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:42.698504 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d01d91-9663-4c8c-9a8c-abba6d6640c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:42.699466 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d01d91-9663-4c8c-9a8c-abba6d6640c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:42.699728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d01d91-9663-4c8c-9a8c-abba6d6640c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:42.699983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d01d91-9663-4c8c-9a8c-abba6d6640c1 admin admin] PATH_INFO: `/v3/projects/f55fcc4134f041cc825f56932b923aed` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:42.701237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d01d91-9663-4c8c-9a8c-abba6d6640c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f55fcc4134f041cc825f56932b923aed)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:42.704343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d01d91-9663-4c8c-9a8c-abba6d6640c1 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:42.704626 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 976/1934] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:42 2022] DELETE /identity/v3/users/62503c2a5f374103a2bab0a9349bb3eb => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:42.710690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:42.780792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-66d01d91-9663-4c8c-9a8c-abba6d6640c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f55fcc4134f041cc825f56932b923aed', 'request_id': 'req-66d01d91-9663-4c8c-9a8c-abba6d6640c1'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.797634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-66d01d91-9663-4c8c-9a8c-abba6d6640c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f55fcc4134f041cc825f56932b923aed', 'request_id': 'req-66d01d91-9663-4c8c-9a8c-abba6d6640c1'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.807461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-66d01d91-9663-4c8c-9a8c-abba6d6640c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f55fcc4134f041cc825f56932b923aed', 'request_id': 'req-66d01d91-9663-4c8c-9a8c-abba6d6640c1'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.824676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-66d01d91-9663-4c8c-9a8c-abba6d6640c1 admin admin] The token cache is being invalidate because project f55fcc4134f041cc825f56932b923aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:42.825216 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-66d01d91-9663-4c8c-9a8c-abba6d6640c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.826011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-66d01d91-9663-4c8c-9a8c-abba6d6640c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:42.829274 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 959/1935] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:42 2022] DELETE /identity/v3/projects/f55fcc4134f041cc825f56932b923aed => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:42.834142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c225f2-fae7-4e63-9511-29ddb69e344c None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:42.834505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c225f2-fae7-4e63-9511-29ddb69e344c None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:42.835051 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c225f2-fae7-4e63-9511-29ddb69e344c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:42.893424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-c7c225f2-fae7-4e63-9511-29ddb69e344c None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:42.894835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c7c225f2-fae7-4e63-9511-29ddb69e344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:43.006263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 977/1936] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:43.016012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c95829-1157-48a3-bc0f-78011e86e129 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:43.016512 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c95829-1157-48a3-bc0f-78011e86e129 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:43.017585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c95829-1157-48a3-bc0f-78011e86e129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:43.055780 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-50c95829-1157-48a3-bc0f-78011e86e129 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:43.059330 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-50c95829-1157-48a3-bc0f-78011e86e129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:43.073700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 960/1937] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:43.080302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c225f2-fae7-4e63-9511-29ddb69e344c None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:43.104173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c225f2-fae7-4e63-9511-29ddb69e344c None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:43.113982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081889d0-e908-4661-8cfe-51dd6580b78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:43.114971 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081889d0-e908-4661-8cfe-51dd6580b78a admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:43.115264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081889d0-e908-4661-8cfe-51dd6580b78a admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:43.115548 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081889d0-e908-4661-8cfe-51dd6580b78a admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:43.116406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081889d0-e908-4661-8cfe-51dd6580b78a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:43.116723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081889d0-e908-4661-8cfe-51dd6580b78a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:43.118478 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081889d0-e908-4661-8cfe-51dd6580b78a admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:43.146422 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c95829-1157-48a3-bc0f-78011e86e129 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:43.157486 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c95829-1157-48a3-bc0f-78011e86e129 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:43.158621 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 978/1938] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:43.163367 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6373f-208e-400a-9c45-b46556b26db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:43.164065 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6373f-208e-400a-9c45-b46556b26db7 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:43.164349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6373f-208e-400a-9c45-b46556b26db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:43.165765 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6373f-208e-400a-9c45-b46556b26db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:43.166507 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6373f-208e-400a-9c45-b46556b26db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:43.169318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6373f-208e-400a-9c45-b46556b26db7 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:43.215211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081889d0-e908-4661-8cfe-51dd6580b78a admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:43.217054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-081889d0-e908-4661-8cfe-51dd6580b78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:43.237655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081889d0-e908-4661-8cfe-51dd6580b78a admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:43.247268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebbc2b-4fca-4298-8b0d-73d52ff7eb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:43.248394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebbc2b-4fca-4298-8b0d-73d52ff7eb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:43.248781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebbc2b-4fca-4298-8b0d-73d52ff7eb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:43.249081 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebbc2b-4fca-4298-8b0d-73d52ff7eb85 admin admin] PATH_INFO: `/v3/users/ed0956716ad94254932bffb350824263` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:43.250610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebbc2b-4fca-4298-8b0d-73d52ff7eb85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0956716ad94254932bffb350824263)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:43.252522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 961/1939] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:43 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:43.256446 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebbc2b-4fca-4298-8b0d-73d52ff7eb85 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:43.257702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6373f-208e-400a-9c45-b46556b26db7 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:43.346755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-faebbc2b-4fca-4298-8b0d-73d52ff7eb85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0956716ad94254932bffb350824263'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:43.391746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6373f-208e-400a-9c45-b46556b26db7 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:43.402508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ddc37-a335-4f19-b791-797f880dfb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:43.403176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-faebbc2b-4fca-4298-8b0d-73d52ff7eb85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0956716ad94254932bffb350824263'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:43.404099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-faebbc2b-4fca-4298-8b0d-73d52ff7eb85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0956716ad94254932bffb350824263'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:43.404876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ddc37-a335-4f19-b791-797f880dfb47 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:43.406645 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ddc37-a335-4f19-b791-797f880dfb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:43.407785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ddc37-a335-4f19-b791-797f880dfb47 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:43.408763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ddc37-a335-4f19-b791-797f880dfb47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:43.413117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ddc37-a335-4f19-b791-797f880dfb47 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:43.424751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-faebbc2b-4fca-4298-8b0d-73d52ff7eb85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0956716ad94254932bffb350824263'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:43.425468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-faebbc2b-4fca-4298-8b0d-73d52ff7eb85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0956716ad94254932bffb350824263'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:43.459669 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 962/1941] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:43 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:43.462572 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305c849-8d5f-46ff-9f69-8461907cbda5 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:43.464673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 979/1941] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:43 2022] DELETE /identity/v3/users/ed0956716ad94254932bffb350824263 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:43.466007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebbc2b-4fca-4298-8b0d-73d52ff7eb85 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:43.467538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-faebbc2b-4fca-4298-8b0d-73d52ff7eb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:43.469119 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305c849-8d5f-46ff-9f69-8461907cbda5 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:43.469374 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305c849-8d5f-46ff-9f69-8461907cbda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:43.511167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:43.536300 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-4305c849-8d5f-46ff-9f69-8461907cbda5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:43.537635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-4305c849-8d5f-46ff-9f69-8461907cbda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:43.606701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebbc2b-4fca-4298-8b0d-73d52ff7eb85 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:43.629001 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e4742-3df7-4680-9ed5-8216051a16da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:43.632711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e4742-3df7-4680-9ed5-8216051a16da admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:43.635070 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e4742-3df7-4680-9ed5-8216051a16da admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:43.635499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e4742-3df7-4680-9ed5-8216051a16da admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:43.636411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e4742-3df7-4680-9ed5-8216051a16da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:43.641909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e4742-3df7-4680-9ed5-8216051a16da admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:43.656046 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:43.685220 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 963/1942] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:43.696138 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 980/1943] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:43.701086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305c849-8d5f-46ff-9f69-8461907cbda5 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:43.713203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305c849-8d5f-46ff-9f69-8461907cbda5 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:43.729785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea03a27-9337-43f4-a22a-b3ff70445359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:43.732928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03a27-9337-43f4-a22a-b3ff70445359 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:43.733213 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03a27-9337-43f4-a22a-b3ff70445359 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:43.733485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03a27-9337-43f4-a22a-b3ff70445359 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:43.734237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea03a27-9337-43f4-a22a-b3ff70445359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:43.740412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea03a27-9337-43f4-a22a-b3ff70445359 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:43.770854 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 964/1944] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:49:43.773024 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e4742-3df7-4680-9ed5-8216051a16da admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:43.789766 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea03a27-9337-43f4-a22a-b3ff70445359 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:43.792501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2ea03a27-9337-43f4-a22a-b3ff70445359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:43.806497 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e4742-3df7-4680-9ed5-8216051a16da admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:43.820828 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96078c8a-04f9-464a-8a42-f2d4f30fea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:43.821989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96078c8a-04f9-464a-8a42-f2d4f30fea11 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:43.822274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96078c8a-04f9-464a-8a42-f2d4f30fea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:43.822585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96078c8a-04f9-464a-8a42-f2d4f30fea11 admin admin] PATH_INFO: `/v3/projects/26aac90e94964c6ba159a19ba6b3cd59/users/16102bfa1d754ba7813d8673317d03a5/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:43.850399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96078c8a-04f9-464a-8a42-f2d4f30fea11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26aac90e94964c6ba159a19ba6b3cd59, user_id=16102bfa1d754ba7813d8673317d03a5, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:43.854298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96078c8a-04f9-464a-8a42-f2d4f30fea11 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:43.891931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 981/1945] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:43 2022] PUT /identity/v3/projects/26aac90e94964c6ba159a19ba6b3cd59/users/16102bfa1d754ba7813d8673317d03a5/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:43.902258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a80ecc-8288-413a-a1a8-6ebd34130528 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:43.902548 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a80ecc-8288-413a-a1a8-6ebd34130528 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:43.902846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a80ecc-8288-413a-a1a8-6ebd34130528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:43.920818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea03a27-9337-43f4-a22a-b3ff70445359 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:43.966717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-40a80ecc-8288-413a-a1a8-6ebd34130528 None None] MFA Rules not processed for user `16102bfa1d754ba7813d8673317d03a5`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:43.968470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-40a80ecc-8288-413a-a1a8-6ebd34130528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:44.034798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5ba78-2f2c-44c7-9c88-ee341eba7d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:44.035446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5ba78-2f2c-44c7-9c88-ee341eba7d05 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:44.035728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5ba78-2f2c-44c7-9c88-ee341eba7d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:44.035997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5ba78-2f2c-44c7-9c88-ee341eba7d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:44.104649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 982/1946] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:44.117236 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a80ecc-8288-413a-a1a8-6ebd34130528 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:44.119376 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-40a80ecc-8288-413a-a1a8-6ebd34130528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:44.172724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5ba78-2f2c-44c7-9c88-ee341eba7d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:44.174301 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5ba78-2f2c-44c7-9c88-ee341eba7d05 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:44.186947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 965/1947] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:49:44.214986 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a80ecc-8288-413a-a1a8-6ebd34130528 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:44.218988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a029bf-f1c4-4c6f-9854-e9c6c5985b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:44.219646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a029bf-f1c4-4c6f-9854-e9c6c5985b07 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:44.219924 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a029bf-f1c4-4c6f-9854-e9c6c5985b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:44.220196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a029bf-f1c4-4c6f-9854-e9c6c5985b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:44.233327 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a029bf-f1c4-4c6f-9854-e9c6c5985b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:44.233327 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a029bf-f1c4-4c6f-9854-e9c6c5985b07 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:44.244121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 983/1948] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:44.264811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5ba78-2f2c-44c7-9c88-ee341eba7d05 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:44.276892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5ba78-2f2c-44c7-9c88-ee341eba7d05 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:44.283179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbde1cc-522e-45c0-9dbb-95f544e9d70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:44.284394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbde1cc-522e-45c0-9dbb-95f544e9d70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:44.284830 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbde1cc-522e-45c0-9dbb-95f544e9d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:44.285523 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbde1cc-522e-45c0-9dbb-95f544e9d70b admin admin] PATH_INFO: `/v3/users/16102bfa1d754ba7813d8673317d03a5` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:44.286401 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbde1cc-522e-45c0-9dbb-95f544e9d70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=16102bfa1d754ba7813d8673317d03a5)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:44.292187 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbde1cc-522e-45c0-9dbb-95f544e9d70b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:44.357185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:44.359101 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a029bf-f1c4-4c6f-9854-e9c6c5985b07 service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:44.359841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8fbde1cc-522e-45c0-9dbb-95f544e9d70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16102bfa1d754ba7813d8673317d03a5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:44.360569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-77a029bf-f1c4-4c6f-9854-e9c6c5985b07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:44.375558 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8fbde1cc-522e-45c0-9dbb-95f544e9d70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16102bfa1d754ba7813d8673317d03a5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:44.383289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8fbde1cc-522e-45c0-9dbb-95f544e9d70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16102bfa1d754ba7813d8673317d03a5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:44.384091 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8fbde1cc-522e-45c0-9dbb-95f544e9d70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16102bfa1d754ba7813d8673317d03a5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:44.384806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8fbde1cc-522e-45c0-9dbb-95f544e9d70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16102bfa1d754ba7813d8673317d03a5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:44.386390 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a029bf-f1c4-4c6f-9854-e9c6c5985b07 service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:44.395477 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbb073-2209-458b-af42-64b3fdfcacb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:44.396794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbb073-2209-458b-af42-64b3fdfcacb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:44.397446 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbb073-2209-458b-af42-64b3fdfcacb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:44.397929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbb073-2209-458b-af42-64b3fdfcacb7 admin admin] PATH_INFO: `/v3/projects/461f4e0ecfbf44b69fba716c5f72eaf0` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:44.399743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbb073-2209-458b-af42-64b3fdfcacb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=461f4e0ecfbf44b69fba716c5f72eaf0)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:44.406076 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 966/1949] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:44 2022] DELETE /identity/v3/users/16102bfa1d754ba7813d8673317d03a5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:44.408539 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a608d-2566-4073-a4d2-18b89702459a None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:44.408539 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a608d-2566-4073-a4d2-18b89702459a None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:44.408539 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a608d-2566-4073-a4d2-18b89702459a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:44.410333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbb073-2209-458b-af42-64b3fdfcacb7 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:44.438140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:44.471574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-268a608d-2566-4073-a4d2-18b89702459a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:44.474910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-268a608d-2566-4073-a4d2-18b89702459a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:44.516292 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b5fbb073-2209-458b-af42-64b3fdfcacb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '461f4e0ecfbf44b69fba716c5f72eaf0', 'request_id': 'req-b5fbb073-2209-458b-af42-64b3fdfcacb7'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:44.532876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b5fbb073-2209-458b-af42-64b3fdfcacb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '461f4e0ecfbf44b69fba716c5f72eaf0', 'request_id': 'req-b5fbb073-2209-458b-af42-64b3fdfcacb7'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:44.540364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b5fbb073-2209-458b-af42-64b3fdfcacb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '461f4e0ecfbf44b69fba716c5f72eaf0', 'request_id': 'req-b5fbb073-2209-458b-af42-64b3fdfcacb7'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:44.555044 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b5fbb073-2209-458b-af42-64b3fdfcacb7 admin admin] The token cache is being invalidate because project 461f4e0ecfbf44b69fba716c5f72eaf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:44.555420 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b5fbb073-2209-458b-af42-64b3fdfcacb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:44.556577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b5fbb073-2209-458b-af42-64b3fdfcacb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:44.558340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 984/1950] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:44 2022] DELETE /identity/v3/projects/461f4e0ecfbf44b69fba716c5f72eaf0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:44.564173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057cd8b-58de-45f8-a6ab-a9f25f3a8a99 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:44.564460 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057cd8b-58de-45f8-a6ab-a9f25f3a8a99 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:44.564730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057cd8b-58de-45f8-a6ab-a9f25f3a8a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:44.586631 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-d057cd8b-58de-45f8-a6ab-a9f25f3a8a99 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:44.590816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d057cd8b-58de-45f8-a6ab-a9f25f3a8a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:44.591340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 967/1951] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:44.599637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 985/1952] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:44.607890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a64e-fe8e-4c7b-a64e-82cc740923e1 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:44.608207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a64e-fe8e-4c7b-a64e-82cc740923e1 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:44.608450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a64e-fe8e-4c7b-a64e-82cc740923e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:44.612513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057cd8b-58de-45f8-a6ab-a9f25f3a8a99 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:44.615933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d057cd8b-58de-45f8-a6ab-a9f25f3a8a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:44.635150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-f2e9a64e-fe8e-4c7b-a64e-82cc740923e1 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:44.636462 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-f2e9a64e-fe8e-4c7b-a64e-82cc740923e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:44.652039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 968/1953] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:44.653043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9a64e-fe8e-4c7b-a64e-82cc740923e1 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:44.667313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9a64e-fe8e-4c7b-a64e-82cc740923e1 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:44.674748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac7981-0050-4e2e-9e7e-0c5ddf30e074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:44.675674 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7981-0050-4e2e-9e7e-0c5ddf30e074 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:44.676976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7981-0050-4e2e-9e7e-0c5ddf30e074 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:44.677343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7981-0050-4e2e-9e7e-0c5ddf30e074 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:44.678467 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac7981-0050-4e2e-9e7e-0c5ddf30e074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:44.678791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac7981-0050-4e2e-9e7e-0c5ddf30e074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:44.680907 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac7981-0050-4e2e-9e7e-0c5ddf30e074 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:44.703890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 969/1954] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:44.707143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac7981-0050-4e2e-9e7e-0c5ddf30e074 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:44.724276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057cd8b-58de-45f8-a6ab-a9f25f3a8a99 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:44.732958 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac7981-0050-4e2e-9e7e-0c5ddf30e074 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:44.737377 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc2a6e-cd24-4aec-9e82-db752f9ed399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:44.738395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc2a6e-cd24-4aec-9e82-db752f9ed399 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:44.739057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc2a6e-cd24-4aec-9e82-db752f9ed399 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:44.740005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc2a6e-cd24-4aec-9e82-db752f9ed399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:44.756902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc2a6e-cd24-4aec-9e82-db752f9ed399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:44.758807 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc2a6e-cd24-4aec-9e82-db752f9ed399 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:44.760990 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d0a1f-2b49-4e82-8587-540cfeb27d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:44.761689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d0a1f-2b49-4e82-8587-540cfeb27d27 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:44.761972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d0a1f-2b49-4e82-8587-540cfeb27d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:44.763245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d0a1f-2b49-4e82-8587-540cfeb27d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:44.764015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d0a1f-2b49-4e82-8587-540cfeb27d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:44.770127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d0a1f-2b49-4e82-8587-540cfeb27d27 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:44.772807 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 986/1955] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:44.822566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc2a6e-cd24-4aec-9e82-db752f9ed399 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:44.854040 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 970/1956] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:44 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:44.857960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc2a6e-cd24-4aec-9e82-db752f9ed399 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:44.984429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161b97c-e6b3-4d31-b8c8-d638fdbf76ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:44.985256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161b97c-e6b3-4d31-b8c8-d638fdbf76ae admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:44.985629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161b97c-e6b3-4d31-b8c8-d638fdbf76ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:44.986144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161b97c-e6b3-4d31-b8c8-d638fdbf76ae admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:44.988126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161b97c-e6b3-4d31-b8c8-d638fdbf76ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:44.993592 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161b97c-e6b3-4d31-b8c8-d638fdbf76ae admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:45.029895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 987/1957] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:44 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:45.034995 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d0a1f-2b49-4e82-8587-540cfeb27d27 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:45.049537 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d0a1f-2b49-4e82-8587-540cfeb27d27 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:45.056713 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4b63a-3602-4fb8-8e8e-828fd2a3589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:45.062030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4b63a-3602-4fb8-8e8e-828fd2a3589d admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:45.062030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4b63a-3602-4fb8-8e8e-828fd2a3589d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:45.062429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4b63a-3602-4fb8-8e8e-828fd2a3589d admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:45.064131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4b63a-3602-4fb8-8e8e-828fd2a3589d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:45.067287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4b63a-3602-4fb8-8e8e-828fd2a3589d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:45.082622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 971/1958] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:45.088303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161b97c-e6b3-4d31-b8c8-d638fdbf76ae admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:45.122861 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161b97c-e6b3-4d31-b8c8-d638fdbf76ae admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:45.137807 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018780ce-f2a4-4344-af28-2fdc92c195b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:45.138681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018780ce-f2a4-4344-af28-2fdc92c195b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:45.138830 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018780ce-f2a4-4344-af28-2fdc92c195b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:45.139072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018780ce-f2a4-4344-af28-2fdc92c195b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:45.139814 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018780ce-f2a4-4344-af28-2fdc92c195b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:45.141631 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018780ce-f2a4-4344-af28-2fdc92c195b6 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:45.171569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4b63a-3602-4fb8-8e8e-828fd2a3589d admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:45.177912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 988/1959] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:45.189647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4b63a-3602-4fb8-8e8e-828fd2a3589d admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:45.203865 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc685b22-1fe8-44da-862c-a5c6b65cfe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:45.205142 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc685b22-1fe8-44da-862c-a5c6b65cfe29 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:45.205445 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc685b22-1fe8-44da-862c-a5c6b65cfe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:45.206378 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc685b22-1fe8-44da-862c-a5c6b65cfe29 admin admin] PATH_INFO: `/v3/projects/89931fc5ee1b42a6bd7758dab6f448ab/users/a095dc3ada614757a0bbe3596e52a942/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:45.242502 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc685b22-1fe8-44da-862c-a5c6b65cfe29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89931fc5ee1b42a6bd7758dab6f448ab, user_id=a095dc3ada614757a0bbe3596e52a942, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:45.246133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc685b22-1fe8-44da-862c-a5c6b65cfe29 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:45.268907 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 972/1960] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:45 2022] PUT /identity/v3/projects/89931fc5ee1b42a6bd7758dab6f448ab/users/a095dc3ada614757a0bbe3596e52a942/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:45.281646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5c816-1c29-48ff-b951-b5cf6e103275 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:45.282003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5c816-1c29-48ff-b951-b5cf6e103275 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:45.282249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5c816-1c29-48ff-b951-b5cf6e103275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:45.324786 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-15a5c816-1c29-48ff-b951-b5cf6e103275 None None] MFA Rules not processed for user `a095dc3ada614757a0bbe3596e52a942`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:45.327459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-15a5c816-1c29-48ff-b951-b5cf6e103275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:45.341109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:45.418986 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 989/1961] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:45.432797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc685b22-1fe8-44da-862c-a5c6b65cfe29 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:45.434927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-bc685b22-1fe8-44da-862c-a5c6b65cfe29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:45.496655 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:45.510709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc685b22-1fe8-44da-862c-a5c6b65cfe29 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:45.516598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40978e89-f811-4697-b73b-ac4fc2c8ad59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:45.517277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978e89-f811-4697-b73b-ac4fc2c8ad59 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:45.517616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978e89-f811-4697-b73b-ac4fc2c8ad59 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:45.517931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978e89-f811-4697-b73b-ac4fc2c8ad59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:45.555475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40978e89-f811-4697-b73b-ac4fc2c8ad59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:45.559331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40978e89-f811-4697-b73b-ac4fc2c8ad59 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:45.577974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 973/1962] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:45.604760 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5c816-1c29-48ff-b951-b5cf6e103275 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:45.640149 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40978e89-f811-4697-b73b-ac4fc2c8ad59 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:45.641680 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-40978e89-f811-4697-b73b-ac4fc2c8ad59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:45.718842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5c816-1c29-48ff-b951-b5cf6e103275 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:45.723903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cf79b-f353-4a57-87bc-ae77bae1db35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:45.724958 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cf79b-f353-4a57-87bc-ae77bae1db35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:45.725293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cf79b-f353-4a57-87bc-ae77bae1db35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:45.725571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cf79b-f353-4a57-87bc-ae77bae1db35 admin admin] PATH_INFO: `/v3/users/a095dc3ada614757a0bbe3596e52a942` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:45.726891 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cf79b-f353-4a57-87bc-ae77bae1db35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a095dc3ada614757a0bbe3596e52a942)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:45.729293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cf79b-f353-4a57-87bc-ae77bae1db35 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:45.778131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40978e89-f811-4697-b73b-ac4fc2c8ad59 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:45.786635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:45.790315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:45.790597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:45.792670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] PATH_INFO: `/v3/projects/d6f3a1fe486f48629dedad69c9babb9f` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:45.795514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6f3a1fe486f48629dedad69c9babb9f)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:45.797697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:45.812367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1d3cf79b-f353-4a57-87bc-ae77bae1db35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a095dc3ada614757a0bbe3596e52a942'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:45.863968 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1d3cf79b-f353-4a57-87bc-ae77bae1db35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a095dc3ada614757a0bbe3596e52a942'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:45.866451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1d3cf79b-f353-4a57-87bc-ae77bae1db35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a095dc3ada614757a0bbe3596e52a942'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:45.885139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1d3cf79b-f353-4a57-87bc-ae77bae1db35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a095dc3ada614757a0bbe3596e52a942'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:45.888527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1d3cf79b-f353-4a57-87bc-ae77bae1db35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a095dc3ada614757a0bbe3596e52a942'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:45.899619 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6f3a1fe486f48629dedad69c9babb9f', 'request_id': 'req-9f2f5f01-ca41-4598-b914-b084c5a5247c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:45.925335 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6f3a1fe486f48629dedad69c9babb9f', 'request_id': 'req-9f2f5f01-ca41-4598-b914-b084c5a5247c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:45.926954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 990/1963] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:45 2022] DELETE /identity/v3/users/a095dc3ada614757a0bbe3596e52a942 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:45.930691 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac9db4-b849-40b0-a561-3355b3f861dc None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:45.932339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac9db4-b849-40b0-a561-3355b3f861dc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:45.933284 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac9db4-b849-40b0-a561-3355b3f861dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:45.934074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6f3a1fe486f48629dedad69c9babb9f', 'request_id': 'req-9f2f5f01-ca41-4598-b914-b084c5a5247c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:45.946806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] The token cache is being invalidate because project d6f3a1fe486f48629dedad69c9babb9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:45.947143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:45.948119 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:45.950116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 974/1964] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:45 2022] DELETE /identity/v3/projects/d6f3a1fe486f48629dedad69c9babb9f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:45.951085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:45.953892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:45.968166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-c3ac9db4-b849-40b0-a561-3355b3f861dc None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:45.970065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c3ac9db4-b849-40b0-a561-3355b3f861dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:46.014903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:46.072007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f5f01-ca41-4598-b914-b084c5a5247c admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:46.075236 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 991/1965] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:46.076308 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac9db4-b849-40b0-a561-3355b3f861dc None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:46.077678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c3ac9db4-b849-40b0-a561-3355b3f861dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:46.081258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:46.082244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:46.082595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:46.083071 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] PATH_INFO: `/v3/projects/26aac90e94964c6ba159a19ba6b3cd59` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:46.084379 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=26aac90e94964c6ba159a19ba6b3cd59)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:46.086504 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:46.091958 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac9db4-b849-40b0-a561-3355b3f861dc None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:46.097535 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa4277-a02e-4497-aeae-1b5f45aa09ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:46.098527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4277-a02e-4497-aeae-1b5f45aa09ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:46.098921 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4277-a02e-4497-aeae-1b5f45aa09ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:46.099270 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4277-a02e-4497-aeae-1b5f45aa09ab admin admin] PATH_INFO: `/v3/users/bd5625fff2e2400b8a19f579d426e0ee` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:46.106994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa4277-a02e-4497-aeae-1b5f45aa09ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5625fff2e2400b8a19f579d426e0ee)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:46.109088 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa4277-a02e-4497-aeae-1b5f45aa09ab admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:46.117381 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:46.158015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26aac90e94964c6ba159a19ba6b3cd59', 'request_id': 'req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:46.168322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26aac90e94964c6ba159a19ba6b3cd59', 'request_id': 'req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:46.177041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26aac90e94964c6ba159a19ba6b3cd59', 'request_id': 'req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:46.191041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4caa4277-a02e-4497-aeae-1b5f45aa09ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5625fff2e2400b8a19f579d426e0ee'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:46.204893 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] The token cache is being invalidate because project 26aac90e94964c6ba159a19ba6b3cd59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:46.205351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:46.206174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:46.207952 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 975/1966] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:45 2022] DELETE /identity/v3/projects/26aac90e94964c6ba159a19ba6b3cd59 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:46.209002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:46.215187 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:46.220091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4caa4277-a02e-4497-aeae-1b5f45aa09ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5625fff2e2400b8a19f579d426e0ee'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:46.221191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4caa4277-a02e-4497-aeae-1b5f45aa09ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5625fff2e2400b8a19f579d426e0ee'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:46.234198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4caa4277-a02e-4497-aeae-1b5f45aa09ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5625fff2e2400b8a19f579d426e0ee'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:46.235157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4caa4277-a02e-4497-aeae-1b5f45aa09ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5625fff2e2400b8a19f579d426e0ee'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:46.265955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 992/1967] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:46 2022] DELETE /identity/v3/users/bd5625fff2e2400b8a19f579d426e0ee => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:46.266491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6334-31fd-42cb-97f0-6227482bd551 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:46.266491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6334-31fd-42cb-97f0-6227482bd551 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:46.277305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6334-31fd-42cb-97f0-6227482bd551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:46.309647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0e3ef-0880-4ade-a24d-502b08f8f7ec admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:46.318104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6a1b6334-31fd-42cb-97f0-6227482bd551 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:46.322084 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6a1b6334-31fd-42cb-97f0-6227482bd551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:46.415779 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e8b31-810d-421d-9508-687769f6ae08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:46.418207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e8b31-810d-421d-9508-687769f6ae08 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:46.418499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e8b31-810d-421d-9508-687769f6ae08 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:46.419162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e8b31-810d-421d-9508-687769f6ae08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:46.422282 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-886e8b31-810d-421d-9508-687769f6ae08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:46.493782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 993/1968] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:46.499511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb6fab-1ae2-4694-b020-316c6d1be875 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:46.499913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb6fab-1ae2-4694-b020-316c6d1be875 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:46.500280 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb6fab-1ae2-4694-b020-316c6d1be875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:46.511190 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e8b31-810d-421d-9508-687769f6ae08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:46.513100 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e8b31-810d-421d-9508-687769f6ae08 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:46.527238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 976/1969] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:46.547340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-51fb6fab-1ae2-4694-b020-316c6d1be875 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:46.550299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-51fb6fab-1ae2-4694-b020-316c6d1be875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:46.564509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 994/1970] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:46.568578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e8b31-810d-421d-9508-687769f6ae08 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:46.583540 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e8b31-810d-421d-9508-687769f6ae08 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:46.592691 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00279b3-7d57-4bf1-8a6e-b35e385218c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:46.593908 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00279b3-7d57-4bf1-8a6e-b35e385218c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:46.594590 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00279b3-7d57-4bf1-8a6e-b35e385218c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:46.594991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00279b3-7d57-4bf1-8a6e-b35e385218c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:46.596595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00279b3-7d57-4bf1-8a6e-b35e385218c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:46.597010 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00279b3-7d57-4bf1-8a6e-b35e385218c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:46.598956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00279b3-7d57-4bf1-8a6e-b35e385218c3 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:46.611345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:46.620271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 977/1971] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:46.621917 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb6fab-1ae2-4694-b020-316c6d1be875 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:46.649155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb6fab-1ae2-4694-b020-316c6d1be875 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:46.655114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791447f-06fa-4cc7-ba9c-9575340052f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:46.656240 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791447f-06fa-4cc7-ba9c-9575340052f3 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:46.656917 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791447f-06fa-4cc7-ba9c-9575340052f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:46.657198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791447f-06fa-4cc7-ba9c-9575340052f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:46.657973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791447f-06fa-4cc7-ba9c-9575340052f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:46.660538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791447f-06fa-4cc7-ba9c-9575340052f3 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:46.702231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 995/1972] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:46 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:46.703794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00279b3-7d57-4bf1-8a6e-b35e385218c3 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:46.718446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00279b3-7d57-4bf1-8a6e-b35e385218c3 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:46.800478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021747d-6dbe-4152-9dc7-a53458662604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:46.801166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021747d-6dbe-4152-9dc7-a53458662604 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:46.801491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021747d-6dbe-4152-9dc7-a53458662604 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:46.801809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021747d-6dbe-4152-9dc7-a53458662604 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:46.802866 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021747d-6dbe-4152-9dc7-a53458662604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:46.806045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021747d-6dbe-4152-9dc7-a53458662604 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:46.830810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791447f-06fa-4cc7-ba9c-9575340052f3 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:46.832733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9791447f-06fa-4cc7-ba9c-9575340052f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:46.857957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 978/1973] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:46 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:49:46.867218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021747d-6dbe-4152-9dc7-a53458662604 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:46.868324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791447f-06fa-4cc7-ba9c-9575340052f3 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:46.883703 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4ad90-a686-4553-9ad7-9acb7569c954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:46.885332 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4ad90-a686-4553-9ad7-9acb7569c954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:46.886837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4ad90-a686-4553-9ad7-9acb7569c954 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:46.887132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4ad90-a686-4553-9ad7-9acb7569c954 admin admin] PATH_INFO: `/v3/projects/e549786aceb0477382f9cd811fadd3ef` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:46.890158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4ad90-a686-4553-9ad7-9acb7569c954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e549786aceb0477382f9cd811fadd3ef)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:46.894936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021747d-6dbe-4152-9dc7-a53458662604 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:46.896494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4ad90-a686-4553-9ad7-9acb7569c954 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:46.911175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870cd50-a952-4e67-b8a4-26e98580275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:46.912497 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870cd50-a952-4e67-b8a4-26e98580275b admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:46.912781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870cd50-a952-4e67-b8a4-26e98580275b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:46.913051 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870cd50-a952-4e67-b8a4-26e98580275b admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:46.914228 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870cd50-a952-4e67-b8a4-26e98580275b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:46.917634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870cd50-a952-4e67-b8a4-26e98580275b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:46.920926 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:46.947901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 979/1974] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:46.950865 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870cd50-a952-4e67-b8a4-26e98580275b admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:46.972271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870cd50-a952-4e67-b8a4-26e98580275b admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:46.986395 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ee90d-7d8f-4f0e-b0a9-07a229331e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:46.987140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ee90d-7d8f-4f0e-b0a9-07a229331e52 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:46.987418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ee90d-7d8f-4f0e-b0a9-07a229331e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:46.987694 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ee90d-7d8f-4f0e-b0a9-07a229331e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:46.988433 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ee90d-7d8f-4f0e-b0a9-07a229331e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:46.990108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ee90d-7d8f-4f0e-b0a9-07a229331e52 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:47.020714 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 980/1975] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:47.021814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ee90d-7d8f-4f0e-b0a9-07a229331e52 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:47.031731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-52a4ad90-a686-4553-9ad7-9acb7569c954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e549786aceb0477382f9cd811fadd3ef', 'request_id': 'req-52a4ad90-a686-4553-9ad7-9acb7569c954'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:47.039580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ee90d-7d8f-4f0e-b0a9-07a229331e52 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:47.060260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-52a4ad90-a686-4553-9ad7-9acb7569c954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e549786aceb0477382f9cd811fadd3ef', 'request_id': 'req-52a4ad90-a686-4553-9ad7-9acb7569c954'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:47.074382 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-52a4ad90-a686-4553-9ad7-9acb7569c954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e549786aceb0477382f9cd811fadd3ef', 'request_id': 'req-52a4ad90-a686-4553-9ad7-9acb7569c954'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:47.107030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-52a4ad90-a686-4553-9ad7-9acb7569c954 admin admin] The token cache is being invalidate because project e549786aceb0477382f9cd811fadd3ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:47.108466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-52a4ad90-a686-4553-9ad7-9acb7569c954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:47.109817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-52a4ad90-a686-4553-9ad7-9acb7569c954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:47.114203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 996/1976] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:46 2022] DELETE /identity/v3/projects/e549786aceb0477382f9cd811fadd3ef => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:47.124159 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf9a60-1bf8-4afe-971f-8d69caa5c1b0 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.124461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf9a60-1bf8-4afe-971f-8d69caa5c1b0 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.124745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf9a60-1bf8-4afe-971f-8d69caa5c1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:47.129750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a64bcd-1506-4a67-85eb-2184c9774321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:47.130901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a64bcd-1506-4a67-85eb-2184c9774321 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.131345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a64bcd-1506-4a67-85eb-2184c9774321 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.131778 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a64bcd-1506-4a67-85eb-2184c9774321 admin admin] PATH_INFO: `/v3/projects/d4abc08ffb2d4807bbc2a09766a2850f/users/3e4e6aedaf0b42ddaf2a9b58fab19178/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:47.152051 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a64bcd-1506-4a67-85eb-2184c9774321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4abc08ffb2d4807bbc2a09766a2850f, user_id=3e4e6aedaf0b42ddaf2a9b58fab19178, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:47.155935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a64bcd-1506-4a67-85eb-2184c9774321 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:47.179609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-aebf9a60-1bf8-4afe-971f-8d69caa5c1b0 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:47.181999 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-aebf9a60-1bf8-4afe-971f-8d69caa5c1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:47.190816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 981/1977] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:47 2022] PUT /identity/v3/projects/d4abc08ffb2d4807bbc2a09766a2850f/users/3e4e6aedaf0b42ddaf2a9b58fab19178/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:47.200871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0dbef-2e82-47a4-9cd7-fe2aa9d625e2 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.201574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0dbef-2e82-47a4-9cd7-fe2aa9d625e2 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.202016 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0dbef-2e82-47a4-9cd7-fe2aa9d625e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:47.243913 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-cce0dbef-2e82-47a4-9cd7-fe2aa9d625e2 None None] MFA Rules not processed for user `3e4e6aedaf0b42ddaf2a9b58fab19178`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:47.245851 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cce0dbef-2e82-47a4-9cd7-fe2aa9d625e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:47.279429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 997/1978] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:47.289102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988c6c2-7a61-43c9-841e-4dc4b085b2a3 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.289460 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988c6c2-7a61-43c9-841e-4dc4b085b2a3 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.289883 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988c6c2-7a61-43c9-841e-4dc4b085b2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:47.312168 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:47.328454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-0988c6c2-7a61-43c9-841e-4dc4b085b2a3 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:47.331148 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0988c6c2-7a61-43c9-841e-4dc4b085b2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:47.357544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 982/1979] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:47.360594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0dbef-2e82-47a4-9cd7-fe2aa9d625e2 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:47.363464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cce0dbef-2e82-47a4-9cd7-fe2aa9d625e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:47.399834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 998/1980] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:47.404328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988c6c2-7a61-43c9-841e-4dc4b085b2a3 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:47.407647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0988c6c2-7a61-43c9-841e-4dc4b085b2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:47.414695 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0dbef-2e82-47a4-9cd7-fe2aa9d625e2 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:47.420318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:47.421240 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.421601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.421881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] PATH_INFO: `/v3/projects/89931fc5ee1b42a6bd7758dab6f448ab` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:47.423179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] RBAC: Authorizing `identity:delete_project(project_id=89931fc5ee1b42a6bd7758dab6f448ab)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:47.425384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:47.431214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988c6c2-7a61-43c9-841e-4dc4b085b2a3 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:47.439090 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c03ee1-50af-41cb-affd-d21e3af0e641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:47.439780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c03ee1-50af-41cb-affd-d21e3af0e641 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.440438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c03ee1-50af-41cb-affd-d21e3af0e641 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.440546 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c03ee1-50af-41cb-affd-d21e3af0e641 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:47.441217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c03ee1-50af-41cb-affd-d21e3af0e641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:47.443187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c03ee1-50af-41cb-affd-d21e3af0e641 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:47.481458 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 999/1981] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:47 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:47.483431 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c03ee1-50af-41cb-affd-d21e3af0e641 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:47.521202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89931fc5ee1b42a6bd7758dab6f448ab', 'request_id': 'req-66941ee9-2921-42ec-b12d-f88aa10df75b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:47.549605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89931fc5ee1b42a6bd7758dab6f448ab', 'request_id': 'req-66941ee9-2921-42ec-b12d-f88aa10df75b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:47.561309 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89931fc5ee1b42a6bd7758dab6f448ab', 'request_id': 'req-66941ee9-2921-42ec-b12d-f88aa10df75b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:47.587290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c03ee1-50af-41cb-affd-d21e3af0e641 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:47.587551 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] The token cache is being invalidate because project 89931fc5ee1b42a6bd7758dab6f448ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:47.587823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:47.593627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:47.596053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 983/1982] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:47 2022] DELETE /identity/v3/projects/89931fc5ee1b42a6bd7758dab6f448ab => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:47.596829 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:47.598475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:47.608865 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:47.699378 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79354787-2f25-4fec-b49c-11b5b2e775e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:47.700190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79354787-2f25-4fec-b49c-11b5b2e775e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.700550 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79354787-2f25-4fec-b49c-11b5b2e775e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.700917 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79354787-2f25-4fec-b49c-11b5b2e775e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:47.701749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79354787-2f25-4fec-b49c-11b5b2e775e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:47.702128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79354787-2f25-4fec-b49c-11b5b2e775e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:47.703901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79354787-2f25-4fec-b49c-11b5b2e775e5 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:47.719747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66941ee9-2921-42ec-b12d-f88aa10df75b admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:47.723061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1000/1983] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:47.724847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ba285-0a52-45a6-92f8-263ed402d65d None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.725215 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ba285-0a52-45a6-92f8-263ed402d65d None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.725567 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f88de-41a6-456c-a614-38e806249137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:47.725715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ba285-0a52-45a6-92f8-263ed402d65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:47.726747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f88de-41a6-456c-a614-38e806249137 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.727133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f88de-41a6-456c-a614-38e806249137 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.727480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f88de-41a6-456c-a614-38e806249137 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:47.728262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f88de-41a6-456c-a614-38e806249137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:47.731292 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f88de-41a6-456c-a614-38e806249137 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:47.748800 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-b79ba285-0a52-45a6-92f8-263ed402d65d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:47.750284 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b79ba285-0a52-45a6-92f8-263ed402d65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:47.764966 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1001/1984] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:47.765556 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ba285-0a52-45a6-92f8-263ed402d65d None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:47.766681 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 984/1985] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:47 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:47.768205 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99fdc7-87bb-4ddc-8e5c-f9216b0645e3 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.768492 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99fdc7-87bb-4ddc-8e5c-f9216b0645e3 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.768675 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b79ba285-0a52-45a6-92f8-263ed402d65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:47.768780 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99fdc7-87bb-4ddc-8e5c-f9216b0645e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:47.788243 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ba285-0a52-45a6-92f8-263ed402d65d None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:47.795271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23577e5-f567-4297-b3e4-bb737f35b7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:47.796393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23577e5-f567-4297-b3e4-bb737f35b7ca admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.796393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23577e5-f567-4297-b3e4-bb737f35b7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.796649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23577e5-f567-4297-b3e4-bb737f35b7ca admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:47.797362 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23577e5-f567-4297-b3e4-bb737f35b7ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:47.797863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-be99fdc7-87bb-4ddc-8e5c-f9216b0645e3 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:47.799381 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-be99fdc7-87bb-4ddc-8e5c-f9216b0645e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:47.799506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23577e5-f567-4297-b3e4-bb737f35b7ca admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:47.809345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 985/1986] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:47.810159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99fdc7-87bb-4ddc-8e5c-f9216b0645e3 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:47.821626 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99fdc7-87bb-4ddc-8e5c-f9216b0645e3 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:47.827420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33126046-36f9-4479-8968-181dd4c98930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:47.828302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33126046-36f9-4479-8968-181dd4c98930 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.828488 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33126046-36f9-4479-8968-181dd4c98930 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.828977 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33126046-36f9-4479-8968-181dd4c98930 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:47.829972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33126046-36f9-4479-8968-181dd4c98930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:47.831769 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33126046-36f9-4479-8968-181dd4c98930 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:47.833542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1002/1987] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:47 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:47.835155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23577e5-f567-4297-b3e4-bb737f35b7ca admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:47.850992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 986/1988] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:47.851991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33126046-36f9-4479-8968-181dd4c98930 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:47.863273 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33126046-36f9-4479-8968-181dd4c98930 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:47.913211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:47.920979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23577e5-f567-4297-b3e4-bb737f35b7ca admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:47.939468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a452e-e5fa-49e6-aff4-41e6cab1a21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:47.940226 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a452e-e5fa-49e6-aff4-41e6cab1a21b admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.940518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a452e-e5fa-49e6-aff4-41e6cab1a21b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.940800 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a452e-e5fa-49e6-aff4-41e6cab1a21b admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:47.941668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a452e-e5fa-49e6-aff4-41e6cab1a21b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:47.941959 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a452e-e5fa-49e6-aff4-41e6cab1a21b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:47.944212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a452e-e5fa-49e6-aff4-41e6cab1a21b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:47.970844 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1003/1989] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:47.970844 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a452e-e5fa-49e6-aff4-41e6cab1a21b admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:47.974305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08782c50-3145-4aa5-9425-6be5fba86757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:47.975049 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08782c50-3145-4aa5-9425-6be5fba86757 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.975326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08782c50-3145-4aa5-9425-6be5fba86757 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.975600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08782c50-3145-4aa5-9425-6be5fba86757 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:47.976339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08782c50-3145-4aa5-9425-6be5fba86757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:47.979049 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08782c50-3145-4aa5-9425-6be5fba86757 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:47.981981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a452e-e5fa-49e6-aff4-41e6cab1a21b admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:47.997009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba397a4-a470-4cb0-94e7-8f2a1e9c0a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:47.999058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba397a4-a470-4cb0-94e7-8f2a1e9c0a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:47.999397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba397a4-a470-4cb0-94e7-8f2a1e9c0a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:47.999685 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba397a4-a470-4cb0-94e7-8f2a1e9c0a49 admin admin] PATH_INFO: `/v3/projects/537f4108a20e45a1955dbf611ebf1626/users/a34d6990ba7840a7a472d4cf7877eb17/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.020446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 987/1990] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:47 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:48.020446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08782c50-3145-4aa5-9425-6be5fba86757 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:48.030315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08782c50-3145-4aa5-9425-6be5fba86757 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:48.035730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba397a4-a470-4cb0-94e7-8f2a1e9c0a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=537f4108a20e45a1955dbf611ebf1626, user_id=a34d6990ba7840a7a472d4cf7877eb17, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:48.036325 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f38f1-fc0f-4c70-93a9-04f8a83452a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:48.037005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f38f1-fc0f-4c70-93a9-04f8a83452a2 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.037284 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f38f1-fc0f-4c70-93a9-04f8a83452a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.037782 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f38f1-fc0f-4c70-93a9-04f8a83452a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.038654 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f38f1-fc0f-4c70-93a9-04f8a83452a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:48.041409 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f38f1-fc0f-4c70-93a9-04f8a83452a2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:48.044043 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba397a4-a470-4cb0-94e7-8f2a1e9c0a49 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:48.078481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1004/1991] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:47 2022] PUT /identity/v3/projects/537f4108a20e45a1955dbf611ebf1626/users/a34d6990ba7840a7a472d4cf7877eb17/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:48.082176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba397a4-a470-4cb0-94e7-8f2a1e9c0a49 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:48.106919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 988/1992] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:48 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:48.106919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f38f1-fc0f-4c70-93a9-04f8a83452a2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:48.217234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:48.241100 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f38f1-fc0f-4c70-93a9-04f8a83452a2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:48.249350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba397a4-a470-4cb0-94e7-8f2a1e9c0a49 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:48.250865 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78336023-d430-4122-a8f5-05e69e8d105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:48.251942 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78336023-d430-4122-a8f5-05e69e8d105e admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.252266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78336023-d430-4122-a8f5-05e69e8d105e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.252547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78336023-d430-4122-a8f5-05e69e8d105e admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.253488 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78336023-d430-4122-a8f5-05e69e8d105e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:48.257085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78336023-d430-4122-a8f5-05e69e8d105e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:48.262050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2404311-2bc2-462c-972f-7733325eeda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:48.263122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2404311-2bc2-462c-972f-7733325eeda0 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.263504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2404311-2bc2-462c-972f-7733325eeda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.263906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2404311-2bc2-462c-972f-7733325eeda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.265025 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2404311-2bc2-462c-972f-7733325eeda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:48.267225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2404311-2bc2-462c-972f-7733325eeda0 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:48.288898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1005/1993] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:48.290010 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2404311-2bc2-462c-972f-7733325eeda0 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:48.297582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 989/1994] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:48.297582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78336023-d430-4122-a8f5-05e69e8d105e admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:48.314072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78336023-d430-4122-a8f5-05e69e8d105e admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:48.317737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2404311-2bc2-462c-972f-7733325eeda0 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:48.320070 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb4851-2865-4947-b1b1-1be83f1b7f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:48.321164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb4851-2865-4947-b1b1-1be83f1b7f6e admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.321256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb4851-2865-4947-b1b1-1be83f1b7f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.321524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb4851-2865-4947-b1b1-1be83f1b7f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.322383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb4851-2865-4947-b1b1-1be83f1b7f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:48.324375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb4851-2865-4947-b1b1-1be83f1b7f6e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:48.334581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86888c-6ddf-406d-9cbd-9be943dc40bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:48.335345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86888c-6ddf-406d-9cbd-9be943dc40bf admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.335630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86888c-6ddf-406d-9cbd-9be943dc40bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.339795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86888c-6ddf-406d-9cbd-9be943dc40bf admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.339969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 990/1995] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:48.340061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86888c-6ddf-406d-9cbd-9be943dc40bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:48.340142 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb4851-2865-4947-b1b1-1be83f1b7f6e admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:48.344870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86888c-6ddf-406d-9cbd-9be943dc40bf admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:48.354555 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb4851-2865-4947-b1b1-1be83f1b7f6e admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:48.360630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0fe25-c4a0-4898-b90b-303eb6111e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:48.361562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0fe25-c4a0-4898-b90b-303eb6111e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.361812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0fe25-c4a0-4898-b90b-303eb6111e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.362081 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0fe25-c4a0-4898-b90b-303eb6111e53 admin admin] PATH_INFO: `/v3/projects/537f4108a20e45a1955dbf611ebf1626/users/a34d6990ba7840a7a472d4cf7877eb17/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.364311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0fe25-c4a0-4898-b90b-303eb6111e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=537f4108a20e45a1955dbf611ebf1626, user_id=a34d6990ba7840a7a472d4cf7877eb17, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:48.366800 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0fe25-c4a0-4898-b90b-303eb6111e53 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:48.382167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 991/1996] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:48 2022] PUT /identity/v3/projects/537f4108a20e45a1955dbf611ebf1626/users/a34d6990ba7840a7a472d4cf7877eb17/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:48.383209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0fe25-c4a0-4898-b90b-303eb6111e53 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:48.397754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1006/1997] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:48 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:48.397754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77119be3-6698-4a0b-82d5-50688e85ec79 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.397754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77119be3-6698-4a0b-82d5-50688e85ec79 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.397754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77119be3-6698-4a0b-82d5-50688e85ec79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.439198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-77119be3-6698-4a0b-82d5-50688e85ec79 None None] MFA Rules not processed for user `a34d6990ba7840a7a472d4cf7877eb17`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:48.440780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-77119be3-6698-4a0b-82d5-50688e85ec79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:48.477711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0fe25-c4a0-4898-b90b-303eb6111e53 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:48.482875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58926081-956c-4c32-82ad-cb4fa260dc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:48.484054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58926081-956c-4c32-82ad-cb4fa260dc00 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.484342 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58926081-956c-4c32-82ad-cb4fa260dc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.484620 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58926081-956c-4c32-82ad-cb4fa260dc00 admin admin] PATH_INFO: `/v3/projects/e1eb3ee6cf1e416c9b253ca3ab7ef2c2/users/5a79ca2c512b48f8840ad790550137b6/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.502364 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58926081-956c-4c32-82ad-cb4fa260dc00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1eb3ee6cf1e416c9b253ca3ab7ef2c2, user_id=5a79ca2c512b48f8840ad790550137b6, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:48.505090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58926081-956c-4c32-82ad-cb4fa260dc00 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:48.516930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:48.523906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 992/1998] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:48 2022] PUT /identity/v3/projects/e1eb3ee6cf1e416c9b253ca3ab7ef2c2/users/5a79ca2c512b48f8840ad790550137b6/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:48.525096 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58926081-956c-4c32-82ad-cb4fa260dc00 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:48.564424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1007/1999] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:48.566197 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f28dfd-877c-49dd-a22d-77bf039cc62a None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.566586 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f28dfd-877c-49dd-a22d-77bf039cc62a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.566895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f28dfd-877c-49dd-a22d-77bf039cc62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.620198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-60f28dfd-877c-49dd-a22d-77bf039cc62a None None] MFA Rules not processed for user `5a79ca2c512b48f8840ad790550137b6`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:48.621452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-60f28dfd-877c-49dd-a22d-77bf039cc62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:48.625225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58926081-956c-4c32-82ad-cb4fa260dc00 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:48.630490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827318a7-080f-44ca-8402-ac9336ab6e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:48.631743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827318a7-080f-44ca-8402-ac9336ab6e79 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.632094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827318a7-080f-44ca-8402-ac9336ab6e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.632435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827318a7-080f-44ca-8402-ac9336ab6e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.633689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827318a7-080f-44ca-8402-ac9336ab6e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:48.635476 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827318a7-080f-44ca-8402-ac9336ab6e79 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:48.649499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 993/2000] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:48.649499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827318a7-080f-44ca-8402-ac9336ab6e79 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:48.649766 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-827318a7-080f-44ca-8402-ac9336ab6e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:48.718895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1008/2001] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:48.720222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f28dfd-877c-49dd-a22d-77bf039cc62a None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:48.726330 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827318a7-080f-44ca-8402-ac9336ab6e79 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:48.730593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bbf1b-00d5-4c84-a595-ce19d4b397d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:48.731449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bbf1b-00d5-4c84-a595-ce19d4b397d7 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.731797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bbf1b-00d5-4c84-a595-ce19d4b397d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.732256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bbf1b-00d5-4c84-a595-ce19d4b397d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.734131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9d1bbf1b-00d5-4c84-a595-ce19d4b397d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:48.749703 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f28dfd-877c-49dd-a22d-77bf039cc62a None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:48.756197 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9295-231e-406f-8a1a-7e53cbf01aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:48.756988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9295-231e-406f-8a1a-7e53cbf01aeb admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.757384 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9295-231e-406f-8a1a-7e53cbf01aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.757869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9295-231e-406f-8a1a-7e53cbf01aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.758756 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a9295-231e-406f-8a1a-7e53cbf01aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:48.761256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a9295-231e-406f-8a1a-7e53cbf01aeb admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:48.774892 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1009/2002] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:48.776277 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9295-231e-406f-8a1a-7e53cbf01aeb admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:48.796039 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9295-231e-406f-8a1a-7e53cbf01aeb admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:48.808636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c039a6-3b13-4213-9716-8cfeae126e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:48.809394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c039a6-3b13-4213-9716-8cfeae126e36 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.809677 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c039a6-3b13-4213-9716-8cfeae126e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.809956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c039a6-3b13-4213-9716-8cfeae126e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.810704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c039a6-3b13-4213-9716-8cfeae126e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:48.814969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c039a6-3b13-4213-9716-8cfeae126e36 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:48.819730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bbf1b-00d5-4c84-a595-ce19d4b397d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:48.821972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bbf1b-00d5-4c84-a595-ce19d4b397d7 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:48.834889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 994/2003] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:48.851644 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bbf1b-00d5-4c84-a595-ce19d4b397d7 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:48.864606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bbf1b-00d5-4c84-a595-ce19d4b397d7 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:48.866296 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1010/2004] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:48 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:48.867926 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c039a6-3b13-4213-9716-8cfeae126e36 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:48.897071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:48.942471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:48.960411 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d321088-092b-4db4-b17e-fa5f09bad09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:48.962427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d321088-092b-4db4-b17e-fa5f09bad09a admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.963857 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d321088-092b-4db4-b17e-fa5f09bad09a admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.963857 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d321088-092b-4db4-b17e-fa5f09bad09a admin admin] PATH_INFO: `/v3/projects/2ac36c8e839b49278b559003f331bfda/users/9cc3d33007a04c4888755d8af1ba5cad/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.980080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c039a6-3b13-4213-9716-8cfeae126e36 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:48.986283 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87b0e5-6c61-4f3b-a8b3-24aac8cc2967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:48.987194 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b0e5-6c61-4f3b-a8b3-24aac8cc2967 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:48.987392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b0e5-6c61-4f3b-a8b3-24aac8cc2967 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:48.987667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b0e5-6c61-4f3b-a8b3-24aac8cc2967 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:48.988028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d321088-092b-4db4-b17e-fa5f09bad09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac36c8e839b49278b559003f331bfda, user_id=9cc3d33007a04c4888755d8af1ba5cad, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:48.988629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87b0e5-6c61-4f3b-a8b3-24aac8cc2967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:48.990727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87b0e5-6c61-4f3b-a8b3-24aac8cc2967 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:48.992741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d321088-092b-4db4-b17e-fa5f09bad09a admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:49.013995 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 995/2005] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:48 2022] PUT /identity/v3/projects/2ac36c8e839b49278b559003f331bfda/users/9cc3d33007a04c4888755d8af1ba5cad/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:49.019337 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030638-790d-4354-b2c4-d142d3f0116d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:49.022726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030638-790d-4354-b2c4-d142d3f0116d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:49.022726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030638-790d-4354-b2c4-d142d3f0116d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:49.023185 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1011/2006] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:48 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:49.024137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87b0e5-6c61-4f3b-a8b3-24aac8cc2967 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:49.038335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87b0e5-6c61-4f3b-a8b3-24aac8cc2967 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:49.047592 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-06030638-790d-4354-b2c4-d142d3f0116d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:49.048808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-06030638-790d-4354-b2c4-d142d3f0116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:49.121441 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebaffb-16a8-48dd-8946-7a463ac945c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:49.122656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebaffb-16a8-48dd-8946-7a463ac945c1 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:49.122656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebaffb-16a8-48dd-8946-7a463ac945c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:49.122880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebaffb-16a8-48dd-8946-7a463ac945c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:49.123947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebaffb-16a8-48dd-8946-7a463ac945c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:49.126119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebaffb-16a8-48dd-8946-7a463ac945c1 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:49.132973 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 996/2007] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:49.142904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1012/2008] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:49.144629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06030638-790d-4354-b2c4-d142d3f0116d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:49.147861 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebaffb-16a8-48dd-8946-7a463ac945c1 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:49.150015 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f0ebaffb-16a8-48dd-8946-7a463ac945c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:49.174860 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06030638-790d-4354-b2c4-d142d3f0116d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:49.193668 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a2789-1bb7-4c12-af76-080cca01840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:49.194996 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a2789-1bb7-4c12-af76-080cca01840c admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:49.195749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a2789-1bb7-4c12-af76-080cca01840c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:49.197952 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a2789-1bb7-4c12-af76-080cca01840c admin admin] PATH_INFO: `/v3/projects/2b373e7557d949bcaaedbdb93c19d873/users/8d30e566ccf4439aa58e23ad91e75686/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:49.231264 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a2789-1bb7-4c12-af76-080cca01840c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b373e7557d949bcaaedbdb93c19d873, user_id=8d30e566ccf4439aa58e23ad91e75686, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:49.234379 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a2789-1bb7-4c12-af76-080cca01840c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:49.265194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 997/2009] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:49 2022] PUT /identity/v3/projects/2b373e7557d949bcaaedbdb93c19d873/users/8d30e566ccf4439aa58e23ad91e75686/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:49.268112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a2789-1bb7-4c12-af76-080cca01840c admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:49.281400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebaffb-16a8-48dd-8946-7a463ac945c1 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:49.365477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a2789-1bb7-4c12-af76-080cca01840c admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:49.366886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acef0d-e0bd-4c7f-8865-8f21be54ac88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:49.367554 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acef0d-e0bd-4c7f-8865-8f21be54ac88 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:49.367836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acef0d-e0bd-4c7f-8865-8f21be54ac88 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:49.368109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acef0d-e0bd-4c7f-8865-8f21be54ac88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:49.370484 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3288424-6edf-47ac-8315-c01cf2740bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:49.371199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3288424-6edf-47ac-8315-c01cf2740bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:49.371482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3288424-6edf-47ac-8315-c01cf2740bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:49.372372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3288424-6edf-47ac-8315-c01cf2740bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:49.376957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:49.379468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acef0d-e0bd-4c7f-8865-8f21be54ac88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:49.381246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acef0d-e0bd-4c7f-8865-8f21be54ac88 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:49.383314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3288424-6edf-47ac-8315-c01cf2740bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:49.385086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3288424-6edf-47ac-8315-c01cf2740bb0 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:49.407190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1013/2010] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:49.413914 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 998/2011] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:49.418519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acef0d-e0bd-4c7f-8865-8f21be54ac88 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:49.430957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acef0d-e0bd-4c7f-8865-8f21be54ac88 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:49.437170 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20643bb0-4d87-42bf-83cc-b2455e1a3960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:49.438371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20643bb0-4d87-42bf-83cc-b2455e1a3960 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:49.438862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20643bb0-4d87-42bf-83cc-b2455e1a3960 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:49.439313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20643bb0-4d87-42bf-83cc-b2455e1a3960 admin admin] PATH_INFO: `/v3/projects/2b373e7557d949bcaaedbdb93c19d873/users/8d30e566ccf4439aa58e23ad91e75686/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:49.441762 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20643bb0-4d87-42bf-83cc-b2455e1a3960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b373e7557d949bcaaedbdb93c19d873, user_id=8d30e566ccf4439aa58e23ad91e75686, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:49.445938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20643bb0-4d87-42bf-83cc-b2455e1a3960 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:49.459553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1014/2012] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:49 2022] PUT /identity/v3/projects/2b373e7557d949bcaaedbdb93c19d873/users/8d30e566ccf4439aa58e23ad91e75686/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:49.472107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed63b0-9698-4d7d-b2d2-a8354d5b90b9 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:49.472390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed63b0-9698-4d7d-b2d2-a8354d5b90b9 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:49.472670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed63b0-9698-4d7d-b2d2-a8354d5b90b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:49.503966 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-37ed63b0-9698-4d7d-b2d2-a8354d5b90b9 None None] MFA Rules not processed for user `8d30e566ccf4439aa58e23ad91e75686`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:49.505421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-37ed63b0-9698-4d7d-b2d2-a8354d5b90b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:49.545541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:49.590377 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 999/2013] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:49.603217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20643bb0-4d87-42bf-83cc-b2455e1a3960 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:49.666498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20643bb0-4d87-42bf-83cc-b2455e1a3960 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:49.670595 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a7e5f-0552-4e12-b90c-782d9e95ad47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:49.671288 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a7e5f-0552-4e12-b90c-782d9e95ad47 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:49.671570 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a7e5f-0552-4e12-b90c-782d9e95ad47 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:49.671847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a7e5f-0552-4e12-b90c-782d9e95ad47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:49.682001 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a7e5f-0552-4e12-b90c-782d9e95ad47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:49.683519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a7e5f-0552-4e12-b90c-782d9e95ad47 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:49.694780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1015/2014] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:49.769037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed63b0-9698-4d7d-b2d2-a8354d5b90b9 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:49.880487 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed63b0-9698-4d7d-b2d2-a8354d5b90b9 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:49.886085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc359bd3-ff27-447e-a8c1-94705d1adf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:49.887032 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359bd3-ff27-447e-a8c1-94705d1adf25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:49.887306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359bd3-ff27-447e-a8c1-94705d1adf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:49.887610 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359bd3-ff27-447e-a8c1-94705d1adf25 admin admin] PATH_INFO: `/v3/users/5a79ca2c512b48f8840ad790550137b6` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:49.888850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc359bd3-ff27-447e-a8c1-94705d1adf25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a79ca2c512b48f8840ad790550137b6)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:49.891125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc359bd3-ff27-447e-a8c1-94705d1adf25 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:49.944373 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cc359bd3-ff27-447e-a8c1-94705d1adf25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a79ca2c512b48f8840ad790550137b6'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:49.957390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cc359bd3-ff27-447e-a8c1-94705d1adf25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a79ca2c512b48f8840ad790550137b6'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:49.965505 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cc359bd3-ff27-447e-a8c1-94705d1adf25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a79ca2c512b48f8840ad790550137b6'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:49.966262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cc359bd3-ff27-447e-a8c1-94705d1adf25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a79ca2c512b48f8840ad790550137b6'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:49.966887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cc359bd3-ff27-447e-a8c1-94705d1adf25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a79ca2c512b48f8840ad790550137b6'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:49.983755 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1000/2015] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:49 2022] DELETE /identity/v3/users/5a79ca2c512b48f8840ad790550137b6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:49.988532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4d9ba-6705-421b-9d0e-2c6a0f871ba5 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:49.988802 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4d9ba-6705-421b-9d0e-2c6a0f871ba5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:49.989076 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4d9ba-6705-421b-9d0e-2c6a0f871ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:50.007669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-1be4d9ba-6705-421b-9d0e-2c6a0f871ba5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:50.008881 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1be4d9ba-6705-421b-9d0e-2c6a0f871ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:50.072968 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1016/2016] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:50.083127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc359bd3-ff27-447e-a8c1-94705d1adf25 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:50.084657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cc359bd3-ff27-447e-a8c1-94705d1adf25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:50.141972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:50.146224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc359bd3-ff27-447e-a8c1-94705d1adf25 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:50.151976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9859b1-8f5a-4467-ad39-dbb0e68af501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:50.152651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9859b1-8f5a-4467-ad39-dbb0e68af501 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:50.152935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9859b1-8f5a-4467-ad39-dbb0e68af501 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:50.153213 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9859b1-8f5a-4467-ad39-dbb0e68af501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:50.166565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9859b1-8f5a-4467-ad39-dbb0e68af501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:50.168964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9859b1-8f5a-4467-ad39-dbb0e68af501 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:50.181447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1001/2017] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:50.332086 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21a221-0a8d-4941-ac5c-08e83d21b0f3 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:50.332888 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21a221-0a8d-4941-ac5c-08e83d21b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:50.333448 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21a221-0a8d-4941-ac5c-08e83d21b0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:50.404569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-eb21a221-0a8d-4941-ac5c-08e83d21b0f3 None None] MFA Rules not processed for user `9cc3d33007a04c4888755d8af1ba5cad`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:50.412189 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-eb21a221-0a8d-4941-ac5c-08e83d21b0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:50.514215 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1017/2018] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:50.569716 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9859b1-8f5a-4467-ad39-dbb0e68af501 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:50.571534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ad9859b1-8f5a-4467-ad39-dbb0e68af501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:50.583908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21a221-0a8d-4941-ac5c-08e83d21b0f3 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:50.585577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-eb21a221-0a8d-4941-ac5c-08e83d21b0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:50.589162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9859b1-8f5a-4467-ad39-dbb0e68af501 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:50.596031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:50.596946 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:50.597222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:50.597515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] PATH_INFO: `/v3/projects/e1eb3ee6cf1e416c9b253ca3ab7ef2c2` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:50.598868 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1eb3ee6cf1e416c9b253ca3ab7ef2c2)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:50.601192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:50.616655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:50.669249 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1eb3ee6cf1e416c9b253ca3ab7ef2c2', 'request_id': 'req-2d25d8da-bea9-40dd-b094-abe654207265'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:50.672935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21a221-0a8d-4941-ac5c-08e83d21b0f3 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:50.685915 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1eb3ee6cf1e416c9b253ca3ab7ef2c2', 'request_id': 'req-2d25d8da-bea9-40dd-b094-abe654207265'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:50.700978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1eb3ee6cf1e416c9b253ca3ab7ef2c2', 'request_id': 'req-2d25d8da-bea9-40dd-b094-abe654207265'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:50.738226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] The token cache is being invalidate because project e1eb3ee6cf1e416c9b253ca3ab7ef2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:50.738226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:50.738226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:50.738226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1002/2019] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:50 2022] DELETE /identity/v3/projects/e1eb3ee6cf1e416c9b253ca3ab7ef2c2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:50.738226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:50.739845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:50.741399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f5103-0e6c-4d1d-96fa-604d8969642e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:50.742173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5103-0e6c-4d1d-96fa-604d8969642e service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:50.742528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5103-0e6c-4d1d-96fa-604d8969642e service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:50.742942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5103-0e6c-4d1d-96fa-604d8969642e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:50.745244 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-079f5103-0e6c-4d1d-96fa-604d8969642e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:50.824108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25d8da-bea9-40dd-b094-abe654207265 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:50.828971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eed95f-71d5-42ca-a369-191f5b82cc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:50.829867 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eed95f-71d5-42ca-a369-191f5b82cc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:50.830135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eed95f-71d5-42ca-a369-191f5b82cc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:50.830814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eed95f-71d5-42ca-a369-191f5b82cc44 admin admin] PATH_INFO: `/v3/users/8d30e566ccf4439aa58e23ad91e75686` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:50.831714 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eed95f-71d5-42ca-a369-191f5b82cc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d30e566ccf4439aa58e23ad91e75686)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:50.833127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f5103-0e6c-4d1d-96fa-604d8969642e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:50.833662 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eed95f-71d5-42ca-a369-191f5b82cc44 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:50.834755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f5103-0e6c-4d1d-96fa-604d8969642e service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:50.857995 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1018/2020] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:50.860108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f5103-0e6c-4d1d-96fa-604d8969642e service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:50.861783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-079f5103-0e6c-4d1d-96fa-604d8969642e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:50.874342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f5103-0e6c-4d1d-96fa-604d8969642e service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:50.878490 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f97455-a0a7-4a28-b5a9-9cc263f38662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:50.879209 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f97455-a0a7-4a28-b5a9-9cc263f38662 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:50.879484 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f97455-a0a7-4a28-b5a9-9cc263f38662 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:50.879771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f97455-a0a7-4a28-b5a9-9cc263f38662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:50.882824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-03f97455-a0a7-4a28-b5a9-9cc263f38662 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:50.898359 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e7eed95f-71d5-42ca-a369-191f5b82cc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d30e566ccf4439aa58e23ad91e75686'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:50.913944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e7eed95f-71d5-42ca-a369-191f5b82cc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d30e566ccf4439aa58e23ad91e75686'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:50.925028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e7eed95f-71d5-42ca-a369-191f5b82cc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d30e566ccf4439aa58e23ad91e75686'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:50.926093 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e7eed95f-71d5-42ca-a369-191f5b82cc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d30e566ccf4439aa58e23ad91e75686'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:50.926956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e7eed95f-71d5-42ca-a369-191f5b82cc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d30e566ccf4439aa58e23ad91e75686'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:50.930059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:50.946114 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1003/2021] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:50 2022] DELETE /identity/v3/users/8d30e566ccf4439aa58e23ad91e75686 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:50.956348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f97455-a0a7-4a28-b5a9-9cc263f38662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:50.957799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f97455-a0a7-4a28-b5a9-9cc263f38662 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:50.969087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1019/2022] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:49:51.320400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eed95f-71d5-42ca-a369-191f5b82cc44 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:51.323364 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e7eed95f-71d5-42ca-a369-191f5b82cc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:51.407511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eed95f-71d5-42ca-a369-191f5b82cc44 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:51.412091 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8ba8d-0347-454b-b5dc-d97393baa5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:51.413042 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8ba8d-0347-454b-b5dc-d97393baa5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:51.413227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8ba8d-0347-454b-b5dc-d97393baa5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:51.413499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8ba8d-0347-454b-b5dc-d97393baa5a1 admin admin] PATH_INFO: `/v3/projects/2b373e7557d949bcaaedbdb93c19d873` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:51.414671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8ba8d-0347-454b-b5dc-d97393baa5a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b373e7557d949bcaaedbdb93c19d873)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:51.416692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8ba8d-0347-454b-b5dc-d97393baa5a1 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:51.467164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-94d8ba8d-0347-454b-b5dc-d97393baa5a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b373e7557d949bcaaedbdb93c19d873', 'request_id': 'req-94d8ba8d-0347-454b-b5dc-d97393baa5a1'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:51.479753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-94d8ba8d-0347-454b-b5dc-d97393baa5a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b373e7557d949bcaaedbdb93c19d873', 'request_id': 'req-94d8ba8d-0347-454b-b5dc-d97393baa5a1'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:51.487024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-94d8ba8d-0347-454b-b5dc-d97393baa5a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b373e7557d949bcaaedbdb93c19d873', 'request_id': 'req-94d8ba8d-0347-454b-b5dc-d97393baa5a1'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:51.499544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-94d8ba8d-0347-454b-b5dc-d97393baa5a1 admin admin] The token cache is being invalidate because project 2b373e7557d949bcaaedbdb93c19d873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:51.499923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-94d8ba8d-0347-454b-b5dc-d97393baa5a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:51.500736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-94d8ba8d-0347-454b-b5dc-d97393baa5a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:51.502604 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1004/2023] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:51 2022] DELETE /identity/v3/projects/2b373e7557d949bcaaedbdb93c19d873 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:51.508003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b197e34-adfa-43e3-88e0-9c406025d535 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:51.508469 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b197e34-adfa-43e3-88e0-9c406025d535 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:51.508560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b197e34-adfa-43e3-88e0-9c406025d535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:51.528262 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-5b197e34-adfa-43e3-88e0-9c406025d535 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:51.529491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5b197e34-adfa-43e3-88e0-9c406025d535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:51.542595 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:51.594600 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1020/2024] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:51.602465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326b0a0-23ac-42e0-a146-3bfac387a0bf None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:51.602784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326b0a0-23ac-42e0-a146-3bfac387a0bf None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:51.603063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326b0a0-23ac-42e0-a146-3bfac387a0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:51.622198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e326b0a0-23ac-42e0-a146-3bfac387a0bf None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:51.623468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e326b0a0-23ac-42e0-a146-3bfac387a0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:51.631821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1005/2025] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:51.636364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b197e34-adfa-43e3-88e0-9c406025d535 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:51.647074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b197e34-adfa-43e3-88e0-9c406025d535 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:51.653145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d3b6a-3ede-471d-a609-76b018b515ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:51.653839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3b6a-3ede-471d-a609-76b018b515ad admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:51.654111 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3b6a-3ede-471d-a609-76b018b515ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:51.654390 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3b6a-3ede-471d-a609-76b018b515ad admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:51.655202 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d3b6a-3ede-471d-a609-76b018b515ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:51.655515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d3b6a-3ede-471d-a609-76b018b515ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:51.657142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d3b6a-3ede-471d-a609-76b018b515ad admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:51.673326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1021/2026] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:51.677723 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326b0a0-23ac-42e0-a146-3bfac387a0bf None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:51.697540 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326b0a0-23ac-42e0-a146-3bfac387a0bf None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:51.703298 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a498da-d023-4066-a199-39f76fb528d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:51.704573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a498da-d023-4066-a199-39f76fb528d2 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:51.704922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a498da-d023-4066-a199-39f76fb528d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:51.705193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a498da-d023-4066-a199-39f76fb528d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:51.705955 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a498da-d023-4066-a199-39f76fb528d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:51.708053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a498da-d023-4066-a199-39f76fb528d2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:51.716604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d3b6a-3ede-471d-a609-76b018b515ad admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:51.724358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-435d3b6a-3ede-471d-a609-76b018b515ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:51.742989 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d3b6a-3ede-471d-a609-76b018b515ad admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:51.748442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68a371-4eef-4f7b-912e-1cfb6c285e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:51.749342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68a371-4eef-4f7b-912e-1cfb6c285e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:51.749699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68a371-4eef-4f7b-912e-1cfb6c285e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:51.749914 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68a371-4eef-4f7b-912e-1cfb6c285e7d admin admin] PATH_INFO: `/v3/users/3e4e6aedaf0b42ddaf2a9b58fab19178` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:51.751158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68a371-4eef-4f7b-912e-1cfb6c285e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e4e6aedaf0b42ddaf2a9b58fab19178)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:51.754130 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68a371-4eef-4f7b-912e-1cfb6c285e7d admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:51.762404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1006/2027] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:51 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:51.767535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a498da-d023-4066-a199-39f76fb528d2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:51.837165 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:51.841385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7a68a371-4eef-4f7b-912e-1cfb6c285e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e4e6aedaf0b42ddaf2a9b58fab19178'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:51.844173 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a498da-d023-4066-a199-39f76fb528d2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:51.876959 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7a68a371-4eef-4f7b-912e-1cfb6c285e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e4e6aedaf0b42ddaf2a9b58fab19178'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:51.877962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7a68a371-4eef-4f7b-912e-1cfb6c285e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e4e6aedaf0b42ddaf2a9b58fab19178'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:51.882256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd98af-a88c-4f1e-9e71-8eeee2fa93dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:51.883257 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd98af-a88c-4f1e-9e71-8eeee2fa93dc admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:51.883641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd98af-a88c-4f1e-9e71-8eeee2fa93dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:51.884094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd98af-a88c-4f1e-9e71-8eeee2fa93dc admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:51.884829 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd98af-a88c-4f1e-9e71-8eeee2fa93dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:51.886515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7a68a371-4eef-4f7b-912e-1cfb6c285e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e4e6aedaf0b42ddaf2a9b58fab19178'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:51.887351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd98af-a88c-4f1e-9e71-8eeee2fa93dc admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:51.887656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7a68a371-4eef-4f7b-912e-1cfb6c285e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e4e6aedaf0b42ddaf2a9b58fab19178'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:51.904530 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1022/2028] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:51 2022] DELETE /identity/v3/users/3e4e6aedaf0b42ddaf2a9b58fab19178 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:51.909628 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb679ca1-8b03-4730-aef2-21c07d0c658f None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:51.910023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb679ca1-8b03-4730-aef2-21c07d0c658f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:51.910405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb679ca1-8b03-4730-aef2-21c07d0c658f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:51.914510 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1007/2029] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:51 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:49:51.918112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd98af-a88c-4f1e-9e71-8eeee2fa93dc admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:51.920098 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ebdd98af-a88c-4f1e-9e71-8eeee2fa93dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:51.928407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-fb679ca1-8b03-4730-aef2-21c07d0c658f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:51.929731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-fb679ca1-8b03-4730-aef2-21c07d0c658f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:51.933641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd98af-a88c-4f1e-9e71-8eeee2fa93dc admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:51.997821 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1023/2030] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:52.000273 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c57e5-616a-4c68-95ee-fb73813a0f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:52.000986 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c57e5-616a-4c68-95ee-fb73813a0f5e admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.001509 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c57e5-616a-4c68-95ee-fb73813a0f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.001509 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c57e5-616a-4c68-95ee-fb73813a0f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.002399 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c57e5-616a-4c68-95ee-fb73813a0f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:52.004260 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c57e5-616a-4c68-95ee-fb73813a0f5e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:52.007305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb679ca1-8b03-4730-aef2-21c07d0c658f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:52.009099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-fb679ca1-8b03-4730-aef2-21c07d0c658f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:52.018797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1008/2031] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:52.020849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c57e5-616a-4c68-95ee-fb73813a0f5e admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:52.032332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c57e5-616a-4c68-95ee-fb73813a0f5e admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:52.032829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:52.037945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee06404-5259-4e2e-a41d-751a3e30a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:52.038616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee06404-5259-4e2e-a41d-751a3e30a9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.038940 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee06404-5259-4e2e-a41d-751a3e30a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.039250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee06404-5259-4e2e-a41d-751a3e30a9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.040017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee06404-5259-4e2e-a41d-751a3e30a9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:52.041788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee06404-5259-4e2e-a41d-751a3e30a9f0 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:52.055254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1009/2032] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:52.056748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee06404-5259-4e2e-a41d-751a3e30a9f0 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:52.066408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee06404-5259-4e2e-a41d-751a3e30a9f0 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:52.070152 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb679ca1-8b03-4730-aef2-21c07d0c658f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:52.070990 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d89486-08a7-43d2-b2cc-0e76e6761791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:52.071881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d89486-08a7-43d2-b2cc-0e76e6761791 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.072162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d89486-08a7-43d2-b2cc-0e76e6761791 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.072670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d89486-08a7-43d2-b2cc-0e76e6761791 admin admin] PATH_INFO: `/v3/projects/dcdab65397e14ff2831618242b93e2e3/users/ea27508716d9402a9a3cb9ce39168b83/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.074018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6ec86-d5d2-42a9-9b97-ac2e24e6b0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:52.074712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6ec86-d5d2-42a9-9b97-ac2e24e6b0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.075028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6ec86-d5d2-42a9-9b97-ac2e24e6b0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.075303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6ec86-d5d2-42a9-9b97-ac2e24e6b0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.084756 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6ec86-d5d2-42a9-9b97-ac2e24e6b0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:52.086196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6ec86-d5d2-42a9-9b97-ac2e24e6b0b4 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:52.087670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d89486-08a7-43d2-b2cc-0e76e6761791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcdab65397e14ff2831618242b93e2e3, user_id=ea27508716d9402a9a3cb9ce39168b83, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:52.090711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d89486-08a7-43d2-b2cc-0e76e6761791 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:52.096452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1024/2033] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:49:52.105323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1010/2034] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:52 2022] PUT /identity/v3/projects/dcdab65397e14ff2831618242b93e2e3/users/ea27508716d9402a9a3cb9ce39168b83/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:52.115707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a7fcf-b5c5-4c6d-9cf7-0848074a91d1 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.115996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a7fcf-b5c5-4c6d-9cf7-0848074a91d1 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.116286 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a7fcf-b5c5-4c6d-9cf7-0848074a91d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.142881 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-926a7fcf-b5c5-4c6d-9cf7-0848074a91d1 None None] MFA Rules not processed for user `ea27508716d9402a9a3cb9ce39168b83`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:52.144112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-926a7fcf-b5c5-4c6d-9cf7-0848074a91d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:52.214406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1025/2035] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:52.218875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d89486-08a7-43d2-b2cc-0e76e6761791 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:52.302576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d89486-08a7-43d2-b2cc-0e76e6761791 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:52.307333 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970731f-17dc-46c5-a7b4-bbe4fb445791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:52.308008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970731f-17dc-46c5-a7b4-bbe4fb445791 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.308282 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970731f-17dc-46c5-a7b4-bbe4fb445791 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.308558 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970731f-17dc-46c5-a7b4-bbe4fb445791 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.309264 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970731f-17dc-46c5-a7b4-bbe4fb445791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:52.311205 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970731f-17dc-46c5-a7b4-bbe4fb445791 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:52.320547 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de5ea7-ea7c-4f47-a464-b50958f55042 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.321167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de5ea7-ea7c-4f47-a464-b50958f55042 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.321599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de5ea7-ea7c-4f47-a464-b50958f55042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.343212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-b7de5ea7-ea7c-4f47-a464-b50958f55042 None None] MFA Rules not processed for user `9cc3d33007a04c4888755d8af1ba5cad`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:52.344412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b7de5ea7-ea7c-4f47-a464-b50958f55042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:52.344864 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1011/2036] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:52 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:49:52.348634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970731f-17dc-46c5-a7b4-bbe4fb445791 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:52.391981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:52.419341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1026/2037] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:52.421317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de5ea7-ea7c-4f47-a464-b50958f55042 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:52.422728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b7de5ea7-ea7c-4f47-a464-b50958f55042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:52.433762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970731f-17dc-46c5-a7b4-bbe4fb445791 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:52.438752 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdb0ce-9561-490f-8236-ac87784dd199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:52.439512 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdb0ce-9561-490f-8236-ac87784dd199 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.439800 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdb0ce-9561-490f-8236-ac87784dd199 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.440077 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdb0ce-9561-490f-8236-ac87784dd199 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.440785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdb0ce-9561-490f-8236-ac87784dd199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:52.442812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdb0ce-9561-490f-8236-ac87784dd199 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:52.464612 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de5ea7-ea7c-4f47-a464-b50958f55042 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:52.469382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1012/2038] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:52 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:52.472980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:52.473153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdb0ce-9561-490f-8236-ac87784dd199 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:52.473846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.474129 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.474409 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] PATH_INFO: `/v3/projects/d4abc08ffb2d4807bbc2a09766a2850f` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.475666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4abc08ffb2d4807bbc2a09766a2850f)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:52.477585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:52.487189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdb0ce-9561-490f-8236-ac87784dd199 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:52.493666 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e8bda-31f2-4626-9264-56749c04eb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:52.494413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e8bda-31f2-4626-9264-56749c04eb16 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.494792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e8bda-31f2-4626-9264-56749c04eb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.495011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e8bda-31f2-4626-9264-56749c04eb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.495918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e8bda-31f2-4626-9264-56749c04eb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:52.500161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e8bda-31f2-4626-9264-56749c04eb16 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:52.512599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1013/2039] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:49:52.518801 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e8bda-31f2-4626-9264-56749c04eb16 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:52.529915 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e8bda-31f2-4626-9264-56749c04eb16 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:52.542268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4abc08ffb2d4807bbc2a09766a2850f', 'request_id': 'req-d27da49b-9181-4dc6-804e-9c84fd4344fd'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:52.550230 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:52.561057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4abc08ffb2d4807bbc2a09766a2850f', 'request_id': 'req-d27da49b-9181-4dc6-804e-9c84fd4344fd'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:52.571172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4abc08ffb2d4807bbc2a09766a2850f', 'request_id': 'req-d27da49b-9181-4dc6-804e-9c84fd4344fd'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:52.587015 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] The token cache is being invalidate because project d4abc08ffb2d4807bbc2a09766a2850f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:52.587443 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:52.588444 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:52.590804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1027/2040] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:52 2022] DELETE /identity/v3/projects/d4abc08ffb2d4807bbc2a09766a2850f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:52.594082 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:52.595865 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:52.626293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d783970-dea2-4748-9be0-66940b04e463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:52.627640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d783970-dea2-4748-9be0-66940b04e463 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.628595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d783970-dea2-4748-9be0-66940b04e463 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.629017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d783970-dea2-4748-9be0-66940b04e463 admin admin] PATH_INFO: `/v3/projects/699a0e39615642f098db4ba1ac418814/users/c8b81050be5949a79b2185f6481c473c/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.648926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d783970-dea2-4748-9be0-66940b04e463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699a0e39615642f098db4ba1ac418814, user_id=c8b81050be5949a79b2185f6481c473c, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:52.653545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d783970-dea2-4748-9be0-66940b04e463 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:52.671830 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27da49b-9181-4dc6-804e-9c84fd4344fd admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:52.682730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1014/2041] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:52 2022] PUT /identity/v3/projects/699a0e39615642f098db4ba1ac418814/users/c8b81050be5949a79b2185f6481c473c/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:52.691758 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d783970-dea2-4748-9be0-66940b04e463 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:52.693603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7d783970-dea2-4748-9be0-66940b04e463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:52.771029 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606dae2-2ab4-4ea4-80e8-92b1f2e92e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:52.771927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606dae2-2ab4-4ea4-80e8-92b1f2e92e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.772209 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606dae2-2ab4-4ea4-80e8-92b1f2e92e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.772484 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606dae2-2ab4-4ea4-80e8-92b1f2e92e1b admin admin] PATH_INFO: `/v3/users/a34d6990ba7840a7a472d4cf7877eb17` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.774363 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606dae2-2ab4-4ea4-80e8-92b1f2e92e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34d6990ba7840a7a472d4cf7877eb17)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:52.777706 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606dae2-2ab4-4ea4-80e8-92b1f2e92e1b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:52.779819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d783970-dea2-4748-9be0-66940b04e463 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:52.785624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c16da-8974-4243-a3b5-0afa49358f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:52.786420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c16da-8974-4243-a3b5-0afa49358f3b admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.786798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c16da-8974-4243-a3b5-0afa49358f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.787144 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c16da-8974-4243-a3b5-0afa49358f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.787959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c16da-8974-4243-a3b5-0afa49358f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:52.789661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c16da-8974-4243-a3b5-0afa49358f3b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:52.801546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1015/2042] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:52.812184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c16da-8974-4243-a3b5-0afa49358f3b admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:52.824630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c16da-8974-4243-a3b5-0afa49358f3b admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:52.832125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659699f-42e3-4b52-9ce8-45066a745ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:52.833089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659699f-42e3-4b52-9ce8-45066a745ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.833378 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659699f-42e3-4b52-9ce8-45066a745ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.833658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659699f-42e3-4b52-9ce8-45066a745ab3 admin admin] PATH_INFO: `/v3/projects/699a0e39615642f098db4ba1ac418814/users/c8b81050be5949a79b2185f6481c473c/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.835826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659699f-42e3-4b52-9ce8-45066a745ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699a0e39615642f098db4ba1ac418814, user_id=c8b81050be5949a79b2185f6481c473c, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:52.839625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659699f-42e3-4b52-9ce8-45066a745ab3 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:52.853186 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6606dae2-2ab4-4ea4-80e8-92b1f2e92e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34d6990ba7840a7a472d4cf7877eb17'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:52.858198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1016/2043] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:52 2022] PUT /identity/v3/projects/699a0e39615642f098db4ba1ac418814/users/c8b81050be5949a79b2185f6481c473c/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:52.869225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4699fd6-2b68-460d-ad33-c257ae588e13 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:52.869678 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4699fd6-2b68-460d-ad33-c257ae588e13 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:52.870058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4699fd6-2b68-460d-ad33-c257ae588e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:52.872524 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6606dae2-2ab4-4ea4-80e8-92b1f2e92e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34d6990ba7840a7a472d4cf7877eb17'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:52.873459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6606dae2-2ab4-4ea4-80e8-92b1f2e92e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34d6990ba7840a7a472d4cf7877eb17'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:52.887612 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6606dae2-2ab4-4ea4-80e8-92b1f2e92e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34d6990ba7840a7a472d4cf7877eb17'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:52.889249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6606dae2-2ab4-4ea4-80e8-92b1f2e92e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34d6990ba7840a7a472d4cf7877eb17'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:52.908288 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-d4699fd6-2b68-460d-ad33-c257ae588e13 None None] MFA Rules not processed for user `c8b81050be5949a79b2185f6481c473c`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:52.909349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d4699fd6-2b68-460d-ad33-c257ae588e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:52.911542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1028/2044] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:52 2022] DELETE /identity/v3/users/a34d6990ba7840a7a472d4cf7877eb17 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:52.914420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:52.999528 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1017/2045] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:53.011105 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606dae2-2ab4-4ea4-80e8-92b1f2e92e1b admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:53.012673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6606dae2-2ab4-4ea4-80e8-92b1f2e92e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:53.023977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:53.096424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606dae2-2ab4-4ea4-80e8-92b1f2e92e1b admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:53.101362 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac2944-4f96-474a-b897-7ebd5c41f2a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:53.102041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac2944-4f96-474a-b897-7ebd5c41f2a9 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:53.102327 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac2944-4f96-474a-b897-7ebd5c41f2a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:53.102602 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac2944-4f96-474a-b897-7ebd5c41f2a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:53.126593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac2944-4f96-474a-b897-7ebd5c41f2a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:53.130269 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac2944-4f96-474a-b897-7ebd5c41f2a9 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:53.160697 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1029/2046] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:53.851601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4699fd6-2b68-460d-ad33-c257ae588e13 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:53.856068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d4699fd6-2b68-460d-ad33-c257ae588e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:53.964211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4699fd6-2b68-460d-ad33-c257ae588e13 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:53.985230 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bce27-1c4e-4be8-be0b-694e03ce646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:53.986377 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bce27-1c4e-4be8-be0b-694e03ce646a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:53.987375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bce27-1c4e-4be8-be0b-694e03ce646a admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:53.988574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac2944-4f96-474a-b897-7ebd5c41f2a9 service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:53.990499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-67ac2944-4f96-474a-b897-7ebd5c41f2a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:53.994106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bce27-1c4e-4be8-be0b-694e03ce646a admin admin] PATH_INFO: `/v3/projects/537f4108a20e45a1955dbf611ebf1626` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:53.996157 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1bce27-1c4e-4be8-be0b-694e03ce646a admin admin] RBAC: Authorizing `identity:delete_project(project_id=537f4108a20e45a1955dbf611ebf1626)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:54.003821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1bce27-1c4e-4be8-be0b-694e03ce646a admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:54.008598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac2944-4f96-474a-b897-7ebd5c41f2a9 service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:54.020326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626f728-b687-417d-8d5d-c0f340c8799c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:54.021309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626f728-b687-417d-8d5d-c0f340c8799c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:54.021872 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626f728-b687-417d-8d5d-c0f340c8799c admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:54.022158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626f728-b687-417d-8d5d-c0f340c8799c admin admin] PATH_INFO: `/v3/users/ea27508716d9402a9a3cb9ce39168b83` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:54.024479 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626f728-b687-417d-8d5d-c0f340c8799c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea27508716d9402a9a3cb9ce39168b83)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:54.026996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626f728-b687-417d-8d5d-c0f340c8799c admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:54.074519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cb1bce27-1c4e-4be8-be0b-694e03ce646a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537f4108a20e45a1955dbf611ebf1626', 'request_id': 'req-cb1bce27-1c4e-4be8-be0b-694e03ce646a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:54.085843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cb1bce27-1c4e-4be8-be0b-694e03ce646a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537f4108a20e45a1955dbf611ebf1626', 'request_id': 'req-cb1bce27-1c4e-4be8-be0b-694e03ce646a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:54.090621 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7626f728-b687-417d-8d5d-c0f340c8799c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea27508716d9402a9a3cb9ce39168b83'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:54.094975 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cb1bce27-1c4e-4be8-be0b-694e03ce646a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537f4108a20e45a1955dbf611ebf1626', 'request_id': 'req-cb1bce27-1c4e-4be8-be0b-694e03ce646a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:54.105079 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7626f728-b687-417d-8d5d-c0f340c8799c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea27508716d9402a9a3cb9ce39168b83'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:54.105898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7626f728-b687-417d-8d5d-c0f340c8799c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea27508716d9402a9a3cb9ce39168b83'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:54.113183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cb1bce27-1c4e-4be8-be0b-694e03ce646a admin admin] The token cache is being invalidate because project 537f4108a20e45a1955dbf611ebf1626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:54.113538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7626f728-b687-417d-8d5d-c0f340c8799c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea27508716d9402a9a3cb9ce39168b83'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:54.113641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cb1bce27-1c4e-4be8-be0b-694e03ce646a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:54.114293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7626f728-b687-417d-8d5d-c0f340c8799c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea27508716d9402a9a3cb9ce39168b83'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:54.114394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cb1bce27-1c4e-4be8-be0b-694e03ce646a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:54.116974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1018/2047] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:53 2022] DELETE /identity/v3/projects/537f4108a20e45a1955dbf611ebf1626 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:54.141217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1030/2048] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:53 2022] DELETE /identity/v3/users/ea27508716d9402a9a3cb9ce39168b83 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:54.145648 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2096d81-744b-4fe3-92bb-a8b80f986ffe None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:54.146354 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2096d81-744b-4fe3-92bb-a8b80f986ffe None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:54.146644 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2096d81-744b-4fe3-92bb-a8b80f986ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:54.168485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-a2096d81-744b-4fe3-92bb-a8b80f986ffe None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:54.169615 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a2096d81-744b-4fe3-92bb-a8b80f986ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:54.203884 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:54.254147 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1019/2049] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:54.261121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626f728-b687-417d-8d5d-c0f340c8799c admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:54.263459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-7626f728-b687-417d-8d5d-c0f340c8799c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:54.375657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626f728-b687-417d-8d5d-c0f340c8799c admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:54.381411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c44a9-02c7-48be-b7a1-9a25ee44f33b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:54.382170 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c44a9-02c7-48be-b7a1-9a25ee44f33b service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:54.382457 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c44a9-02c7-48be-b7a1-9a25ee44f33b service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:54.382846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c44a9-02c7-48be-b7a1-9a25ee44f33b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:54.404332 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c44a9-02c7-48be-b7a1-9a25ee44f33b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:54.406953 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c44a9-02c7-48be-b7a1-9a25ee44f33b service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:54.427536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1031/2050] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:55.098609 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2096d81-744b-4fe3-92bb-a8b80f986ffe None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:55.100107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a2096d81-744b-4fe3-92bb-a8b80f986ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:55.112499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2096d81-744b-4fe3-92bb-a8b80f986ffe None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:55.117206 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:55.118500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:55.119030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:55.119568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] PATH_INFO: `/v3/projects/dcdab65397e14ff2831618242b93e2e3` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:55.121099 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcdab65397e14ff2831618242b93e2e3)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:55.123332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:55.194698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcdab65397e14ff2831618242b93e2e3', 'request_id': 'req-23fb23f2-abcc-4624-965e-c94f5864d8ad'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:55.208679 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcdab65397e14ff2831618242b93e2e3', 'request_id': 'req-23fb23f2-abcc-4624-965e-c94f5864d8ad'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:55.227149 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcdab65397e14ff2831618242b93e2e3', 'request_id': 'req-23fb23f2-abcc-4624-965e-c94f5864d8ad'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:55.256059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] The token cache is being invalidate because project dcdab65397e14ff2831618242b93e2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:55.256342 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:55.256988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:55.259353 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1020/2051] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:55 2022] DELETE /identity/v3/projects/dcdab65397e14ff2831618242b93e2e3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:55.262788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c44a9-02c7-48be-b7a1-9a25ee44f33b service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:55.274404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c44a9-02c7-48be-b7a1-9a25ee44f33b service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:55.309814 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:55.384586 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c335f45-275f-4f27-9157-2fb394e99fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:55.386014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c335f45-275f-4f27-9157-2fb394e99fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:55.386203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c335f45-275f-4f27-9157-2fb394e99fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:55.386454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c335f45-275f-4f27-9157-2fb394e99fa9 admin admin] PATH_INFO: `/v3/users/c8b81050be5949a79b2185f6481c473c` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:55.389064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c335f45-275f-4f27-9157-2fb394e99fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b81050be5949a79b2185f6481c473c)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:55.391708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c335f45-275f-4f27-9157-2fb394e99fa9 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:55.460293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5c335f45-275f-4f27-9157-2fb394e99fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b81050be5949a79b2185f6481c473c'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:55.477553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5c335f45-275f-4f27-9157-2fb394e99fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b81050be5949a79b2185f6481c473c'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:55.478644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5c335f45-275f-4f27-9157-2fb394e99fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b81050be5949a79b2185f6481c473c'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:55.488591 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5c335f45-275f-4f27-9157-2fb394e99fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b81050be5949a79b2185f6481c473c'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:55.489623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5c335f45-275f-4f27-9157-2fb394e99fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b81050be5949a79b2185f6481c473c'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:55.513433 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1032/2052] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:55 2022] DELETE /identity/v3/users/c8b81050be5949a79b2185f6481c473c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:56.248130 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:56.249824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:56.294394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb23f2-abcc-4624-965e-c94f5864d8ad admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:56.403461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a5007-019b-4f23-936c-508dc829b057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:56.404456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a5007-019b-4f23-936c-508dc829b057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:56.404836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a5007-019b-4f23-936c-508dc829b057 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:56.405153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a5007-019b-4f23-936c-508dc829b057 admin admin] PATH_INFO: `/v3/projects/699a0e39615642f098db4ba1ac418814` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:56.406913 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a5007-019b-4f23-936c-508dc829b057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=699a0e39615642f098db4ba1ac418814)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:56.409444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a5007-019b-4f23-936c-508dc829b057 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:56.478283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-189a5007-019b-4f23-936c-508dc829b057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699a0e39615642f098db4ba1ac418814', 'request_id': 'req-189a5007-019b-4f23-936c-508dc829b057'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:56.489189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-189a5007-019b-4f23-936c-508dc829b057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699a0e39615642f098db4ba1ac418814', 'request_id': 'req-189a5007-019b-4f23-936c-508dc829b057'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:56.490792 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:56.501618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-189a5007-019b-4f23-936c-508dc829b057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699a0e39615642f098db4ba1ac418814', 'request_id': 'req-189a5007-019b-4f23-936c-508dc829b057'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:56.514611 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-189a5007-019b-4f23-936c-508dc829b057 admin admin] The token cache is being invalidate because project 699a0e39615642f098db4ba1ac418814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:56.515004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-189a5007-019b-4f23-936c-508dc829b057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:56.515767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-189a5007-019b-4f23-936c-508dc829b057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:56.518690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1021/2053] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:56 2022] DELETE /identity/v3/projects/699a0e39615642f098db4ba1ac418814 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:56.523701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c90d25-b848-4fb9-bd2b-92fecaa9e39e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:56.524217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c90d25-b848-4fb9-bd2b-92fecaa9e39e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:56.524548 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c90d25-b848-4fb9-bd2b-92fecaa9e39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:56.545130 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-69c90d25-b848-4fb9-bd2b-92fecaa9e39e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:56.546359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-69c90d25-b848-4fb9-bd2b-92fecaa9e39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:56.672183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1033/2054] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:56.681221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426929ae-2e02-414b-98de-71fb127b1ebe None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:56.681732 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426929ae-2e02-414b-98de-71fb127b1ebe None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:56.681918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426929ae-2e02-414b-98de-71fb127b1ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:56.705516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-426929ae-2e02-414b-98de-71fb127b1ebe None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:56.706816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-426929ae-2e02-414b-98de-71fb127b1ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:56.715537 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1022/2055] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:56.720307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c90d25-b848-4fb9-bd2b-92fecaa9e39e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:56.738247 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c90d25-b848-4fb9-bd2b-92fecaa9e39e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:56.751382 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71a4f6-4131-44ab-ad56-25cdc04dbbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:56.752078 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71a4f6-4131-44ab-ad56-25cdc04dbbfe admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:56.752362 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71a4f6-4131-44ab-ad56-25cdc04dbbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:56.752670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71a4f6-4131-44ab-ad56-25cdc04dbbfe admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:56.753426 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71a4f6-4131-44ab-ad56-25cdc04dbbfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:56.753742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71a4f6-4131-44ab-ad56-25cdc04dbbfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:56.755561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71a4f6-4131-44ab-ad56-25cdc04dbbfe admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:56.785885 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1034/2056] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:56.789922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426929ae-2e02-414b-98de-71fb127b1ebe None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:56.807831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426929ae-2e02-414b-98de-71fb127b1ebe None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:56.815330 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911dbfa8-ada9-48e4-bdd1-d08b6696da33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:56.816186 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dbfa8-ada9-48e4-bdd1-d08b6696da33 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:56.816868 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dbfa8-ada9-48e4-bdd1-d08b6696da33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:56.817311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dbfa8-ada9-48e4-bdd1-d08b6696da33 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:56.818133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911dbfa8-ada9-48e4-bdd1-d08b6696da33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:56.821365 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911dbfa8-ada9-48e4-bdd1-d08b6696da33 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:56.869920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1023/2057] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:56 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:49:56.874334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71a4f6-4131-44ab-ad56-25cdc04dbbfe admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:56.890663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71a4f6-4131-44ab-ad56-25cdc04dbbfe admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:56.936255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:56.984937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47716c-ae99-4a7e-a7c6-5fa45cf4cbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:56.985641 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47716c-ae99-4a7e-a7c6-5fa45cf4cbff admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:56.985923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47716c-ae99-4a7e-a7c6-5fa45cf4cbff admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:56.986315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47716c-ae99-4a7e-a7c6-5fa45cf4cbff admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:56.987376 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47716c-ae99-4a7e-a7c6-5fa45cf4cbff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:56.989208 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47716c-ae99-4a7e-a7c6-5fa45cf4cbff admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:57.024468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1035/2058] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:56 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:57.029891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911dbfa8-ada9-48e4-bdd1-d08b6696da33 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:57.043667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911dbfa8-ada9-48e4-bdd1-d08b6696da33 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:57.049857 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3ceeb-53d7-4220-af9d-02d058467163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:57.051421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3ceeb-53d7-4220-af9d-02d058467163 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:57.051754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3ceeb-53d7-4220-af9d-02d058467163 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:57.052017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3ceeb-53d7-4220-af9d-02d058467163 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:57.052784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3ceeb-53d7-4220-af9d-02d058467163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:57.055111 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3ceeb-53d7-4220-af9d-02d058467163 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:57.073799 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1024/2059] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:57.075039 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47716c-ae99-4a7e-a7c6-5fa45cf4cbff admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:57.101481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47716c-ae99-4a7e-a7c6-5fa45cf4cbff admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:57.107543 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27505a88-0712-4861-8cf5-a5e402c7b204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:57.109108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27505a88-0712-4861-8cf5-a5e402c7b204 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:57.109395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27505a88-0712-4861-8cf5-a5e402c7b204 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:57.109818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27505a88-0712-4861-8cf5-a5e402c7b204 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:57.110569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27505a88-0712-4861-8cf5-a5e402c7b204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:57.112245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27505a88-0712-4861-8cf5-a5e402c7b204 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:57.136063 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1036/2060] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:49:57.137662 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3ceeb-53d7-4220-af9d-02d058467163 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:57.153031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3ceeb-53d7-4220-af9d-02d058467163 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:57.169640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454db52-6376-4f31-b1c3-2cfd0edfb7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:57.170929 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454db52-6376-4f31-b1c3-2cfd0edfb7f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:57.171285 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454db52-6376-4f31-b1c3-2cfd0edfb7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:57.171631 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454db52-6376-4f31-b1c3-2cfd0edfb7f1 admin admin] PATH_INFO: `/v3/projects/e3e17133459e4d3e982487dc254b3f17/users/c2c2d8aeb2b9466c99229021e0d3d200/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:57.219593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454db52-6376-4f31-b1c3-2cfd0edfb7f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e17133459e4d3e982487dc254b3f17, user_id=c2c2d8aeb2b9466c99229021e0d3d200, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:57.222599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454db52-6376-4f31-b1c3-2cfd0edfb7f1 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:57.274199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1025/2061] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:57 2022] PUT /identity/v3/projects/e3e17133459e4d3e982487dc254b3f17/users/c2c2d8aeb2b9466c99229021e0d3d200/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:57.284536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fff6-04ea-4e73-922a-39246d58471b None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:57.285061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fff6-04ea-4e73-922a-39246d58471b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:57.285507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fff6-04ea-4e73-922a-39246d58471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:57.351681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-b333fff6-04ea-4e73-922a-39246d58471b None None] MFA Rules not processed for user `c2c2d8aeb2b9466c99229021e0d3d200`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:57.354301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b333fff6-04ea-4e73-922a-39246d58471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:57.526006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1037/2062] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:57.532980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454db52-6376-4f31-b1c3-2cfd0edfb7f1 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:57.640098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333fff6-04ea-4e73-922a-39246d58471b None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:57.641684 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b333fff6-04ea-4e73-922a-39246d58471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:57.656100 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454db52-6376-4f31-b1c3-2cfd0edfb7f1 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:57.665740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333fff6-04ea-4e73-922a-39246d58471b None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:57.671894 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3178a4-8808-4891-89c2-aa7959cd2c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:57.672593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3178a4-8808-4891-89c2-aa7959cd2c10 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:57.672878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3178a4-8808-4891-89c2-aa7959cd2c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:57.673197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3178a4-8808-4891-89c2-aa7959cd2c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:57.673908 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3178a4-8808-4891-89c2-aa7959cd2c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:57.676923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3178a4-8808-4891-89c2-aa7959cd2c10 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:57.681039 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d6308-f35c-4a4d-a327-3ff32a3aa21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:57.682180 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d6308-f35c-4a4d-a327-3ff32a3aa21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:57.682509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d6308-f35c-4a4d-a327-3ff32a3aa21c admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:57.682819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d6308-f35c-4a4d-a327-3ff32a3aa21c admin admin] PATH_INFO: `/v3/users/825dd3922747496b88f0718b069abc1f` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:57.684565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d6308-f35c-4a4d-a327-3ff32a3aa21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=825dd3922747496b88f0718b069abc1f)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:57.686505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d6308-f35c-4a4d-a327-3ff32a3aa21c admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:57.730318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1026/2063] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:57 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:57.736144 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3178a4-8808-4891-89c2-aa7959cd2c10 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:57.762641 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-dd3d6308-f35c-4a4d-a327-3ff32a3aa21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825dd3922747496b88f0718b069abc1f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:57.777556 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-dd3d6308-f35c-4a4d-a327-3ff32a3aa21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825dd3922747496b88f0718b069abc1f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:57.778301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-dd3d6308-f35c-4a4d-a327-3ff32a3aa21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825dd3922747496b88f0718b069abc1f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:57.785283 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-dd3d6308-f35c-4a4d-a327-3ff32a3aa21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825dd3922747496b88f0718b069abc1f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:57.785951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-dd3d6308-f35c-4a4d-a327-3ff32a3aa21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825dd3922747496b88f0718b069abc1f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:57.803792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1038/2064] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:57 2022] DELETE /identity/v3/users/825dd3922747496b88f0718b069abc1f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:57.813283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3178a4-8808-4891-89c2-aa7959cd2c10 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:57.823258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:57.887301 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6197769-0371-42a8-a911-ed92d9e3c31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:57.888037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6197769-0371-42a8-a911-ed92d9e3c31f admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:57.888317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6197769-0371-42a8-a911-ed92d9e3c31f admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:57.888587 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6197769-0371-42a8-a911-ed92d9e3c31f admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:57.889283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6197769-0371-42a8-a911-ed92d9e3c31f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:57.891418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6197769-0371-42a8-a911-ed92d9e3c31f admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:57.912809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1027/2065] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:57 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:57.916849 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d6308-f35c-4a4d-a327-3ff32a3aa21c admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:57.918872 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-dd3d6308-f35c-4a4d-a327-3ff32a3aa21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:57.932809 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d6308-f35c-4a4d-a327-3ff32a3aa21c admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:57.941730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bdf17-7cc0-4582-bd40-2a307b5231ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:57.942393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bdf17-7cc0-4582-bd40-2a307b5231ec admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:57.942675 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bdf17-7cc0-4582-bd40-2a307b5231ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:57.943014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bdf17-7cc0-4582-bd40-2a307b5231ec admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:57.943806 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bdf17-7cc0-4582-bd40-2a307b5231ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:57.945443 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bdf17-7cc0-4582-bd40-2a307b5231ec admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:57.952240 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:57.959091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1039/2066] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:57.962647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6197769-0371-42a8-a911-ed92d9e3c31f admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:57.973962 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6197769-0371-42a8-a911-ed92d9e3c31f admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:57.979210 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5426c0-c6a9-44ec-85ab-748b71f053f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:57.980127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5426c0-c6a9-44ec-85ab-748b71f053f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:57.980401 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5426c0-c6a9-44ec-85ab-748b71f053f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:57.980725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5426c0-c6a9-44ec-85ab-748b71f053f8 admin admin] PATH_INFO: `/v3/projects/6f33e715bfd44919bcc0ecc3eaa54578/users/0a99b2730bc74230b906f6aaa7992232/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:57.995147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bdf17-7cc0-4582-bd40-2a307b5231ec admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:57.997024 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-337bdf17-7cc0-4582-bd40-2a307b5231ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:57.997379 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5426c0-c6a9-44ec-85ab-748b71f053f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f33e715bfd44919bcc0ecc3eaa54578, user_id=0a99b2730bc74230b906f6aaa7992232, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:58.000472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5426c0-c6a9-44ec-85ab-748b71f053f8 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:58.015523 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bdf17-7cc0-4582-bd40-2a307b5231ec admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:58.022697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1028/2067] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:57 2022] PUT /identity/v3/projects/6f33e715bfd44919bcc0ecc3eaa54578/users/0a99b2730bc74230b906f6aaa7992232/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:58.023938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5426c0-c6a9-44ec-85ab-748b71f053f8 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:58.076351 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5d37d-7c89-4610-aef0-49a4fa75ba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:58.077340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d37d-7c89-4610-aef0-49a4fa75ba26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.077628 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d37d-7c89-4610-aef0-49a4fa75ba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.077906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d37d-7c89-4610-aef0-49a4fa75ba26 admin admin] PATH_INFO: `/v3/projects/659789a2da584fbda97cb9de335946b7` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.079131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5d37d-7c89-4610-aef0-49a4fa75ba26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=659789a2da584fbda97cb9de335946b7)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:58.081095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5d37d-7c89-4610-aef0-49a4fa75ba26 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:58.091948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5426c0-c6a9-44ec-85ab-748b71f053f8 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:58.096568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad156ab-7102-4752-9b3b-1e586b39d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:58.097239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad156ab-7102-4752-9b3b-1e586b39d273 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.097601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad156ab-7102-4752-9b3b-1e586b39d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.097789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad156ab-7102-4752-9b3b-1e586b39d273 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.098620 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad156ab-7102-4752-9b3b-1e586b39d273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:58.100195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad156ab-7102-4752-9b3b-1e586b39d273 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:58.110541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1029/2068] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:49:58.114746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad156ab-7102-4752-9b3b-1e586b39d273 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:58.124502 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad156ab-7102-4752-9b3b-1e586b39d273 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:58.129216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-fae5d37d-7c89-4610-aef0-49a4fa75ba26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659789a2da584fbda97cb9de335946b7', 'request_id': 'req-fae5d37d-7c89-4610-aef0-49a4fa75ba26'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:58.138095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-fae5d37d-7c89-4610-aef0-49a4fa75ba26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659789a2da584fbda97cb9de335946b7', 'request_id': 'req-fae5d37d-7c89-4610-aef0-49a4fa75ba26'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:58.145368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-fae5d37d-7c89-4610-aef0-49a4fa75ba26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659789a2da584fbda97cb9de335946b7', 'request_id': 'req-fae5d37d-7c89-4610-aef0-49a4fa75ba26'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:58.156019 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-fae5d37d-7c89-4610-aef0-49a4fa75ba26 admin admin] The token cache is being invalidate because project 659789a2da584fbda97cb9de335946b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:58.156306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-fae5d37d-7c89-4610-aef0-49a4fa75ba26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:58.156964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-fae5d37d-7c89-4610-aef0-49a4fa75ba26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:58.158749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1040/2069] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:57 2022] DELETE /identity/v3/projects/659789a2da584fbda97cb9de335946b7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:58.163530 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e53b8c-a736-4c6a-9133-1e76e9cc1487 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.163816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e53b8c-a736-4c6a-9133-1e76e9cc1487 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.164093 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e53b8c-a736-4c6a-9133-1e76e9cc1487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.182305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-90e53b8c-a736-4c6a-9133-1e76e9cc1487 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:58.182486 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dd115-f06f-4f23-b28f-4e34d9f37259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:58.183306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dd115-f06f-4f23-b28f-4e34d9f37259 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.183519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-90e53b8c-a736-4c6a-9133-1e76e9cc1487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:58.183622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dd115-f06f-4f23-b28f-4e34d9f37259 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.183853 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dd115-f06f-4f23-b28f-4e34d9f37259 admin admin] PATH_INFO: `/v3/projects/6f33e715bfd44919bcc0ecc3eaa54578/users/0a99b2730bc74230b906f6aaa7992232/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.185908 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dd115-f06f-4f23-b28f-4e34d9f37259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f33e715bfd44919bcc0ecc3eaa54578, user_id=0a99b2730bc74230b906f6aaa7992232, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:58.188680 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dd115-f06f-4f23-b28f-4e34d9f37259 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:58.191452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1041/2070] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:58.208558 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1030/2071] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:58 2022] PUT /identity/v3/projects/6f33e715bfd44919bcc0ecc3eaa54578/users/0a99b2730bc74230b906f6aaa7992232/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:58.208969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea418b-7e75-4746-b63d-c5d225b0eb3b None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.208969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea418b-7e75-4746-b63d-c5d225b0eb3b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.208969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea418b-7e75-4746-b63d-c5d225b0eb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.211093 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06ffa1-6ab6-4da3-85ac-3b28b94f1099 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.211730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06ffa1-6ab6-4da3-85ac-3b28b94f1099 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.212006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06ffa1-6ab6-4da3-85ac-3b28b94f1099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.230552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-89ea418b-7e75-4746-b63d-c5d225b0eb3b None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:58.233356 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-89ea418b-7e75-4746-b63d-c5d225b0eb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:58.234136 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:58.245319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-3c06ffa1-6ab6-4da3-85ac-3b28b94f1099 None None] MFA Rules not processed for user `0a99b2730bc74230b906f6aaa7992232`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:58.246539 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3c06ffa1-6ab6-4da3-85ac-3b28b94f1099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:58.317182 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1042/2072] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:58.321559 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea418b-7e75-4746-b63d-c5d225b0eb3b None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:58.332345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea418b-7e75-4746-b63d-c5d225b0eb3b None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:58.334900 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1031/2073] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:49:58.337996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808f2cc-daae-424e-9451-4c9a03d73a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:58.338846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f2cc-daae-424e-9451-4c9a03d73a64 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.339105 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f2cc-daae-424e-9451-4c9a03d73a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.339380 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f2cc-daae-424e-9451-4c9a03d73a64 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.340178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808f2cc-daae-424e-9451-4c9a03d73a64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:49:58.340488 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808f2cc-daae-424e-9451-4c9a03d73a64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:58.342091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808f2cc-daae-424e-9451-4c9a03d73a64 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:58.346171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06ffa1-6ab6-4da3-85ac-3b28b94f1099 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:58.347604 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3c06ffa1-6ab6-4da3-85ac-3b28b94f1099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:58.358310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1043/2074] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:49:58.359273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808f2cc-daae-424e-9451-4c9a03d73a64 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:58.371145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808f2cc-daae-424e-9451-4c9a03d73a64 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:58.375797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77562835-824b-4473-98e9-3a4b38750e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:58.376457 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77562835-824b-4473-98e9-3a4b38750e94 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.376736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77562835-824b-4473-98e9-3a4b38750e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.377105 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77562835-824b-4473-98e9-3a4b38750e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.377797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77562835-824b-4473-98e9-3a4b38750e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:58.379728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77562835-824b-4473-98e9-3a4b38750e94 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:58.389004 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:58.409886 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06ffa1-6ab6-4da3-85ac-3b28b94f1099 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:58.410968 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1044/2075] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:49:58 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:49:58.415043 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77562835-824b-4473-98e9-3a4b38750e94 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:58.466451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32630b16-1bac-444f-af5a-9ab10294a914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:58.467136 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630b16-1bac-444f-af5a-9ab10294a914 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.467415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630b16-1bac-444f-af5a-9ab10294a914 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.467750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630b16-1bac-444f-af5a-9ab10294a914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.481416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77562835-824b-4473-98e9-3a4b38750e94 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:58.486254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cf05a-f744-4dd3-8aaa-8a2d385adb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:58.486973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cf05a-f744-4dd3-8aaa-8a2d385adb5f admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.487696 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cf05a-f744-4dd3-8aaa-8a2d385adb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.487985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cf05a-f744-4dd3-8aaa-8a2d385adb5f admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.488693 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cf05a-f744-4dd3-8aaa-8a2d385adb5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:58.491367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cf05a-f744-4dd3-8aaa-8a2d385adb5f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:58.513440 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1045/2076] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:49:58 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:49:58.517649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cf05a-f744-4dd3-8aaa-8a2d385adb5f admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:58.532609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cf05a-f744-4dd3-8aaa-8a2d385adb5f admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:58.534664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32630b16-1bac-444f-af5a-9ab10294a914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:58.536793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32630b16-1bac-444f-af5a-9ab10294a914 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:58.538242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf2bb2-60c5-41eb-b4a0-b469c8430055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:58.538976 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf2bb2-60c5-41eb-b4a0-b469c8430055 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.539311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf2bb2-60c5-41eb-b4a0-b469c8430055 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.539516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf2bb2-60c5-41eb-b4a0-b469c8430055 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.540251 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf2bb2-60c5-41eb-b4a0-b469c8430055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:58.541994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf2bb2-60c5-41eb-b4a0-b469c8430055 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:58.543808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:58.555375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1032/2077] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:49:58.557847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1046/2078] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:49:58.566074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32630b16-1bac-444f-af5a-9ab10294a914 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:58.577661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32630b16-1bac-444f-af5a-9ab10294a914 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:58.582791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db2f20-b607-4a01-8788-658366bc7df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:58.583835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2f20-b607-4a01-8788-658366bc7df3 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.584209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2f20-b607-4a01-8788-658366bc7df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.584491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2f20-b607-4a01-8788-658366bc7df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.585449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db2f20-b607-4a01-8788-658366bc7df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:58.587849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db2f20-b607-4a01-8788-658366bc7df3 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:58.603478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1033/2079] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:49:58.607838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf2bb2-60c5-41eb-b4a0-b469c8430055 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:58.622680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf2bb2-60c5-41eb-b4a0-b469c8430055 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:58.627895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674f62c-3e60-4bc6-b69b-176d1396cdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:58.630847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674f62c-3e60-4bc6-b69b-176d1396cdbb admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.630847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674f62c-3e60-4bc6-b69b-176d1396cdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.630847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674f62c-3e60-4bc6-b69b-176d1396cdbb admin admin] PATH_INFO: `/v3/projects/1adb3aff00e1452e969d782432a87539/users/7d8292542e8a4c429dd7575cbaccd157/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.647130 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674f62c-3e60-4bc6-b69b-176d1396cdbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1adb3aff00e1452e969d782432a87539, user_id=7d8292542e8a4c429dd7575cbaccd157, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:58.649874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674f62c-3e60-4bc6-b69b-176d1396cdbb admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:58.671219 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1047/2080] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:49:58 2022] PUT /identity/v3/projects/1adb3aff00e1452e969d782432a87539/users/7d8292542e8a4c429dd7575cbaccd157/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:49:58.679105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834119d9-60ed-403a-9841-686175d4c674 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.679414 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834119d9-60ed-403a-9841-686175d4c674 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.679692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834119d9-60ed-403a-9841-686175d4c674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.700903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-834119d9-60ed-403a-9841-686175d4c674 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:58.702136 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-834119d9-60ed-403a-9841-686175d4c674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:58.784264 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1034/2081] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:58.800428 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674f62c-3e60-4bc6-b69b-176d1396cdbb admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:58.800428 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3674f62c-3e60-4bc6-b69b-176d1396cdbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:58.894500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674f62c-3e60-4bc6-b69b-176d1396cdbb admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:58.899744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b150f52-466e-4772-8c74-df0597272c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:58.900580 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b150f52-466e-4772-8c74-df0597272c07 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:58.901054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b150f52-466e-4772-8c74-df0597272c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:58.901427 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b150f52-466e-4772-8c74-df0597272c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:58.918189 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b150f52-466e-4772-8c74-df0597272c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:58.920298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b150f52-466e-4772-8c74-df0597272c07 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:58.933155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1048/2082] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:58.992973 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834119d9-60ed-403a-9841-686175d4c674 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:58.994632 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-834119d9-60ed-403a-9841-686175d4c674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:59.006815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834119d9-60ed-403a-9841-686175d4c674 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:59.012333 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c632b49-7f8e-4328-abe1-9440476335cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:59.013299 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c632b49-7f8e-4328-abe1-9440476335cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:59.013545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c632b49-7f8e-4328-abe1-9440476335cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:59.013748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c632b49-7f8e-4328-abe1-9440476335cb admin admin] PATH_INFO: `/v3/users/c2c2d8aeb2b9466c99229021e0d3d200` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:59.015126 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c632b49-7f8e-4328-abe1-9440476335cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c2d8aeb2b9466c99229021e0d3d200)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:59.017119 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c632b49-7f8e-4328-abe1-9440476335cb admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:59.078195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8c632b49-7f8e-4328-abe1-9440476335cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c2d8aeb2b9466c99229021e0d3d200'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:59.118266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8c632b49-7f8e-4328-abe1-9440476335cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c2d8aeb2b9466c99229021e0d3d200'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:59.137789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8c632b49-7f8e-4328-abe1-9440476335cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c2d8aeb2b9466c99229021e0d3d200'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:59.138641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8c632b49-7f8e-4328-abe1-9440476335cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c2d8aeb2b9466c99229021e0d3d200'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:59.139570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8c632b49-7f8e-4328-abe1-9440476335cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c2d8aeb2b9466c99229021e0d3d200'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:59.164136 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1035/2083] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:58 2022] DELETE /identity/v3/users/c2c2d8aeb2b9466c99229021e0d3d200 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:59.168862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803c355-80c4-4cd0-8cb4-3c719e6b25fc None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:59.169293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803c355-80c4-4cd0-8cb4-3c719e6b25fc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:59.169712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803c355-80c4-4cd0-8cb4-3c719e6b25fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:59.189010 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-3803c355-80c4-4cd0-8cb4-3c719e6b25fc None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:49:59.190427 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3803c355-80c4-4cd0-8cb4-3c719e6b25fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:59.237660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:59.260765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1049/2084] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:49:59.270388 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c632b49-7f8e-4328-abe1-9440476335cb admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:59.272202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8c632b49-7f8e-4328-abe1-9440476335cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:59.340742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c632b49-7f8e-4328-abe1-9440476335cb admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:59.344919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8275e02-d347-4657-babd-71377d79fc5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:59.345683 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8275e02-d347-4657-babd-71377d79fc5c service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:59.346029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8275e02-d347-4657-babd-71377d79fc5c service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:59.346376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8275e02-d347-4657-babd-71377d79fc5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:59.356535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8275e02-d347-4657-babd-71377d79fc5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:59.358111 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8275e02-d347-4657-babd-71377d79fc5c service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:59.370720 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1036/2085] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:49:59.649908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803c355-80c4-4cd0-8cb4-3c719e6b25fc None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:59.651822 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3803c355-80c4-4cd0-8cb4-3c719e6b25fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:49:59.669052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803c355-80c4-4cd0-8cb4-3c719e6b25fc None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:59.676698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:59.679025 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:59.679287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:59.679588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] PATH_INFO: `/v3/projects/e3e17133459e4d3e982487dc254b3f17` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:59.680906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e17133459e4d3e982487dc254b3f17)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:59.682983 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:59.736785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e17133459e4d3e982487dc254b3f17', 'request_id': 'req-9040bc35-de25-438f-ae9d-f1df5dde6908'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:59.746301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e17133459e4d3e982487dc254b3f17', 'request_id': 'req-9040bc35-de25-438f-ae9d-f1df5dde6908'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:59.754743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e17133459e4d3e982487dc254b3f17', 'request_id': 'req-9040bc35-de25-438f-ae9d-f1df5dde6908'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:59.766508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] The token cache is being invalidate because project e3e17133459e4d3e982487dc254b3f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:49:59.766826 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:59.767610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:59.769266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1050/2086] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:49:59 2022] DELETE /identity/v3/projects/e3e17133459e4d3e982487dc254b3f17 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:49:59.773335 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8275e02-d347-4657-babd-71377d79fc5c service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:49:59.779805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:49:59.784188 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8275e02-d347-4657-babd-71377d79fc5c service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:49:59.877791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf7d86-d8dd-4eb1-9b71-7cbf847b4519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:49:59.878921 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf7d86-d8dd-4eb1-9b71-7cbf847b4519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:49:59.879305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf7d86-d8dd-4eb1-9b71-7cbf847b4519 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:49:59.879660 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf7d86-d8dd-4eb1-9b71-7cbf847b4519 admin admin] PATH_INFO: `/v3/users/0a99b2730bc74230b906f6aaa7992232` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:49:59.881184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf7d86-d8dd-4eb1-9b71-7cbf847b4519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a99b2730bc74230b906f6aaa7992232)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:49:59.887571 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf7d86-d8dd-4eb1-9b71-7cbf847b4519 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:49:59.971502 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-53cf7d86-d8dd-4eb1-9b71-7cbf847b4519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a99b2730bc74230b906f6aaa7992232'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:49:59.989277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-53cf7d86-d8dd-4eb1-9b71-7cbf847b4519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a99b2730bc74230b906f6aaa7992232'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:00.000530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-53cf7d86-d8dd-4eb1-9b71-7cbf847b4519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a99b2730bc74230b906f6aaa7992232'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:00.001832 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-53cf7d86-d8dd-4eb1-9b71-7cbf847b4519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a99b2730bc74230b906f6aaa7992232'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:00.002268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-53cf7d86-d8dd-4eb1-9b71-7cbf847b4519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a99b2730bc74230b906f6aaa7992232'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:00.021984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1037/2087] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:49:59 2022] DELETE /identity/v3/users/0a99b2730bc74230b906f6aaa7992232 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:00.349604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:00.351144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:00.376836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040bc35-de25-438f-ae9d-f1df5dde6908 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:00.456876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:00.457771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:00.458109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:00.458384 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25 admin admin] PATH_INFO: `/v3/projects/6f33e715bfd44919bcc0ecc3eaa54578` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:00.459808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f33e715bfd44919bcc0ecc3eaa54578)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:00.462282 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:00.550187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f33e715bfd44919bcc0ecc3eaa54578', 'request_id': 'req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:00.568319 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f33e715bfd44919bcc0ecc3eaa54578', 'request_id': 'req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:00.576059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f33e715bfd44919bcc0ecc3eaa54578', 'request_id': 'req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:00.584716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:00.592203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25 admin admin] The token cache is being invalidate because project 6f33e715bfd44919bcc0ecc3eaa54578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:50:00.592500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:00.593500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-974a92b7-7432-4ea8-bb64-1bf8a3db2f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:00.595792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1051/2088] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:50:00 2022] DELETE /identity/v3/projects/6f33e715bfd44919bcc0ecc3eaa54578 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:00.601731 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503dfb7-d284-4569-a97b-4bc307ab4667 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:00.602252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503dfb7-d284-4569-a97b-4bc307ab4667 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:00.602409 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503dfb7-d284-4569-a97b-4bc307ab4667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:00.624031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-7503dfb7-d284-4569-a97b-4bc307ab4667 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:00.625705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7503dfb7-d284-4569-a97b-4bc307ab4667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:00.739967 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1038/2089] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:00.748635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703b122-ca92-46a9-a950-c01c45e307da None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:00.749128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703b122-ca92-46a9-a950-c01c45e307da None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:00.749218 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703b122-ca92-46a9-a950-c01c45e307da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:00.774348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-8703b122-ca92-46a9-a950-c01c45e307da None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:00.775690 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8703b122-ca92-46a9-a950-c01c45e307da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:00.789046 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1052/2090] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:50:00.793684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503dfb7-d284-4569-a97b-4bc307ab4667 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:00.808379 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503dfb7-d284-4569-a97b-4bc307ab4667 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:00.813691 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8de96f-0184-48a7-85a1-796dbf95e3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:00.814387 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8de96f-0184-48a7-85a1-796dbf95e3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:00.814677 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8de96f-0184-48a7-85a1-796dbf95e3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:00.815078 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8de96f-0184-48a7-85a1-796dbf95e3c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:00.815836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8de96f-0184-48a7-85a1-796dbf95e3c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:50:00.816151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8de96f-0184-48a7-85a1-796dbf95e3c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:00.817835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8de96f-0184-48a7-85a1-796dbf95e3c7 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:00.833087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1039/2091] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:50:00.838165 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703b122-ca92-46a9-a950-c01c45e307da None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:00.855584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703b122-ca92-46a9-a950-c01c45e307da None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:00.860950 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b89d2-1c30-4acf-8c62-3e0f8c1c30e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:00.861645 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b89d2-1c30-4acf-8c62-3e0f8c1c30e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:00.861906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b89d2-1c30-4acf-8c62-3e0f8c1c30e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:00.862331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b89d2-1c30-4acf-8c62-3e0f8c1c30e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:00.863237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b89d2-1c30-4acf-8c62-3e0f8c1c30e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:00.865363 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b89d2-1c30-4acf-8c62-3e0f8c1c30e2 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:00.907469 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1053/2092] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:50:00 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:50:00.911891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8de96f-0184-48a7-85a1-796dbf95e3c7 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:00.922701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8de96f-0184-48a7-85a1-796dbf95e3c7 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:00.931453 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:00.990372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89749e12-7e59-4a0c-846d-5315cde2583d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:00.990971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89749e12-7e59-4a0c-846d-5315cde2583d admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:00.991253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89749e12-7e59-4a0c-846d-5315cde2583d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:00.991526 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89749e12-7e59-4a0c-846d-5315cde2583d admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:00.992218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89749e12-7e59-4a0c-846d-5315cde2583d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:00.994204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89749e12-7e59-4a0c-846d-5315cde2583d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:01.017123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1040/2093] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:50:00 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:50:01.021357 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b89d2-1c30-4acf-8c62-3e0f8c1c30e2 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:01.032609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b89d2-1c30-4acf-8c62-3e0f8c1c30e2 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:01.039214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5d7bf-1b9e-491a-b331-80e71650d6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:01.039977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5d7bf-1b9e-491a-b331-80e71650d6ca admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:01.040372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5d7bf-1b9e-491a-b331-80e71650d6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:01.040977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5d7bf-1b9e-491a-b331-80e71650d6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:01.041694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5d7bf-1b9e-491a-b331-80e71650d6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:01.043515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5d7bf-1b9e-491a-b331-80e71650d6ca admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:01.056050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1054/2094] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:50:01.060718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89749e12-7e59-4a0c-846d-5315cde2583d admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:01.073482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89749e12-7e59-4a0c-846d-5315cde2583d admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:01.082206 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a447f7-29fc-4cdd-9d5f-33b61ebf869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:01.083042 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a447f7-29fc-4cdd-9d5f-33b61ebf869e admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:01.083208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a447f7-29fc-4cdd-9d5f-33b61ebf869e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:01.083479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a447f7-29fc-4cdd-9d5f-33b61ebf869e admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:01.084220 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a447f7-29fc-4cdd-9d5f-33b61ebf869e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:01.085849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a447f7-29fc-4cdd-9d5f-33b61ebf869e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:01.097781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1041/2095] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:50:01.101969 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5d7bf-1b9e-491a-b331-80e71650d6ca admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:01.112264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5d7bf-1b9e-491a-b331-80e71650d6ca admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:01.118038 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aecb15-f228-4c04-aca0-c6da0c5b0bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:01.119161 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aecb15-f228-4c04-aca0-c6da0c5b0bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:01.119444 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aecb15-f228-4c04-aca0-c6da0c5b0bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:01.119721 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aecb15-f228-4c04-aca0-c6da0c5b0bf9 admin admin] PATH_INFO: `/v3/projects/541a124d3d0b4357ba547762aae70ac8/users/caa71468a30a40a084994e48ac620926/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:01.135402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aecb15-f228-4c04-aca0-c6da0c5b0bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=541a124d3d0b4357ba547762aae70ac8, user_id=caa71468a30a40a084994e48ac620926, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:01.138107 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aecb15-f228-4c04-aca0-c6da0c5b0bf9 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:01.154408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1055/2096] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:50:01 2022] PUT /identity/v3/projects/541a124d3d0b4357ba547762aae70ac8/users/caa71468a30a40a084994e48ac620926/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:01.165457 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecbb45-571e-4dfc-bd7e-0dc97fe0a8c4 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:01.165875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecbb45-571e-4dfc-bd7e-0dc97fe0a8c4 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:01.166411 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecbb45-571e-4dfc-bd7e-0dc97fe0a8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:01.215781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ccecbb45-571e-4dfc-bd7e-0dc97fe0a8c4 None None] MFA Rules not processed for user `caa71468a30a40a084994e48ac620926`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:01.218262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ccecbb45-571e-4dfc-bd7e-0dc97fe0a8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:01.313532 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1042/2097] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:01.322637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aecb15-f228-4c04-aca0-c6da0c5b0bf9 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:01.326276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-77aecb15-f228-4c04-aca0-c6da0c5b0bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:01.402387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aecb15-f228-4c04-aca0-c6da0c5b0bf9 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:01.407860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4768c-40fe-4576-a64b-2c9c542990f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:01.408613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4768c-40fe-4576-a64b-2c9c542990f5 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:01.408986 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4768c-40fe-4576-a64b-2c9c542990f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:01.409459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4768c-40fe-4576-a64b-2c9c542990f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:01.420841 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4768c-40fe-4576-a64b-2c9c542990f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:01.423199 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4768c-40fe-4576-a64b-2c9c542990f5 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:01.433639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1056/2098] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:50:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:50:03.524310 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440659fe-3938-4f59-8b8e-e0f1de562120 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:03.524739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440659fe-3938-4f59-8b8e-e0f1de562120 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:03.525124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440659fe-3938-4f59-8b8e-e0f1de562120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:03.560727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-440659fe-3938-4f59-8b8e-e0f1de562120 None None] MFA Rules not processed for user `7d8292542e8a4c429dd7575cbaccd157`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:03.562234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-440659fe-3938-4f59-8b8e-e0f1de562120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:03.694899 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1043/2099] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:03.697558 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0541d-877c-471f-94e8-324140dea247 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:03.698088 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0541d-877c-471f-94e8-324140dea247 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:03.698179 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0541d-877c-471f-94e8-324140dea247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:03.717661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-43e0541d-877c-471f-94e8-324140dea247 None None] MFA Rules not processed for user `7d8292542e8a4c429dd7575cbaccd157`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:03.718333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-43e0541d-877c-471f-94e8-324140dea247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:03.726365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1057/2100] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:03.737451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440659fe-3938-4f59-8b8e-e0f1de562120 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:03.739295 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-440659fe-3938-4f59-8b8e-e0f1de562120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:03.752094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:03.827289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440659fe-3938-4f59-8b8e-e0f1de562120 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:03.833547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab899db-62a9-4e50-a527-fcc10482b172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:03.834228 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab899db-62a9-4e50-a527-fcc10482b172 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:03.834501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab899db-62a9-4e50-a527-fcc10482b172 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:03.834814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab899db-62a9-4e50-a527-fcc10482b172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:03.850739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab899db-62a9-4e50-a527-fcc10482b172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:03.853362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab899db-62a9-4e50-a527-fcc10482b172 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:03.864167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1044/2101] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:50:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:50:04.193415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0541d-877c-471f-94e8-324140dea247 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:04.299630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0541d-877c-471f-94e8-324140dea247 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:04.309431 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dd355-166e-45ca-bdbf-727f018638e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:04.310560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dd355-166e-45ca-bdbf-727f018638e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:04.311012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dd355-166e-45ca-bdbf-727f018638e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:04.311183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dd355-166e-45ca-bdbf-727f018638e8 admin admin] PATH_INFO: `/v3/users/caa71468a30a40a084994e48ac620926` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:04.312517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dd355-166e-45ca-bdbf-727f018638e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa71468a30a40a084994e48ac620926)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:04.314484 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dd355-166e-45ca-bdbf-727f018638e8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:04.366894 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:04.378517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b51dd355-166e-45ca-bdbf-727f018638e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa71468a30a40a084994e48ac620926'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:04.408041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b51dd355-166e-45ca-bdbf-727f018638e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa71468a30a40a084994e48ac620926'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:04.408810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b51dd355-166e-45ca-bdbf-727f018638e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa71468a30a40a084994e48ac620926'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:04.420643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b51dd355-166e-45ca-bdbf-727f018638e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa71468a30a40a084994e48ac620926'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:04.421703 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b51dd355-166e-45ca-bdbf-727f018638e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa71468a30a40a084994e48ac620926'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:04.447283 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1058/2102] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:50:04 2022] DELETE /identity/v3/users/caa71468a30a40a084994e48ac620926 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:04.452799 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ca036-faeb-439f-a192-a3e93f9db314 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:04.453142 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ca036-faeb-439f-a192-a3e93f9db314 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:04.453475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ca036-faeb-439f-a192-a3e93f9db314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:04.477210 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-589ca036-faeb-439f-a192-a3e93f9db314 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:04.478505 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-589ca036-faeb-439f-a192-a3e93f9db314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:04.593181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1045/2103] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:04.605231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dd355-166e-45ca-bdbf-727f018638e8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:04.606870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b51dd355-166e-45ca-bdbf-727f018638e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:04.652461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d99b2-3cb0-43d2-9980-8e61d9b6a8e2 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:04.652749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d99b2-3cb0-43d2-9980-8e61d9b6a8e2 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:04.653026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d99b2-3cb0-43d2-9980-8e61d9b6a8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:04.700227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-902d99b2-3cb0-43d2-9980-8e61d9b6a8e2 None None] MFA Rules not processed for user `7d8292542e8a4c429dd7575cbaccd157`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:04.701565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-902d99b2-3cb0-43d2-9980-8e61d9b6a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:04.772798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dd355-166e-45ca-bdbf-727f018638e8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:04.781448 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1046/2104] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:04.782058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cd70f-9e67-4e39-a77c-102e114419f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:04.783048 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cd70f-9e67-4e39-a77c-102e114419f9 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:04.784229 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cd70f-9e67-4e39-a77c-102e114419f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:04.785929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cd70f-9e67-4e39-a77c-102e114419f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:04.807173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cd70f-9e67-4e39-a77c-102e114419f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:04.812522 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cd70f-9e67-4e39-a77c-102e114419f9 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:04.831073 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1059/2105] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:50:05.315829 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d99b2-3cb0-43d2-9980-8e61d9b6a8e2 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:05.317321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-902d99b2-3cb0-43d2-9980-8e61d9b6a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:05.333171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d99b2-3cb0-43d2-9980-8e61d9b6a8e2 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:05.340968 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b3ce1-c55c-44e8-a666-8e021c91d537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:05.342506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b3ce1-c55c-44e8-a666-8e021c91d537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:05.343028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b3ce1-c55c-44e8-a666-8e021c91d537 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:05.343386 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b3ce1-c55c-44e8-a666-8e021c91d537 admin admin] PATH_INFO: `/v3/projects/541a124d3d0b4357ba547762aae70ac8` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:05.345075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b3ce1-c55c-44e8-a666-8e021c91d537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=541a124d3d0b4357ba547762aae70ac8)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:05.347845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b3ce1-c55c-44e8-a666-8e021c91d537 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:05.408437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:05.423417 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-487b3ce1-c55c-44e8-a666-8e021c91d537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '541a124d3d0b4357ba547762aae70ac8', 'request_id': 'req-487b3ce1-c55c-44e8-a666-8e021c91d537'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:05.440653 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-487b3ce1-c55c-44e8-a666-8e021c91d537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '541a124d3d0b4357ba547762aae70ac8', 'request_id': 'req-487b3ce1-c55c-44e8-a666-8e021c91d537'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:05.448339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-487b3ce1-c55c-44e8-a666-8e021c91d537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '541a124d3d0b4357ba547762aae70ac8', 'request_id': 'req-487b3ce1-c55c-44e8-a666-8e021c91d537'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:05.461517 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-487b3ce1-c55c-44e8-a666-8e021c91d537 admin admin] The token cache is being invalidate because project 541a124d3d0b4357ba547762aae70ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:50:05.461918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-487b3ce1-c55c-44e8-a666-8e021c91d537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:05.462663 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-487b3ce1-c55c-44e8-a666-8e021c91d537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:05.464570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1047/2106] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:50:05 2022] DELETE /identity/v3/projects/541a124d3d0b4357ba547762aae70ac8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:05.469940 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce8caa-1cad-4f8b-9a4b-1a14147d312a None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:05.471645 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce8caa-1cad-4f8b-9a4b-1a14147d312a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:05.472027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce8caa-1cad-4f8b-9a4b-1a14147d312a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:05.492143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-32ce8caa-1cad-4f8b-9a4b-1a14147d312a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:05.493382 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-32ce8caa-1cad-4f8b-9a4b-1a14147d312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:05.570922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1060/2107] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:50:05.575376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a06693-6d61-420b-80e9-18cc1c0ac9fe None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:05.575763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a06693-6d61-420b-80e9-18cc1c0ac9fe None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:05.576146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a06693-6d61-420b-80e9-18cc1c0ac9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:05.596086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-f9a06693-6d61-420b-80e9-18cc1c0ac9fe None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:05.597318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-f9a06693-6d61-420b-80e9-18cc1c0ac9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:05.605550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1048/2108] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:05.610200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce8caa-1cad-4f8b-9a4b-1a14147d312a None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:05.620505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce8caa-1cad-4f8b-9a4b-1a14147d312a None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:05.625243 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13b6a0-29f7-4cb8-afe7-cce45029b734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:05.625915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13b6a0-29f7-4cb8-afe7-cce45029b734 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:05.626196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13b6a0-29f7-4cb8-afe7-cce45029b734 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:05.626458 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13b6a0-29f7-4cb8-afe7-cce45029b734 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:05.627232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13b6a0-29f7-4cb8-afe7-cce45029b734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:50:05.627543 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13b6a0-29f7-4cb8-afe7-cce45029b734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:05.629166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13b6a0-29f7-4cb8-afe7-cce45029b734 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:05.642708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1061/2109] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:50:05.654987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a06693-6d61-420b-80e9-18cc1c0ac9fe None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:05.679807 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a06693-6d61-420b-80e9-18cc1c0ac9fe None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:05.685480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef92fc-e993-4762-8ec5-2313b3b5633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:05.686240 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef92fc-e993-4762-8ec5-2313b3b5633d admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:05.686584 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef92fc-e993-4762-8ec5-2313b3b5633d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:05.686953 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef92fc-e993-4762-8ec5-2313b3b5633d admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:05.687909 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef92fc-e993-4762-8ec5-2313b3b5633d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:05.690402 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef92fc-e993-4762-8ec5-2313b3b5633d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:05.725737 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1049/2110] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:50:05 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:50:05.730021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13b6a0-29f7-4cb8-afe7-cce45029b734 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:05.740959 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13b6a0-29f7-4cb8-afe7-cce45029b734 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:05.810096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:05.837168 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e9912-a917-462f-94de-59ca629aad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:05.838161 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e9912-a917-462f-94de-59ca629aad98 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:05.838594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e9912-a917-462f-94de-59ca629aad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:05.838910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e9912-a917-462f-94de-59ca629aad98 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:05.839801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e9912-a917-462f-94de-59ca629aad98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:05.841766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e9912-a917-462f-94de-59ca629aad98 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:05.877005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1062/2111] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:50:05 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:50:05.879328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef92fc-e993-4762-8ec5-2313b3b5633d admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:05.894645 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef92fc-e993-4762-8ec5-2313b3b5633d admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:05.901065 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c93f67-142f-40f4-b76f-a0a79d2c1b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:05.901813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c93f67-142f-40f4-b76f-a0a79d2c1b93 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:05.902155 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c93f67-142f-40f4-b76f-a0a79d2c1b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:05.902489 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c93f67-142f-40f4-b76f-a0a79d2c1b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:05.903457 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c93f67-142f-40f4-b76f-a0a79d2c1b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:05.906063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c93f67-142f-40f4-b76f-a0a79d2c1b93 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:05.926328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1050/2112] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:50:05.927607 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e9912-a917-462f-94de-59ca629aad98 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:05.938074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e9912-a917-462f-94de-59ca629aad98 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:05.943133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddb7b0-4e78-4d69-81fa-e697ec0e3d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:05.943835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddb7b0-4e78-4d69-81fa-e697ec0e3d49 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:05.944098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddb7b0-4e78-4d69-81fa-e697ec0e3d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:05.944376 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddb7b0-4e78-4d69-81fa-e697ec0e3d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:05.945116 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddb7b0-4e78-4d69-81fa-e697ec0e3d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:05.946822 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddb7b0-4e78-4d69-81fa-e697ec0e3d49 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:05.959988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1063/2113] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:50:05.964883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c93f67-142f-40f4-b76f-a0a79d2c1b93 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:05.979418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c93f67-142f-40f4-b76f-a0a79d2c1b93 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:05.985036 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136ea99-187a-4888-bdb9-5ef935ba7c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:05.985939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136ea99-187a-4888-bdb9-5ef935ba7c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:05.986387 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136ea99-187a-4888-bdb9-5ef935ba7c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:05.986688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136ea99-187a-4888-bdb9-5ef935ba7c59 admin admin] PATH_INFO: `/v3/projects/307624bfe427442f92421a1df0ebe50a/users/ba70b3f6fcc44b1abe1633287adc12a3/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:06.005899 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136ea99-187a-4888-bdb9-5ef935ba7c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307624bfe427442f92421a1df0ebe50a, user_id=ba70b3f6fcc44b1abe1633287adc12a3, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:06.010241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136ea99-187a-4888-bdb9-5ef935ba7c59 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:06.032100 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1051/2114] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:50:05 2022] PUT /identity/v3/projects/307624bfe427442f92421a1df0ebe50a/users/ba70b3f6fcc44b1abe1633287adc12a3/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:06.043417 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af342a7-10e2-47b4-b8e7-515b5891e437 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:06.044553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af342a7-10e2-47b4-b8e7-515b5891e437 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:06.045113 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af342a7-10e2-47b4-b8e7-515b5891e437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:06.082152 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-4af342a7-10e2-47b4-b8e7-515b5891e437 None None] MFA Rules not processed for user `ba70b3f6fcc44b1abe1633287adc12a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:06.084134 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4af342a7-10e2-47b4-b8e7-515b5891e437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:06.173270 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1064/2115] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:50:06.185598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136ea99-187a-4888-bdb9-5ef935ba7c59 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:06.188429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2136ea99-187a-4888-bdb9-5ef935ba7c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:06.314161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136ea99-187a-4888-bdb9-5ef935ba7c59 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:06.320046 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd8390-bbb0-4942-87e0-5d09d4b2b7ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:06.320823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd8390-bbb0-4942-87e0-5d09d4b2b7ce service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:06.321217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd8390-bbb0-4942-87e0-5d09d4b2b7ce service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:06.321670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd8390-bbb0-4942-87e0-5d09d4b2b7ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:06.334648 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd8390-bbb0-4942-87e0-5d09d4b2b7ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:06.336815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd8390-bbb0-4942-87e0-5d09d4b2b7ce service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:06.351226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1052/2116] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:50:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:50:06.409245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af342a7-10e2-47b4-b8e7-515b5891e437 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:06.590106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af342a7-10e2-47b4-b8e7-515b5891e437 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:06.598112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335bfd2-6114-439d-ac79-969d712008fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:06.599224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335bfd2-6114-439d-ac79-969d712008fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:06.600548 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335bfd2-6114-439d-ac79-969d712008fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:06.600548 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335bfd2-6114-439d-ac79-969d712008fd admin admin] PATH_INFO: `/v3/users/ba70b3f6fcc44b1abe1633287adc12a3` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:06.601701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335bfd2-6114-439d-ac79-969d712008fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba70b3f6fcc44b1abe1633287adc12a3)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:06.604707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335bfd2-6114-439d-ac79-969d712008fd admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:06.769623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7335bfd2-6114-439d-ac79-969d712008fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba70b3f6fcc44b1abe1633287adc12a3'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:06.783796 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:06.809808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7335bfd2-6114-439d-ac79-969d712008fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba70b3f6fcc44b1abe1633287adc12a3'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:06.813740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7335bfd2-6114-439d-ac79-969d712008fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba70b3f6fcc44b1abe1633287adc12a3'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:06.830929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7335bfd2-6114-439d-ac79-969d712008fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba70b3f6fcc44b1abe1633287adc12a3'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:06.834527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-7335bfd2-6114-439d-ac79-969d712008fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba70b3f6fcc44b1abe1633287adc12a3'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:06.864481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1065/2117] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:50:06 2022] DELETE /identity/v3/users/ba70b3f6fcc44b1abe1633287adc12a3 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:06.870419 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd1c5f-8922-4dc0-b858-8ae0a73fe575 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:06.870999 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd1c5f-8922-4dc0-b858-8ae0a73fe575 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:06.870999 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd1c5f-8922-4dc0-b858-8ae0a73fe575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:06.897370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e7dd1c5f-8922-4dc0-b858-8ae0a73fe575 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:06.898859 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e7dd1c5f-8922-4dc0-b858-8ae0a73fe575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:06.986960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1053/2118] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:06.993736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335bfd2-6114-439d-ac79-969d712008fd admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:06.995284 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-7335bfd2-6114-439d-ac79-969d712008fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:07.082016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335bfd2-6114-439d-ac79-969d712008fd admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:07.094793 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70394e-2b9e-4415-8683-0dac9bc353c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:07.105759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70394e-2b9e-4415-8683-0dac9bc353c5 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:07.106160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70394e-2b9e-4415-8683-0dac9bc353c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:07.106457 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70394e-2b9e-4415-8683-0dac9bc353c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:07.121316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70394e-2b9e-4415-8683-0dac9bc353c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:07.123525 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70394e-2b9e-4415-8683-0dac9bc353c5 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:07.136023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1066/2119] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:50:07.469514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd1c5f-8922-4dc0-b858-8ae0a73fe575 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:07.473676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e7dd1c5f-8922-4dc0-b858-8ae0a73fe575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:07.484447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:07.493640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd1c5f-8922-4dc0-b858-8ae0a73fe575 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:07.518909 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:07.520164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:07.520985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:07.521707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] PATH_INFO: `/v3/projects/307624bfe427442f92421a1df0ebe50a` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:07.523451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=307624bfe427442f92421a1df0ebe50a)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:07.526593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:07.613878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307624bfe427442f92421a1df0ebe50a', 'request_id': 'req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:07.625088 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307624bfe427442f92421a1df0ebe50a', 'request_id': 'req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:07.634510 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307624bfe427442f92421a1df0ebe50a', 'request_id': 'req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:07.648245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] The token cache is being invalidate because project 307624bfe427442f92421a1df0ebe50a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:50:07.648535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:07.649208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:07.651127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1054/2120] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:50:07 2022] DELETE /identity/v3/projects/307624bfe427442f92421a1df0ebe50a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:10.798391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548672e-3404-49ce-a45e-d1947d819334 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:10.798926 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548672e-3404-49ce-a45e-d1947d819334 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:10.799012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548672e-3404-49ce-a45e-d1947d819334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:10.817724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-8548672e-3404-49ce-a45e-d1947d819334 None None] MFA Rules not processed for user `9cc3d33007a04c4888755d8af1ba5cad`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:10.819062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8548672e-3404-49ce-a45e-d1947d819334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:10.898596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1067/2121] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:13.173723 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:13.175442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:13.253939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcd4c6-2ef7-4348-acdb-8ff18e8eff62 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:13.265075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d8e94-f825-474c-9ec4-d2af316a70f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:13.266622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d8e94-f825-474c-9ec4-d2af316a70f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:13.266959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d8e94-f825-474c-9ec4-d2af316a70f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:13.267351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d8e94-f825-474c-9ec4-d2af316a70f9 admin admin] PATH_INFO: `/v3/users/4136a1bfabde41469cad173f51bd01d2` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:13.268655 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d8e94-f825-474c-9ec4-d2af316a70f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4136a1bfabde41469cad173f51bd01d2)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:13.270695 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d8e94-f825-474c-9ec4-d2af316a70f9 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:13.323621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8d9d8e94-f825-474c-9ec4-d2af316a70f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4136a1bfabde41469cad173f51bd01d2'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.338392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8d9d8e94-f825-474c-9ec4-d2af316a70f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4136a1bfabde41469cad173f51bd01d2'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.346008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8d9d8e94-f825-474c-9ec4-d2af316a70f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4136a1bfabde41469cad173f51bd01d2'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.346914 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8d9d8e94-f825-474c-9ec4-d2af316a70f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4136a1bfabde41469cad173f51bd01d2'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.347947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8d9d8e94-f825-474c-9ec4-d2af316a70f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4136a1bfabde41469cad173f51bd01d2'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.374476 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1055/2122] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:50:13 2022] DELETE /identity/v3/users/4136a1bfabde41469cad173f51bd01d2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:13.564252 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548672e-3404-49ce-a45e-d1947d819334 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:13.576451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548672e-3404-49ce-a45e-d1947d819334 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:13.635315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:13.636181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:13.636465 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:13.636740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] PATH_INFO: `/v3/projects/f4d9578661da4465a4d8e5d9b4e63797` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:13.637913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d9578661da4465a4d8e5d9b4e63797)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:13.639863 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:13.664160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:13.692346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d9578661da4465a4d8e5d9b4e63797', 'request_id': 'req-71d0327e-652a-4202-b46b-943dc82536d6'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.702412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d9578661da4465a4d8e5d9b4e63797', 'request_id': 'req-71d0327e-652a-4202-b46b-943dc82536d6'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.709076 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d9578661da4465a4d8e5d9b4e63797', 'request_id': 'req-71d0327e-652a-4202-b46b-943dc82536d6'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.720302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] The token cache is being invalidate because project f4d9578661da4465a4d8e5d9b4e63797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:50:13.720584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.721268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.722912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1068/2123] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:50:13 2022] DELETE /identity/v3/projects/f4d9578661da4465a4d8e5d9b4e63797 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:13.727086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d8e94-f825-474c-9ec4-d2af316a70f9 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:13.728761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8d9d8e94-f825-474c-9ec4-d2af316a70f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:13.738505 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:13.742537 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d8e94-f825-474c-9ec4-d2af316a70f9 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:13.801867 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e84d6-3196-4c9d-a103-61101472e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:13.802783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e84d6-3196-4c9d-a103-61101472e564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:13.803073 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e84d6-3196-4c9d-a103-61101472e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:13.803354 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e84d6-3196-4c9d-a103-61101472e564 admin admin] PATH_INFO: `/v3/users/9133f5861cbd4b359f4b38e2c9d836df` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:13.804661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e84d6-3196-4c9d-a103-61101472e564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9133f5861cbd4b359f4b38e2c9d836df)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:13.806736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e84d6-3196-4c9d-a103-61101472e564 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:13.862133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-698e84d6-3196-4c9d-a103-61101472e564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9133f5861cbd4b359f4b38e2c9d836df'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.874304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-698e84d6-3196-4c9d-a103-61101472e564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9133f5861cbd4b359f4b38e2c9d836df'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.881734 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-698e84d6-3196-4c9d-a103-61101472e564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9133f5861cbd4b359f4b38e2c9d836df'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.882729 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-698e84d6-3196-4c9d-a103-61101472e564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9133f5861cbd4b359f4b38e2c9d836df'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.883752 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-698e84d6-3196-4c9d-a103-61101472e564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9133f5861cbd4b359f4b38e2c9d836df'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:13.899361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1056/2124] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:50:13 2022] DELETE /identity/v3/users/9133f5861cbd4b359f4b38e2c9d836df => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:14.079899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:14.081336 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:14.095197 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0327e-652a-4202-b46b-943dc82536d6 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:14.152367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905a1f9-9c35-498a-92a6-8d745f837499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:14.153242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905a1f9-9c35-498a-92a6-8d745f837499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:14.153552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905a1f9-9c35-498a-92a6-8d745f837499 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:14.153799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905a1f9-9c35-498a-92a6-8d745f837499 admin admin] PATH_INFO: `/v3/projects/b9685eccbcce4d099f0cdc83228d202a` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:14.155085 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905a1f9-9c35-498a-92a6-8d745f837499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9685eccbcce4d099f0cdc83228d202a)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:14.157003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905a1f9-9c35-498a-92a6-8d745f837499 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:14.206875 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4905a1f9-9c35-498a-92a6-8d745f837499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9685eccbcce4d099f0cdc83228d202a', 'request_id': 'req-4905a1f9-9c35-498a-92a6-8d745f837499'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:14.216078 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4905a1f9-9c35-498a-92a6-8d745f837499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9685eccbcce4d099f0cdc83228d202a', 'request_id': 'req-4905a1f9-9c35-498a-92a6-8d745f837499'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:14.222396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4905a1f9-9c35-498a-92a6-8d745f837499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9685eccbcce4d099f0cdc83228d202a', 'request_id': 'req-4905a1f9-9c35-498a-92a6-8d745f837499'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:14.233195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4905a1f9-9c35-498a-92a6-8d745f837499 admin admin] The token cache is being invalidate because project b9685eccbcce4d099f0cdc83228d202a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:50:14.233481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4905a1f9-9c35-498a-92a6-8d745f837499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:14.234110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4905a1f9-9c35-498a-92a6-8d745f837499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:14.235696 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1069/2125] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:50:14 2022] DELETE /identity/v3/projects/b9685eccbcce4d099f0cdc83228d202a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:14.241490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f8a49-1eac-4ae3-851c-c3224caee6a1 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:14.241939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f8a49-1eac-4ae3-851c-c3224caee6a1 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:14.242085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f8a49-1eac-4ae3-851c-c3224caee6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:14.259872 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-0d1f8a49-1eac-4ae3-851c-c3224caee6a1 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:14.261089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-0d1f8a49-1eac-4ae3-851c-c3224caee6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:14.322886 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1057/2126] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:14.330829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a1558-e807-478b-a91a-a8e348b5c44b None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:14.331130 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a1558-e807-478b-a91a-a8e348b5c44b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:14.331410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a1558-e807-478b-a91a-a8e348b5c44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:14.351122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-3c0a1558-e807-478b-a91a-a8e348b5c44b None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:14.352340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3c0a1558-e807-478b-a91a-a8e348b5c44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:14.361193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1070/2127] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:14.365479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f8a49-1eac-4ae3-851c-c3224caee6a1 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:14.375363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f8a49-1eac-4ae3-851c-c3224caee6a1 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:14.379914 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d982a-f460-4118-8e73-ed59c9e7b9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:14.380585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d982a-f460-4118-8e73-ed59c9e7b9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:14.380865 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d982a-f460-4118-8e73-ed59c9e7b9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:14.381136 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d982a-f460-4118-8e73-ed59c9e7b9a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:14.381872 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d982a-f460-4118-8e73-ed59c9e7b9a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:50:14.382179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d982a-f460-4118-8e73-ed59c9e7b9a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:14.384189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d982a-f460-4118-8e73-ed59c9e7b9a2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:14.402757 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1058/2128] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:50:14.407815 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a1558-e807-478b-a91a-a8e348b5c44b None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:14.419635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a1558-e807-478b-a91a-a8e348b5c44b None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:14.432828 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa566b4-3744-4f3c-86fb-e8c02e2852bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:14.433934 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa566b4-3744-4f3c-86fb-e8c02e2852bf admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:14.434353 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa566b4-3744-4f3c-86fb-e8c02e2852bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:14.435038 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa566b4-3744-4f3c-86fb-e8c02e2852bf admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:14.440163 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa566b4-3744-4f3c-86fb-e8c02e2852bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:14.443249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa566b4-3744-4f3c-86fb-e8c02e2852bf admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:14.481879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1071/2129] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:50:14 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:50:14.486520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d982a-f460-4118-8e73-ed59c9e7b9a2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:14.497788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d982a-f460-4118-8e73-ed59c9e7b9a2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:14.511309 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:14.572224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebab634-f807-4ad4-b981-03d96bfc481a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:14.573010 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebab634-f807-4ad4-b981-03d96bfc481a admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:14.573295 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebab634-f807-4ad4-b981-03d96bfc481a admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:14.573571 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebab634-f807-4ad4-b981-03d96bfc481a admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:14.574272 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebab634-f807-4ad4-b981-03d96bfc481a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:14.576253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebab634-f807-4ad4-b981-03d96bfc481a admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:14.602171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1059/2130] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:50:14 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:50:14.603716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa566b4-3744-4f3c-86fb-e8c02e2852bf admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:14.615296 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa566b4-3744-4f3c-86fb-e8c02e2852bf admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:14.622550 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6adcb-0291-445d-b55e-ffc81663be60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:14.623462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6adcb-0291-445d-b55e-ffc81663be60 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:14.623780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6adcb-0291-445d-b55e-ffc81663be60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:14.624054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6adcb-0291-445d-b55e-ffc81663be60 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:14.624917 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6adcb-0291-445d-b55e-ffc81663be60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:14.626530 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6adcb-0291-445d-b55e-ffc81663be60 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:14.630222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:14.649020 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebab634-f807-4ad4-b981-03d96bfc481a admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:14.649748 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1072/2131] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:50:14.660294 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebab634-f807-4ad4-b981-03d96bfc481a admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:14.667024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d3239-bca6-468e-ab23-edc28bf0d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:14.668000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d3239-bca6-468e-ab23-edc28bf0d0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:14.668370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d3239-bca6-468e-ab23-edc28bf0d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:14.668724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d3239-bca6-468e-ab23-edc28bf0d0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:14.669649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d3239-bca6-468e-ab23-edc28bf0d0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:14.671589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d3239-bca6-468e-ab23-edc28bf0d0c5 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:14.683483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1060/2132] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:50:14.687965 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6adcb-0291-445d-b55e-ffc81663be60 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:14.698909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6adcb-0291-445d-b55e-ffc81663be60 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:14.703621 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997ba8d-d3bc-4128-a318-a2198d54df80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:14.704521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997ba8d-d3bc-4128-a318-a2198d54df80 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:14.705029 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997ba8d-d3bc-4128-a318-a2198d54df80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:14.705319 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997ba8d-d3bc-4128-a318-a2198d54df80 admin admin] PATH_INFO: `/v3/projects/8a18840ddf9d4bd6a87c0dcecb480647/users/2b16caa06f444d4e85d722a70b898db3/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:14.727538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997ba8d-d3bc-4128-a318-a2198d54df80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a18840ddf9d4bd6a87c0dcecb480647, user_id=2b16caa06f444d4e85d722a70b898db3, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:14.732144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997ba8d-d3bc-4128-a318-a2198d54df80 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:14.748359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1073/2133] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:50:14 2022] PUT /identity/v3/projects/8a18840ddf9d4bd6a87c0dcecb480647/users/2b16caa06f444d4e85d722a70b898db3/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:14.758491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2054188-fa66-4191-89a2-f9ba7a17a21f None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:14.758815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2054188-fa66-4191-89a2-f9ba7a17a21f None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:14.759201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2054188-fa66-4191-89a2-f9ba7a17a21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:14.788822 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-b2054188-fa66-4191-89a2-f9ba7a17a21f None None] MFA Rules not processed for user `2b16caa06f444d4e85d722a70b898db3`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:14.790359 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-b2054188-fa66-4191-89a2-f9ba7a17a21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:14.865053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1061/2134] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:14.876309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997ba8d-d3bc-4128-a318-a2198d54df80 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:14.878230 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a997ba8d-d3bc-4128-a318-a2198d54df80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:14.942521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997ba8d-d3bc-4128-a318-a2198d54df80 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:14.949370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467011a-f93f-4f5c-8078-60589219e6aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:14.950015 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467011a-f93f-4f5c-8078-60589219e6aa service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:14.951584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467011a-f93f-4f5c-8078-60589219e6aa service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:14.951866 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467011a-f93f-4f5c-8078-60589219e6aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:14.961896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467011a-f93f-4f5c-8078-60589219e6aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:14.963373 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467011a-f93f-4f5c-8078-60589219e6aa service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:14.973582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1074/2135] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:50:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:50:24.861529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:24.968605 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:26.487744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2054188-fa66-4191-89a2-f9ba7a17a21f None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:26.554633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2054188-fa66-4191-89a2-f9ba7a17a21f None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:26.560742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6dc97-ed0a-4e79-98b9-85ca995a20b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:26.561499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6dc97-ed0a-4e79-98b9-85ca995a20b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:26.561776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6dc97-ed0a-4e79-98b9-85ca995a20b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:26.562047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6dc97-ed0a-4e79-98b9-85ca995a20b4 admin admin] PATH_INFO: `/v3/users/2b16caa06f444d4e85d722a70b898db3` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:26.563290 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6dc97-ed0a-4e79-98b9-85ca995a20b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b16caa06f444d4e85d722a70b898db3)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:26.565287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6dc97-ed0a-4e79-98b9-85ca995a20b4 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:26.626605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-04f6dc97-ed0a-4e79-98b9-85ca995a20b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b16caa06f444d4e85d722a70b898db3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:26.645501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-04f6dc97-ed0a-4e79-98b9-85ca995a20b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b16caa06f444d4e85d722a70b898db3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:26.652828 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-04f6dc97-ed0a-4e79-98b9-85ca995a20b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b16caa06f444d4e85d722a70b898db3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:26.653609 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-04f6dc97-ed0a-4e79-98b9-85ca995a20b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b16caa06f444d4e85d722a70b898db3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:26.654435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-04f6dc97-ed0a-4e79-98b9-85ca995a20b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b16caa06f444d4e85d722a70b898db3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:26.670501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1062/2136] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:50:26 2022] DELETE /identity/v3/users/2b16caa06f444d4e85d722a70b898db3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:26.675231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fa75e-89fc-4f62-bfaa-05894fb77ade None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:26.675707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fa75e-89fc-4f62-bfaa-05894fb77ade None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:26.675821 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fa75e-89fc-4f62-bfaa-05894fb77ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:26.696124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-1a4fa75e-89fc-4f62-bfaa-05894fb77ade None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:26.697323 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1a4fa75e-89fc-4f62-bfaa-05894fb77ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:26.757616 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1075/2137] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:26.767562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6dc97-ed0a-4e79-98b9-85ca995a20b4 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:26.769064 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-04f6dc97-ed0a-4e79-98b9-85ca995a20b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:26.828437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6dc97-ed0a-4e79-98b9-85ca995a20b4 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:26.832887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08cbf1-c362-4a93-883b-bea6183626c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:26.833519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08cbf1-c362-4a93-883b-bea6183626c7 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:26.833807 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08cbf1-c362-4a93-883b-bea6183626c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:26.834086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08cbf1-c362-4a93-883b-bea6183626c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:26.844604 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08cbf1-c362-4a93-883b-bea6183626c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:26.846054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08cbf1-c362-4a93-883b-bea6183626c7 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:26.856241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1063/2138] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:50:27.218229 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fa75e-89fc-4f62-bfaa-05894fb77ade None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:27.219735 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1a4fa75e-89fc-4f62-bfaa-05894fb77ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:27.232405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fa75e-89fc-4f62-bfaa-05894fb77ade None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:27.238092 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41482f-4c4e-436d-a049-be7ca01a4852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:27.239109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41482f-4c4e-436d-a049-be7ca01a4852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:27.239392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41482f-4c4e-436d-a049-be7ca01a4852 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:27.239664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41482f-4c4e-436d-a049-be7ca01a4852 admin admin] PATH_INFO: `/v3/projects/8a18840ddf9d4bd6a87c0dcecb480647` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:27.240915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41482f-4c4e-436d-a049-be7ca01a4852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a18840ddf9d4bd6a87c0dcecb480647)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:27.242868 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41482f-4c4e-436d-a049-be7ca01a4852 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:27.295055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6c41482f-4c4e-436d-a049-be7ca01a4852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a18840ddf9d4bd6a87c0dcecb480647', 'request_id': 'req-6c41482f-4c4e-436d-a049-be7ca01a4852'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:27.304778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6c41482f-4c4e-436d-a049-be7ca01a4852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a18840ddf9d4bd6a87c0dcecb480647', 'request_id': 'req-6c41482f-4c4e-436d-a049-be7ca01a4852'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:27.311575 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6c41482f-4c4e-436d-a049-be7ca01a4852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a18840ddf9d4bd6a87c0dcecb480647', 'request_id': 'req-6c41482f-4c4e-436d-a049-be7ca01a4852'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:27.321851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6c41482f-4c4e-436d-a049-be7ca01a4852 admin admin] The token cache is being invalidate because project 8a18840ddf9d4bd6a87c0dcecb480647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:50:27.322160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6c41482f-4c4e-436d-a049-be7ca01a4852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:27.322840 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6c41482f-4c4e-436d-a049-be7ca01a4852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:27.324575 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1076/2139] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:50:27 2022] DELETE /identity/v3/projects/8a18840ddf9d4bd6a87c0dcecb480647 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:27.330344 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0e1c6-b523-4082-82e1-0a4ef977716c None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:27.330755 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0e1c6-b523-4082-82e1-0a4ef977716c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:27.331298 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0e1c6-b523-4082-82e1-0a4ef977716c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:27.356961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-c3e0e1c6-b523-4082-82e1-0a4ef977716c None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:27.358161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-c3e0e1c6-b523-4082-82e1-0a4ef977716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:27.376975 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:27.422999 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1064/2140] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:27.431858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327d824-e1c8-47cd-9bfb-1edc43d56df7 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:27.432146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327d824-e1c8-47cd-9bfb-1edc43d56df7 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:27.432421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327d824-e1c8-47cd-9bfb-1edc43d56df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:27.452765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-2327d824-e1c8-47cd-9bfb-1edc43d56df7 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:27.453966 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2327d824-e1c8-47cd-9bfb-1edc43d56df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:27.463278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1077/2141] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:27.467532 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0e1c6-b523-4082-82e1-0a4ef977716c None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:27.477866 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0e1c6-b523-4082-82e1-0a4ef977716c None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:27.484375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e20823-0d39-4919-9180-c93150bedec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:27.485036 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e20823-0d39-4919-9180-c93150bedec1 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:27.485314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e20823-0d39-4919-9180-c93150bedec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:27.485580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e20823-0d39-4919-9180-c93150bedec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:27.486434 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e20823-0d39-4919-9180-c93150bedec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:50:27.486739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e20823-0d39-4919-9180-c93150bedec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:27.488397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e20823-0d39-4919-9180-c93150bedec1 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:27.501060 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1065/2142] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:50:27.505383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327d824-e1c8-47cd-9bfb-1edc43d56df7 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:27.515793 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327d824-e1c8-47cd-9bfb-1edc43d56df7 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:27.521730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574d78a-097c-4b61-9cf9-a329270d2eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:27.522394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d78a-097c-4b61-9cf9-a329270d2eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:27.522710 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d78a-097c-4b61-9cf9-a329270d2eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:27.523097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d78a-097c-4b61-9cf9-a329270d2eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:27.523800 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574d78a-097c-4b61-9cf9-a329270d2eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:27.525733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574d78a-097c-4b61-9cf9-a329270d2eb3 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:27.554942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1078/2143] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:50:27 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:50:27.559137 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e20823-0d39-4919-9180-c93150bedec1 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:27.569698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e20823-0d39-4919-9180-c93150bedec1 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:27.627985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210034e7-b52e-46dd-9f7d-88cdf5eae2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:27.628666 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210034e7-b52e-46dd-9f7d-88cdf5eae2ed admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:27.628938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210034e7-b52e-46dd-9f7d-88cdf5eae2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:27.629233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210034e7-b52e-46dd-9f7d-88cdf5eae2ed admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:27.629944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210034e7-b52e-46dd-9f7d-88cdf5eae2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:27.631930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210034e7-b52e-46dd-9f7d-88cdf5eae2ed admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:27.656824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1066/2144] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:50:27 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:50:27.661011 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574d78a-097c-4b61-9cf9-a329270d2eb3 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:27.673314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574d78a-097c-4b61-9cf9-a329270d2eb3 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:27.681646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d7fc8-9b60-4fb7-a2ac-baa5700db634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:27.683257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d7fc8-9b60-4fb7-a2ac-baa5700db634 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:27.683556 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d7fc8-9b60-4fb7-a2ac-baa5700db634 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:27.683918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d7fc8-9b60-4fb7-a2ac-baa5700db634 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:27.685291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d7fc8-9b60-4fb7-a2ac-baa5700db634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:27.686966 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d7fc8-9b60-4fb7-a2ac-baa5700db634 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:27.699425 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1079/2145] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:50:27.703928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210034e7-b52e-46dd-9f7d-88cdf5eae2ed admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:27.715969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210034e7-b52e-46dd-9f7d-88cdf5eae2ed admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:27.721213 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ce1b6-509f-4860-8370-4386183076ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:27.721889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ce1b6-509f-4860-8370-4386183076ee admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:27.722176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ce1b6-509f-4860-8370-4386183076ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:27.722449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ce1b6-509f-4860-8370-4386183076ee admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:27.723222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ce1b6-509f-4860-8370-4386183076ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:27.724884 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ce1b6-509f-4860-8370-4386183076ee admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:27.736169 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1067/2146] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:50:27.740224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d7fc8-9b60-4fb7-a2ac-baa5700db634 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:27.750959 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d7fc8-9b60-4fb7-a2ac-baa5700db634 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:27.755890 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b29143-a3c9-4476-b0bf-8e2379b84916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:27.756835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b29143-a3c9-4476-b0bf-8e2379b84916 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:27.757109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b29143-a3c9-4476-b0bf-8e2379b84916 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:27.757507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b29143-a3c9-4476-b0bf-8e2379b84916 admin admin] PATH_INFO: `/v3/projects/0f672ff9ec9c429ab780255b18fcc528/users/d8be530da6cd4df2bc4eee38997e1b45/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:27.774007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b29143-a3c9-4476-b0bf-8e2379b84916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f672ff9ec9c429ab780255b18fcc528, user_id=d8be530da6cd4df2bc4eee38997e1b45, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:27.776742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b29143-a3c9-4476-b0bf-8e2379b84916 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:27.791635 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1080/2147] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:50:27 2022] PUT /identity/v3/projects/0f672ff9ec9c429ab780255b18fcc528/users/d8be530da6cd4df2bc4eee38997e1b45/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:27.796920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6184693-2f39-4ecf-8d95-0cf4960172d7 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:27.797207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6184693-2f39-4ecf-8d95-0cf4960172d7 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:27.797479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6184693-2f39-4ecf-8d95-0cf4960172d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:27.815527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e6184693-2f39-4ecf-8d95-0cf4960172d7 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:27.816778 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e6184693-2f39-4ecf-8d95-0cf4960172d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:27.885839 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1068/2148] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:27.895449 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b29143-a3c9-4476-b0bf-8e2379b84916 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:27.897200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d3b29143-a3c9-4476-b0bf-8e2379b84916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:27.919652 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:27.961124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b29143-a3c9-4476-b0bf-8e2379b84916 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:27.965128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1680d4f-f58d-44f0-be78-5522cdb31136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:27.965998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1680d4f-f58d-44f0-be78-5522cdb31136 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:27.966304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1680d4f-f58d-44f0-be78-5522cdb31136 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:27.966581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1680d4f-f58d-44f0-be78-5522cdb31136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:27.977043 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1680d4f-f58d-44f0-be78-5522cdb31136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:27.978518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1680d4f-f58d-44f0-be78-5522cdb31136 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:27.989891 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1081/2149] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:50:28.884368 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d4fd4-0bbf-44b5-bc14-79216afd564c None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:28.884721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d4fd4-0bbf-44b5-bc14-79216afd564c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:28.884721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d4fd4-0bbf-44b5-bc14-79216afd564c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:28.913434 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-170d4fd4-0bbf-44b5-bc14-79216afd564c None None] MFA Rules not processed for user `d8be530da6cd4df2bc4eee38997e1b45`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:28.914652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-170d4fd4-0bbf-44b5-bc14-79216afd564c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:28.943300 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:29.017309 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1069/2150] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:29.032166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1680d4f-f58d-44f0-be78-5522cdb31136 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:29.033789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e1680d4f-f58d-44f0-be78-5522cdb31136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:29.165951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1680d4f-f58d-44f0-be78-5522cdb31136 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:29.172863 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6534ecc-7ab9-4f09-a8ab-5438bb5cb3bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:29.173664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6534ecc-7ab9-4f09-a8ab-5438bb5cb3bb service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:29.174075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6534ecc-7ab9-4f09-a8ab-5438bb5cb3bb service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:29.174848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6534ecc-7ab9-4f09-a8ab-5438bb5cb3bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:29.189216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6534ecc-7ab9-4f09-a8ab-5438bb5cb3bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:29.190662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6534ecc-7ab9-4f09-a8ab-5438bb5cb3bb service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:29.211011 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1082/2151] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:50:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:50:30.649950 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81442d6-071e-4315-9f86-ddb05cf17773 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:30.650420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81442d6-071e-4315-9f86-ddb05cf17773 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:30.650508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81442d6-071e-4315-9f86-ddb05cf17773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:30.681008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-b81442d6-071e-4315-9f86-ddb05cf17773 None None] MFA Rules not processed for user `d8be530da6cd4df2bc4eee38997e1b45`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:30.683427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-b81442d6-071e-4315-9f86-ddb05cf17773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:30.716334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1070/2152] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:31.378356 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79b956-36de-47b0-a9ce-9192a13ded3d None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:31.378902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79b956-36de-47b0-a9ce-9192a13ded3d None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:31.379079 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79b956-36de-47b0-a9ce-9192a13ded3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:31.401888 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6d79b956-36de-47b0-a9ce-9192a13ded3d None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:31.403306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6d79b956-36de-47b0-a9ce-9192a13ded3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:31.478343 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1083/2153] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:50:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:31.528754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81442d6-071e-4315-9f86-ddb05cf17773 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:31.530307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-b81442d6-071e-4315-9f86-ddb05cf17773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:31.621053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81442d6-071e-4315-9f86-ddb05cf17773 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:31.629021 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b09547-6569-4b8f-b131-89a78765daa7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:31.629730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b09547-6569-4b8f-b131-89a78765daa7 service swift] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:31.629979 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b09547-6569-4b8f-b131-89a78765daa7 service swift] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:31.630280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b09547-6569-4b8f-b131-89a78765daa7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:31.641953 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b09547-6569-4b8f-b131-89a78765daa7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:31.643604 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b09547-6569-4b8f-b131-89a78765daa7 service swift] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:31.659568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1071/2154] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:50:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:50:35.638079 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c034a-b659-4a92-b213-cffa408d5d6f None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:35.639513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c034a-b659-4a92-b213-cffa408d5d6f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:35.640104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c034a-b659-4a92-b213-cffa408d5d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:35.661885 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-bb0c034a-b659-4a92-b213-cffa408d5d6f None None] MFA Rules not processed for user `4067f36996a348f39b50fd88f223c87b`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:35.663418 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-bb0c034a-b659-4a92-b213-cffa408d5d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:35.753445 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1084/2155] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:50:41.675485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=54 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:45.746480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=93 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:50.342743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe268c86-04f8-40fb-9e7d-2bdc007ea023 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:50.344041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe268c86-04f8-40fb-9e7d-2bdc007ea023 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:50.344595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe268c86-04f8-40fb-9e7d-2bdc007ea023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:50.364599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-fe268c86-04f8-40fb-9e7d-2bdc007ea023 None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:50.365850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-fe268c86-04f8-40fb-9e7d-2bdc007ea023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:50.373919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1072/2156] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 30 03:50:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:50.395675 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c034a-b659-4a92-b213-cffa408d5d6f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:50.410217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c034a-b659-4a92-b213-cffa408d5d6f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:50.416255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411ef7f-9911-4de7-9195-ea8752ea1806 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:50.416997 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411ef7f-9911-4de7-9195-ea8752ea1806 service swift] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:50.417305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411ef7f-9911-4de7-9195-ea8752ea1806 service swift] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:50.417647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411ef7f-9911-4de7-9195-ea8752ea1806 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:50.427400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411ef7f-9911-4de7-9195-ea8752ea1806 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:50.429048 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411ef7f-9911-4de7-9195-ea8752ea1806 service swift] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:50.440530 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1085/2157] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:50:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:50:52.592444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe268c86-04f8-40fb-9e7d-2bdc007ea023 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:52.594006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-fe268c86-04f8-40fb-9e7d-2bdc007ea023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:52.610692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe268c86-04f8-40fb-9e7d-2bdc007ea023 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:52.617924 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d226cf-8092-47fe-b3fc-404505dc2d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:52.619280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d226cf-8092-47fe-b3fc-404505dc2d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:52.619557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d226cf-8092-47fe-b3fc-404505dc2d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:52.619825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d226cf-8092-47fe-b3fc-404505dc2d98 admin admin] PATH_INFO: `/v3/users/9cc3d33007a04c4888755d8af1ba5cad` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:52.621091 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d226cf-8092-47fe-b3fc-404505dc2d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc3d33007a04c4888755d8af1ba5cad)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:52.623872 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d226cf-8092-47fe-b3fc-404505dc2d98 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:52.688745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-00d226cf-8092-47fe-b3fc-404505dc2d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc3d33007a04c4888755d8af1ba5cad'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:52.706515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-00d226cf-8092-47fe-b3fc-404505dc2d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc3d33007a04c4888755d8af1ba5cad'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:52.714336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-00d226cf-8092-47fe-b3fc-404505dc2d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc3d33007a04c4888755d8af1ba5cad'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:52.715828 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-00d226cf-8092-47fe-b3fc-404505dc2d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc3d33007a04c4888755d8af1ba5cad'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:52.716506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-00d226cf-8092-47fe-b3fc-404505dc2d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc3d33007a04c4888755d8af1ba5cad'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:52.735462 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1073/2158] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:50:52 2022] DELETE /identity/v3/users/9cc3d33007a04c4888755d8af1ba5cad => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:52.963781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411ef7f-9911-4de7-9195-ea8752ea1806 service swift] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:52.977394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411ef7f-9911-4de7-9195-ea8752ea1806 service swift] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:53.064238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c60df3-e6b9-4367-9144-9262a9bc5afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:53.065330 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c60df3-e6b9-4367-9144-9262a9bc5afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:53.065810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c60df3-e6b9-4367-9144-9262a9bc5afe admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:53.066137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c60df3-e6b9-4367-9144-9262a9bc5afe admin admin] PATH_INFO: `/v3/projects/2ac36c8e839b49278b559003f331bfda` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:53.067619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c60df3-e6b9-4367-9144-9262a9bc5afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac36c8e839b49278b559003f331bfda)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:53.069693 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c60df3-e6b9-4367-9144-9262a9bc5afe admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:53.134552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-e2c60df3-e6b9-4367-9144-9262a9bc5afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac36c8e839b49278b559003f331bfda', 'request_id': 'req-e2c60df3-e6b9-4367-9144-9262a9bc5afe'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:53.142053 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-e2c60df3-e6b9-4367-9144-9262a9bc5afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac36c8e839b49278b559003f331bfda', 'request_id': 'req-e2c60df3-e6b9-4367-9144-9262a9bc5afe'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:53.148999 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-e2c60df3-e6b9-4367-9144-9262a9bc5afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac36c8e839b49278b559003f331bfda', 'request_id': 'req-e2c60df3-e6b9-4367-9144-9262a9bc5afe'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:53.160111 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-e2c60df3-e6b9-4367-9144-9262a9bc5afe admin admin] The token cache is being invalidate because project 2ac36c8e839b49278b559003f331bfda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:50:53.160399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-e2c60df3-e6b9-4367-9144-9262a9bc5afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:53.161070 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-e2c60df3-e6b9-4367-9144-9262a9bc5afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:50:53.162758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1086/2159] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:50:52 2022] DELETE /identity/v3/projects/2ac36c8e839b49278b559003f331bfda => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:53.169432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624f9e5-d8d2-4c5c-929a-0ffb5b79368c None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:53.169862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624f9e5-d8d2-4c5c-929a-0ffb5b79368c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:53.170402 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624f9e5-d8d2-4c5c-929a-0ffb5b79368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:53.193911 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-c624f9e5-d8d2-4c5c-929a-0ffb5b79368c None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:53.195175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-c624f9e5-d8d2-4c5c-929a-0ffb5b79368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:53.259688 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1074/2160] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:53.268183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93559bd3-83e7-4f48-b9fa-7bc7e16eb024 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:53.268458 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93559bd3-83e7-4f48-b9fa-7bc7e16eb024 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:53.268741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93559bd3-83e7-4f48-b9fa-7bc7e16eb024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:53.288790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-93559bd3-83e7-4f48-b9fa-7bc7e16eb024 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:53.290008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-93559bd3-83e7-4f48-b9fa-7bc7e16eb024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:53.298560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1087/2161] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:53.303158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624f9e5-d8d2-4c5c-929a-0ffb5b79368c None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:53.313133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624f9e5-d8d2-4c5c-929a-0ffb5b79368c None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:53.318443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a12941-e014-4dad-9673-b11879a27ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:53.319136 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a12941-e014-4dad-9673-b11879a27ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:53.319416 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a12941-e014-4dad-9673-b11879a27ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:53.319690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a12941-e014-4dad-9673-b11879a27ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:53.320419 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a12941-e014-4dad-9673-b11879a27ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:50:53.320726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a12941-e014-4dad-9673-b11879a27ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:53.322347 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a12941-e014-4dad-9673-b11879a27ce6 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:53.334419 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1075/2162] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:50:53.338912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93559bd3-83e7-4f48-b9fa-7bc7e16eb024 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:53.348996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93559bd3-83e7-4f48-b9fa-7bc7e16eb024 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:53.354846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ffd5d-f76d-4b7e-b26f-f88d02cbdef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:53.355780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ffd5d-f76d-4b7e-b26f-f88d02cbdef1 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:53.356062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ffd5d-f76d-4b7e-b26f-f88d02cbdef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:53.356336 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ffd5d-f76d-4b7e-b26f-f88d02cbdef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:53.357052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ffd5d-f76d-4b7e-b26f-f88d02cbdef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:53.359030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ffd5d-f76d-4b7e-b26f-f88d02cbdef1 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:53.396824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1088/2163] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:50:53 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:50:53.401172 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a12941-e014-4dad-9673-b11879a27ce6 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:53.411739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a12941-e014-4dad-9673-b11879a27ce6 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:53.471242 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:53.484827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa59058-db18-4123-b2cc-411bcade69e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:53.485517 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa59058-db18-4123-b2cc-411bcade69e0 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:53.485800 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa59058-db18-4123-b2cc-411bcade69e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:53.486084 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa59058-db18-4123-b2cc-411bcade69e0 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:53.486820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa59058-db18-4123-b2cc-411bcade69e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:53.488803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa59058-db18-4123-b2cc-411bcade69e0 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:53.513562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1076/2164] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:50:53 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:50:53.517952 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ffd5d-f76d-4b7e-b26f-f88d02cbdef1 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:53.532545 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ffd5d-f76d-4b7e-b26f-f88d02cbdef1 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:53.540039 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f687fb-42ce-4622-8b0c-1d42e8158dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:53.540992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f687fb-42ce-4622-8b0c-1d42e8158dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:53.541434 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f687fb-42ce-4622-8b0c-1d42e8158dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:53.542458 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f687fb-42ce-4622-8b0c-1d42e8158dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:53.543427 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f687fb-42ce-4622-8b0c-1d42e8158dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:53.546365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f687fb-42ce-4622-8b0c-1d42e8158dd3 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:53.561669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1089/2165] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:50:53.565400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa59058-db18-4123-b2cc-411bcade69e0 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:53.582675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa59058-db18-4123-b2cc-411bcade69e0 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:53.598187 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29176bdf-c51d-4245-b17f-eefb6b074103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:53.599690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176bdf-c51d-4245-b17f-eefb6b074103 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:53.600297 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176bdf-c51d-4245-b17f-eefb6b074103 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:53.600558 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176bdf-c51d-4245-b17f-eefb6b074103 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:53.601886 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29176bdf-c51d-4245-b17f-eefb6b074103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:53.604943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29176bdf-c51d-4245-b17f-eefb6b074103 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:53.619370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1077/2166] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:50:53.625153 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f687fb-42ce-4622-8b0c-1d42e8158dd3 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:53.639121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f687fb-42ce-4622-8b0c-1d42e8158dd3 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:53.645620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f43ac-8408-4486-8e8b-21efa5f6b8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:53.646721 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f43ac-8408-4486-8e8b-21efa5f6b8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:53.647787 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f43ac-8408-4486-8e8b-21efa5f6b8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:53.647787 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f43ac-8408-4486-8e8b-21efa5f6b8d9 admin admin] PATH_INFO: `/v3/projects/046d6747dca449e9aa57c4da7421b880/users/1bdc2effd673472da00a0adda66a258a/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:53.668456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f43ac-8408-4486-8e8b-21efa5f6b8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=046d6747dca449e9aa57c4da7421b880, user_id=1bdc2effd673472da00a0adda66a258a, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:53.671540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f43ac-8408-4486-8e8b-21efa5f6b8d9 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:53.688428 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1090/2167] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:50:53 2022] PUT /identity/v3/projects/046d6747dca449e9aa57c4da7421b880/users/1bdc2effd673472da00a0adda66a258a/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:50:53.698472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c70e4-6d2d-4643-9382-a066f1139725 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:53.699007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c70e4-6d2d-4643-9382-a066f1139725 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:53.699385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c70e4-6d2d-4643-9382-a066f1139725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:53.735231 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-4a1c70e4-6d2d-4643-9382-a066f1139725 None None] MFA Rules not processed for user `1bdc2effd673472da00a0adda66a258a`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:53.736452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-4a1c70e4-6d2d-4643-9382-a066f1139725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:53.816199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1078/2168] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:50:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:53.830238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f43ac-8408-4486-8e8b-21efa5f6b8d9 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:53.832187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a34f43ac-8408-4486-8e8b-21efa5f6b8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:53.858224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:50:53.923144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f43ac-8408-4486-8e8b-21efa5f6b8d9 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:53.927117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959d49a-999a-4ed2-bed7-fc4b3e163a19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450fda3236cc4d1ba3189b6b66f65686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:53.927790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959d49a-999a-4ed2-bed7-fc4b3e163a19 service glance] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:53.928073 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959d49a-999a-4ed2-bed7-fc4b3e163a19 service glance] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:53.928345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959d49a-999a-4ed2-bed7-fc4b3e163a19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:53.938370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959d49a-999a-4ed2-bed7-fc4b3e163a19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:53.939889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959d49a-999a-4ed2-bed7-fc4b3e163a19 service glance] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:53.949984 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1091/2169] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:50:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:50:54.327909 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44d65c-2686-4b10-ac5f-9a7eecd9626d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:54.328191 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44d65c-2686-4b10-ac5f-9a7eecd9626d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:54.328461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44d65c-2686-4b10-ac5f-9a7eecd9626d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:54.349425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-9d44d65c-2686-4b10-ac5f-9a7eecd9626d None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:50:54.350634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9d44d65c-2686-4b10-ac5f-9a7eecd9626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:54.415127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1079/2170] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:50:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:50:54.428544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959d49a-999a-4ed2-bed7-fc4b3e163a19 service glance] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:50:54.430132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2959d49a-999a-4ed2-bed7-fc4b3e163a19 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:50:54.510154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959d49a-999a-4ed2-bed7-fc4b3e163a19 service glance] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:50:54.516489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f33ff4-d262-4261-b640-f5bb4bac2558 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:50:54.517223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33ff4-d262-4261-b640-f5bb4bac2558 service swift] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:50:54.517553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33ff4-d262-4261-b640-f5bb4bac2558 service swift] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:50:54.517850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33ff4-d262-4261-b640-f5bb4bac2558 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:50:54.529712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f33ff4-d262-4261-b640-f5bb4bac2558 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:50:54.531373 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f33ff4-d262-4261-b640-f5bb4bac2558 service swift] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:50:54.539778 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1092/2171] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:50:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:51:04.403393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:51:04.536271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=52 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:51:08.569158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7f539-22a2-46ec-a28b-8329721586de None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:08.569684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7f539-22a2-46ec-a28b-8329721586de None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:08.569809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7f539-22a2-46ec-a28b-8329721586de None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:08.571187 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1080/2172] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 03:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:51:08.578182 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0695b07-46c9-4bf3-9fd2-ef9b87da3279 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:08.578661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0695b07-46c9-4bf3-9fd2-ef9b87da3279 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:08.578960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0695b07-46c9-4bf3-9fd2-ef9b87da3279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:08.610932 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-b0695b07-46c9-4bf3-9fd2-ef9b87da3279 None None] MFA Rules not processed for user `758b152c320e4a94921bb96541cbea98`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:08.612142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b0695b07-46c9-4bf3-9fd2-ef9b87da3279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:08.749688 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1093/2173] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 03:51:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:08.761667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7f539-22a2-46ec-a28b-8329721586de None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:08.775277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7f539-22a2-46ec-a28b-8329721586de None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:08.780011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a2ba4-bd50-4d88-917a-791ed8a7109e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450fda3236cc4d1ba3189b6b66f65686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:08.780760 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a2ba4-bd50-4d88-917a-791ed8a7109e service glance] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:08.780923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a2ba4-bd50-4d88-917a-791ed8a7109e service glance] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:08.781189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a2ba4-bd50-4d88-917a-791ed8a7109e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:08.791867 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a2ba4-bd50-4d88-917a-791ed8a7109e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:08.793200 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a2ba4-bd50-4d88-917a-791ed8a7109e service glance] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:08.803878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1081/2174] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:51:08.879820 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76548b53-0a90-4179-8ee5-1fc6c7a2f90f None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:08.880145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76548b53-0a90-4179-8ee5-1fc6c7a2f90f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:08.880407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76548b53-0a90-4179-8ee5-1fc6c7a2f90f None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:08.882087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1094/2175] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 03:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:51:08.887426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11084-958e-4acc-a217-bb9f1dcc31e2 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:08.887709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11084-958e-4acc-a217-bb9f1dcc31e2 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:08.887985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11084-958e-4acc-a217-bb9f1dcc31e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:08.924784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-88a11084-958e-4acc-a217-bb9f1dcc31e2 None None] MFA Rules not processed for user `b3aa7416101948aba0b45129174cd988`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:08.927204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-88a11084-958e-4acc-a217-bb9f1dcc31e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:08.999400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1082/2176] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 03:51:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:09.011731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76548b53-0a90-4179-8ee5-1fc6c7a2f90f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:09.013562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-76548b53-0a90-4179-8ee5-1fc6c7a2f90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:09.028525 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76548b53-0a90-4179-8ee5-1fc6c7a2f90f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:09.032673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556abde-cf44-40a6-a9e0-0feca9847731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:09.033304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556abde-cf44-40a6-a9e0-0feca9847731 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:09.033582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556abde-cf44-40a6-a9e0-0feca9847731 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:09.033851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556abde-cf44-40a6-a9e0-0feca9847731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:09.041372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556abde-cf44-40a6-a9e0-0feca9847731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:09.043063 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556abde-cf44-40a6-a9e0-0feca9847731 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:09.050864 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1095/2177] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:51:09.167666 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b6c69-7108-44a4-ae82-dd1e616fd2ce None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:09.168047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b6c69-7108-44a4-ae82-dd1e616fd2ce None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:09.168331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b6c69-7108-44a4-ae82-dd1e616fd2ce None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:09.169768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1083/2178] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 03:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:51:09.175514 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e115dd-3d28-432b-a6f0-d34131326cdc None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:09.175808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e115dd-3d28-432b-a6f0-d34131326cdc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:09.176083 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e115dd-3d28-432b-a6f0-d34131326cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:09.195375 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-10e115dd-3d28-432b-a6f0-d34131326cdc None None] MFA Rules not processed for user `758b152c320e4a94921bb96541cbea98`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:09.196576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-10e115dd-3d28-432b-a6f0-d34131326cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:09.206724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1096/2179] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 03:51:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:09.218097 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b6c69-7108-44a4-ae82-dd1e616fd2ce None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:09.220225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3c6b6c69-7108-44a4-ae82-dd1e616fd2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:09.235293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b6c69-7108-44a4-ae82-dd1e616fd2ce None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:09.239293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c1840-b481-4ad0-aa45-48e3b512cf72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:09.239934 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c1840-b481-4ad0-aa45-48e3b512cf72 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:09.240215 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c1840-b481-4ad0-aa45-48e3b512cf72 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:09.240462 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c1840-b481-4ad0-aa45-48e3b512cf72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:09.251811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c1840-b481-4ad0-aa45-48e3b512cf72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:09.253277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c1840-b481-4ad0-aa45-48e3b512cf72 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:09.264652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1084/2180] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:51:10.859263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de04e65-e62c-4899-a245-6dbca027791c None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:10.859838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de04e65-e62c-4899-a245-6dbca027791c None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:10.859838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de04e65-e62c-4899-a245-6dbca027791c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:10.928166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-4de04e65-e62c-4899-a245-6dbca027791c None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:10.929406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4de04e65-e62c-4899-a245-6dbca027791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:10.985557 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:51:11.019450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1097/2181] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 30 03:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:11.038299 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c1840-b481-4ad0-aa45-48e3b512cf72 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:11.039920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-034c1840-b481-4ad0-aa45-48e3b512cf72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:11.055389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c1840-b481-4ad0-aa45-48e3b512cf72 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:11.061321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97993d9e-2d0c-4e80-82ab-dad5d4d77ba5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:11.062189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97993d9e-2d0c-4e80-82ab-dad5d4d77ba5 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:11.062423 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97993d9e-2d0c-4e80-82ab-dad5d4d77ba5 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:11.062788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97993d9e-2d0c-4e80-82ab-dad5d4d77ba5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:11.073535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97993d9e-2d0c-4e80-82ab-dad5d4d77ba5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:11.074983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97993d9e-2d0c-4e80-82ab-dad5d4d77ba5 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:11.086224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1085/2182] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:51:13.421162 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabf827-0530-473f-91f3-e902d5ba7feb None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:13.421690 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabf827-0530-473f-91f3-e902d5ba7feb None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:13.421690 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabf827-0530-473f-91f3-e902d5ba7feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:13.441660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-2eabf827-0530-473f-91f3-e902d5ba7feb None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:13.442899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2eabf827-0530-473f-91f3-e902d5ba7feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:13.450416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1098/2183] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:51:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:13.462902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97993d9e-2d0c-4e80-82ab-dad5d4d77ba5 service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:13.474903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97993d9e-2d0c-4e80-82ab-dad5d4d77ba5 service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:13.480130 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526b722-36d9-4127-8ca3-997db3d4c76f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:13.480853 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526b722-36d9-4127-8ca3-997db3d4c76f service swift] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:13.481204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526b722-36d9-4127-8ca3-997db3d4c76f service swift] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:13.481488 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526b722-36d9-4127-8ca3-997db3d4c76f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:13.490284 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526b722-36d9-4127-8ca3-997db3d4c76f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:13.492333 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526b722-36d9-4127-8ca3-997db3d4c76f service swift] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:13.504340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1086/2184] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:51:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:51:14.006555 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e00d4-dafb-44e2-8b31-2060f434a654 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:14.006753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e00d4-dafb-44e2-8b31-2060f434a654 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:14.007046 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e00d4-dafb-44e2-8b31-2060f434a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:14.030538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-af8e00d4-dafb-44e2-8b31-2060f434a654 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:14.032289 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-af8e00d4-dafb-44e2-8b31-2060f434a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:14.041725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1099/2185] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 30 03:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:14.057861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526b722-36d9-4127-8ca3-997db3d4c76f service swift] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:14.070222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526b722-36d9-4127-8ca3-997db3d4c76f service swift] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:14.075896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec10c84-3178-4236-b99d-0cc4fb78af0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:14.076582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec10c84-3178-4236-b99d-0cc4fb78af0b service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:14.076867 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec10c84-3178-4236-b99d-0cc4fb78af0b service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:14.077143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec10c84-3178-4236-b99d-0cc4fb78af0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:14.086076 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec10c84-3178-4236-b99d-0cc4fb78af0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:14.087707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec10c84-3178-4236-b99d-0cc4fb78af0b service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:14.097575 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1087/2186] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:51:24.022758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=18 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:51:24.093113 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=62 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:51:28.351113 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e00d4-dafb-44e2-8b31-2060f434a654 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:28.363114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e00d4-dafb-44e2-8b31-2060f434a654 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:28.369590 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1717335-c4ec-4335-a612-758ff1100337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:28.370471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1717335-c4ec-4335-a612-758ff1100337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:28.370746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1717335-c4ec-4335-a612-758ff1100337 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:28.371046 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1717335-c4ec-4335-a612-758ff1100337 admin admin] PATH_INFO: `/v3/users/1bdc2effd673472da00a0adda66a258a` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:28.372392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1717335-c4ec-4335-a612-758ff1100337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bdc2effd673472da00a0adda66a258a)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:28.374350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1717335-c4ec-4335-a612-758ff1100337 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:28.426727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d1717335-c4ec-4335-a612-758ff1100337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bdc2effd673472da00a0adda66a258a'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:28.438864 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d1717335-c4ec-4335-a612-758ff1100337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bdc2effd673472da00a0adda66a258a'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:28.439553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d1717335-c4ec-4335-a612-758ff1100337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bdc2effd673472da00a0adda66a258a'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:28.446431 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d1717335-c4ec-4335-a612-758ff1100337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bdc2effd673472da00a0adda66a258a'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:28.447225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d1717335-c4ec-4335-a612-758ff1100337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bdc2effd673472da00a0adda66a258a'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:28.463016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1100/2187] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:51:28 2022] DELETE /identity/v3/users/1bdc2effd673472da00a0adda66a258a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:51:28.467741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f71a8-060c-40d2-b32f-716f1b46a803 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:28.468255 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f71a8-060c-40d2-b32f-716f1b46a803 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:28.468352 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f71a8-060c-40d2-b32f-716f1b46a803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:28.487205 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-508f71a8-060c-40d2-b32f-716f1b46a803 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:28.488418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-508f71a8-060c-40d2-b32f-716f1b46a803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:28.559597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1088/2188] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:28.569465 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1717335-c4ec-4335-a612-758ff1100337 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:28.571118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d1717335-c4ec-4335-a612-758ff1100337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:28.630791 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1717335-c4ec-4335-a612-758ff1100337 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:28.634747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e0cc9-e270-4911-8c22-750436e29baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:28.635510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e0cc9-e270-4911-8c22-750436e29baa service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:28.635764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e0cc9-e270-4911-8c22-750436e29baa service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:28.636072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e0cc9-e270-4911-8c22-750436e29baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:28.645544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e0cc9-e270-4911-8c22-750436e29baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:28.647005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e0cc9-e270-4911-8c22-750436e29baa service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:28.657072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1101/2189] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:51:28.936468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f71a8-060c-40d2-b32f-716f1b46a803 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:28.937968 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-508f71a8-060c-40d2-b32f-716f1b46a803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:28.950262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f71a8-060c-40d2-b32f-716f1b46a803 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:28.955408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b5eb2-abba-462a-ab96-61356dc22267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:28.956384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b5eb2-abba-462a-ab96-61356dc22267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:28.956667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b5eb2-abba-462a-ab96-61356dc22267 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:28.956994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b5eb2-abba-462a-ab96-61356dc22267 admin admin] PATH_INFO: `/v3/projects/046d6747dca449e9aa57c4da7421b880` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:28.958555 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b5eb2-abba-462a-ab96-61356dc22267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=046d6747dca449e9aa57c4da7421b880)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:28.960614 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b5eb2-abba-462a-ab96-61356dc22267 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:29.011096 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b98b5eb2-abba-462a-ab96-61356dc22267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046d6747dca449e9aa57c4da7421b880', 'request_id': 'req-b98b5eb2-abba-462a-ab96-61356dc22267'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:29.020652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b98b5eb2-abba-462a-ab96-61356dc22267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046d6747dca449e9aa57c4da7421b880', 'request_id': 'req-b98b5eb2-abba-462a-ab96-61356dc22267'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:29.026318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b98b5eb2-abba-462a-ab96-61356dc22267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046d6747dca449e9aa57c4da7421b880', 'request_id': 'req-b98b5eb2-abba-462a-ab96-61356dc22267'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:29.037861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b98b5eb2-abba-462a-ab96-61356dc22267 admin admin] The token cache is being invalidate because project 046d6747dca449e9aa57c4da7421b880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:51:29.038144 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b98b5eb2-abba-462a-ab96-61356dc22267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:29.038864 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b98b5eb2-abba-462a-ab96-61356dc22267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:29.040439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1089/2190] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:51:28 2022] DELETE /identity/v3/projects/046d6747dca449e9aa57c4da7421b880 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:51:29.047992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf204a-6f71-4229-8742-0b7cbd8bbafd None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:29.048349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf204a-6f71-4229-8742-0b7cbd8bbafd None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:29.048724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf204a-6f71-4229-8742-0b7cbd8bbafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:29.079886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-85cf204a-6f71-4229-8742-0b7cbd8bbafd None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:29.081067 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-85cf204a-6f71-4229-8742-0b7cbd8bbafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:29.150984 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1102/2191] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:29.159238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2810efa-a130-4e59-ba77-f3d508d44008 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:29.159552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2810efa-a130-4e59-ba77-f3d508d44008 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:29.159828 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2810efa-a130-4e59-ba77-f3d508d44008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:29.178813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-c2810efa-a130-4e59-ba77-f3d508d44008 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:29.180052 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-c2810efa-a130-4e59-ba77-f3d508d44008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:29.189392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1090/2192] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:29.193859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf204a-6f71-4229-8742-0b7cbd8bbafd None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:29.204724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf204a-6f71-4229-8742-0b7cbd8bbafd None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:29.211149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e780fbb-0cbc-4bc5-9b27-9bd089cc97db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:29.211807 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e780fbb-0cbc-4bc5-9b27-9bd089cc97db admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:29.212087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e780fbb-0cbc-4bc5-9b27-9bd089cc97db admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:29.212399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e780fbb-0cbc-4bc5-9b27-9bd089cc97db admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:29.213214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e780fbb-0cbc-4bc5-9b27-9bd089cc97db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:51:29.213523 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e780fbb-0cbc-4bc5-9b27-9bd089cc97db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:29.215181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e780fbb-0cbc-4bc5-9b27-9bd089cc97db admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:29.216637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:51:29.229860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1103/2193] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:51:29.234254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2810efa-a130-4e59-ba77-f3d508d44008 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:29.245643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2810efa-a130-4e59-ba77-f3d508d44008 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:29.251336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3206ff5-22b8-4d31-9ce3-2ebf4c40b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:29.251983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3206ff5-22b8-4d31-9ce3-2ebf4c40b2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:29.252271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3206ff5-22b8-4d31-9ce3-2ebf4c40b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:29.252546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3206ff5-22b8-4d31-9ce3-2ebf4c40b2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:29.253246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3206ff5-22b8-4d31-9ce3-2ebf4c40b2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:29.255204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3206ff5-22b8-4d31-9ce3-2ebf4c40b2b1 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:29.291686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1091/2194] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:51:29 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:51:29.293175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e780fbb-0cbc-4bc5-9b27-9bd089cc97db admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:29.303263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e780fbb-0cbc-4bc5-9b27-9bd089cc97db admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:29.368655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a938180-7097-4587-9320-6e1dd793f668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:29.369653 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a938180-7097-4587-9320-6e1dd793f668 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:29.369961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a938180-7097-4587-9320-6e1dd793f668 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:29.370240 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a938180-7097-4587-9320-6e1dd793f668 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:29.370979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a938180-7097-4587-9320-6e1dd793f668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:29.372943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a938180-7097-4587-9320-6e1dd793f668 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:29.395622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1104/2195] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:51:29 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:51:29.400379 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3206ff5-22b8-4d31-9ce3-2ebf4c40b2b1 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:29.411554 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3206ff5-22b8-4d31-9ce3-2ebf4c40b2b1 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:29.416780 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386adf2-9996-499a-a022-a3cfe1c95f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:29.417447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386adf2-9996-499a-a022-a3cfe1c95f6e admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:29.417730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386adf2-9996-499a-a022-a3cfe1c95f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:29.418003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386adf2-9996-499a-a022-a3cfe1c95f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:29.418794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386adf2-9996-499a-a022-a3cfe1c95f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:29.420433 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386adf2-9996-499a-a022-a3cfe1c95f6e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:29.430920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1092/2196] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:51:29.435566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a938180-7097-4587-9320-6e1dd793f668 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:29.446116 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a938180-7097-4587-9320-6e1dd793f668 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:29.451780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c3029-39a9-4af1-91ee-8ae9ffb46f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:29.452539 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c3029-39a9-4af1-91ee-8ae9ffb46f8a admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:29.452850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c3029-39a9-4af1-91ee-8ae9ffb46f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:29.453205 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c3029-39a9-4af1-91ee-8ae9ffb46f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:29.453999 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c3029-39a9-4af1-91ee-8ae9ffb46f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:29.456120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c3029-39a9-4af1-91ee-8ae9ffb46f8a admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:29.467748 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1105/2197] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:51:29.472196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386adf2-9996-499a-a022-a3cfe1c95f6e admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:29.483363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386adf2-9996-499a-a022-a3cfe1c95f6e admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:29.488809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a459116-67e4-457e-a2e5-545a0fffe5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:29.489725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a459116-67e4-457e-a2e5-545a0fffe5c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:29.489997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a459116-67e4-457e-a2e5-545a0fffe5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:29.490266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a459116-67e4-457e-a2e5-545a0fffe5c8 admin admin] PATH_INFO: `/v3/projects/07957768c9924a32bb86047035e0a531/users/7906bcc3790f4a5e8a0d092a6b0a8175/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:29.505797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a459116-67e4-457e-a2e5-545a0fffe5c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07957768c9924a32bb86047035e0a531, user_id=7906bcc3790f4a5e8a0d092a6b0a8175, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:29.508504 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a459116-67e4-457e-a2e5-545a0fffe5c8 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:29.521889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1093/2198] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:51:29 2022] PUT /identity/v3/projects/07957768c9924a32bb86047035e0a531/users/7906bcc3790f4a5e8a0d092a6b0a8175/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:51:29.533886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e42e6-d622-4385-aac3-6736ec89b685 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:29.534175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e42e6-d622-4385-aac3-6736ec89b685 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:29.534449 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e42e6-d622-4385-aac3-6736ec89b685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:29.573239 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-3e1e42e6-d622-4385-aac3-6736ec89b685 None None] MFA Rules not processed for user `7906bcc3790f4a5e8a0d092a6b0a8175`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:29.574463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3e1e42e6-d622-4385-aac3-6736ec89b685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:29.643585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1106/2199] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:51:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:29.655777 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a459116-67e4-457e-a2e5-545a0fffe5c8 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:29.657805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6a459116-67e4-457e-a2e5-545a0fffe5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:29.682845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:51:29.720595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a459116-67e4-457e-a2e5-545a0fffe5c8 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:29.724210 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd15b1-b17c-4de7-98f0-57b04b497e7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:29.724865 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd15b1-b17c-4de7-98f0-57b04b497e7b service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:29.725145 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd15b1-b17c-4de7-98f0-57b04b497e7b service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:29.725422 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd15b1-b17c-4de7-98f0-57b04b497e7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:29.734040 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd15b1-b17c-4de7-98f0-57b04b497e7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:29.735547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd15b1-b17c-4de7-98f0-57b04b497e7b service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:29.744601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1094/2200] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:51:30.618918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c404168-2501-4f42-a7c7-7285431b8bfc None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:30.619485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c404168-2501-4f42-a7c7-7285431b8bfc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:30.619638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c404168-2501-4f42-a7c7-7285431b8bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:30.640376 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-9c404168-2501-4f42-a7c7-7285431b8bfc None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:30.641598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9c404168-2501-4f42-a7c7-7285431b8bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:30.705791 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1107/2201] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 30 03:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:30.722078 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd15b1-b17c-4de7-98f0-57b04b497e7b service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:30.724028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8ddd15b1-b17c-4de7-98f0-57b04b497e7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:30.828723 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd15b1-b17c-4de7-98f0-57b04b497e7b service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:30.835326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b86c1-628c-429e-ad25-573e65ecdf88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:30.835980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b86c1-628c-429e-ad25-573e65ecdf88 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:30.836263 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b86c1-628c-429e-ad25-573e65ecdf88 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:30.836536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b86c1-628c-429e-ad25-573e65ecdf88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:30.845650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b86c1-628c-429e-ad25-573e65ecdf88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:30.847313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b86c1-628c-429e-ad25-573e65ecdf88 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:30.858167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1095/2202] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:51:35.759753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912561-27eb-4722-90bc-87d98aebc4b0 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:35.760412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912561-27eb-4722-90bc-87d98aebc4b0 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:35.760412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912561-27eb-4722-90bc-87d98aebc4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:35.776524 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:51:35.789358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-a8912561-27eb-4722-90bc-87d98aebc4b0 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:35.790590 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a8912561-27eb-4722-90bc-87d98aebc4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:35.799757 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1108/2203] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 30 03:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:35.824066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b86c1-628c-429e-ad25-573e65ecdf88 service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:35.826094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d08b86c1-628c-429e-ad25-573e65ecdf88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:35.841931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b86c1-628c-429e-ad25-573e65ecdf88 service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:35.848143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb9a32-d5f6-4005-8308-5afef85635c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:35.848790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb9a32-d5f6-4005-8308-5afef85635c1 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:35.849068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb9a32-d5f6-4005-8308-5afef85635c1 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:35.849647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb9a32-d5f6-4005-8308-5afef85635c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:35.859566 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb9a32-d5f6-4005-8308-5afef85635c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:35.861770 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb9a32-d5f6-4005-8308-5afef85635c1 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:35.875179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1096/2204] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:51:38.548488 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de4d87-1d0a-43f4-b2c5-13afbe4e05f2 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:38.548971 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de4d87-1d0a-43f4-b2c5-13afbe4e05f2 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:38.549276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de4d87-1d0a-43f4-b2c5-13afbe4e05f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:38.577209 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-09de4d87-1d0a-43f4-b2c5-13afbe4e05f2 None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:38.578371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-09de4d87-1d0a-43f4-b2c5-13afbe4e05f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:38.639228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1109/2205] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 30 03:51:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:38.661920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb9a32-d5f6-4005-8308-5afef85635c1 service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:38.663417 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a7fb9a32-d5f6-4005-8308-5afef85635c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:38.738707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb9a32-d5f6-4005-8308-5afef85635c1 service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:38.744213 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad1274-c992-4ef0-80e0-98b11c1551f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:38.744857 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad1274-c992-4ef0-80e0-98b11c1551f5 service swift] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:38.745136 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad1274-c992-4ef0-80e0-98b11c1551f5 service swift] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:38.745406 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad1274-c992-4ef0-80e0-98b11c1551f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:38.754127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad1274-c992-4ef0-80e0-98b11c1551f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:38.755923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad1274-c992-4ef0-80e0-98b11c1551f5 service swift] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:38.759456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:51:38.765189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1097/2206] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:51:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:51:40.059393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de4d87-1d0a-43f4-b2c5-13afbe4e05f2 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:40.071577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de4d87-1d0a-43f4-b2c5-13afbe4e05f2 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:40.077350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228fe8e-7a1a-4e38-8187-7aff38b652f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:40.078233 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228fe8e-7a1a-4e38-8187-7aff38b652f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:40.078517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228fe8e-7a1a-4e38-8187-7aff38b652f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:40.078802 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228fe8e-7a1a-4e38-8187-7aff38b652f5 admin admin] PATH_INFO: `/v3/users/7906bcc3790f4a5e8a0d092a6b0a8175` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:40.080088 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228fe8e-7a1a-4e38-8187-7aff38b652f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7906bcc3790f4a5e8a0d092a6b0a8175)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:40.082010 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228fe8e-7a1a-4e38-8187-7aff38b652f5 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:40.141007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b228fe8e-7a1a-4e38-8187-7aff38b652f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7906bcc3790f4a5e8a0d092a6b0a8175'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:40.152819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b228fe8e-7a1a-4e38-8187-7aff38b652f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7906bcc3790f4a5e8a0d092a6b0a8175'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:40.153496 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b228fe8e-7a1a-4e38-8187-7aff38b652f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7906bcc3790f4a5e8a0d092a6b0a8175'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:40.160435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b228fe8e-7a1a-4e38-8187-7aff38b652f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7906bcc3790f4a5e8a0d092a6b0a8175'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:40.161065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-b228fe8e-7a1a-4e38-8187-7aff38b652f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7906bcc3790f4a5e8a0d092a6b0a8175'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:40.176308 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1110/2207] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:51:40 2022] DELETE /identity/v3/users/7906bcc3790f4a5e8a0d092a6b0a8175 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:51:40.181037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb4b90-a01c-4176-96d3-aab822f15ac1 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:40.181516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb4b90-a01c-4176-96d3-aab822f15ac1 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:40.181609 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb4b90-a01c-4176-96d3-aab822f15ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:40.199690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-2bcb4b90-a01c-4176-96d3-aab822f15ac1 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:40.201361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2bcb4b90-a01c-4176-96d3-aab822f15ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:40.266014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1098/2208] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:40.276679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228fe8e-7a1a-4e38-8187-7aff38b652f5 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:40.278195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b228fe8e-7a1a-4e38-8187-7aff38b652f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:40.339731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228fe8e-7a1a-4e38-8187-7aff38b652f5 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:40.343866 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae62d8-3aa5-4406-96f8-ff448be2f7f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:40.344517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae62d8-3aa5-4406-96f8-ff448be2f7f3 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:40.344805 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae62d8-3aa5-4406-96f8-ff448be2f7f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:40.345099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae62d8-3aa5-4406-96f8-ff448be2f7f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:40.355907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae62d8-3aa5-4406-96f8-ff448be2f7f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:40.357850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae62d8-3aa5-4406-96f8-ff448be2f7f3 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:40.368181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1111/2209] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:51:40.658375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb4b90-a01c-4176-96d3-aab822f15ac1 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:40.660443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2bcb4b90-a01c-4176-96d3-aab822f15ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:40.696519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb4b90-a01c-4176-96d3-aab822f15ac1 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:40.702134 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:40.703039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:40.703364 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:40.703640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a admin admin] PATH_INFO: `/v3/projects/07957768c9924a32bb86047035e0a531` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:40.708698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07957768c9924a32bb86047035e0a531)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:40.713186 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:40.770687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07957768c9924a32bb86047035e0a531', 'request_id': 'req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:40.778263 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07957768c9924a32bb86047035e0a531', 'request_id': 'req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:40.784450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07957768c9924a32bb86047035e0a531', 'request_id': 'req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:40.796677 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a admin admin] The token cache is being invalidate because project 07957768c9924a32bb86047035e0a531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:51:40.796965 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:40.797689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f5a78008-6d27-4a95-bc11-7ceda41f8f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:40.799395 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1099/2210] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:51:40 2022] DELETE /identity/v3/projects/07957768c9924a32bb86047035e0a531 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:51:40.804324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dee9d-d1d2-4cc0-988b-9ff944c78da0 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:40.804616 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dee9d-d1d2-4cc0-988b-9ff944c78da0 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:40.804899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dee9d-d1d2-4cc0-988b-9ff944c78da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:40.820174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:51:40.827920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-793dee9d-d1d2-4cc0-988b-9ff944c78da0 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:40.829456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-793dee9d-d1d2-4cc0-988b-9ff944c78da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:40.895447 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1112/2211] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:40.903296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d62e0-e17e-4032-8a37-88162dfd5ba5 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:40.903481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d62e0-e17e-4032-8a37-88162dfd5ba5 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:40.903776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d62e0-e17e-4032-8a37-88162dfd5ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:40.923089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-199d62e0-e17e-4032-8a37-88162dfd5ba5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:40.924303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-199d62e0-e17e-4032-8a37-88162dfd5ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:40.933464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1100/2212] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:40.937855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dee9d-d1d2-4cc0-988b-9ff944c78da0 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:40.948783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dee9d-d1d2-4cc0-988b-9ff944c78da0 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:40.953901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033585c0-a674-4dff-94d3-df172088caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:40.954596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033585c0-a674-4dff-94d3-df172088caf1 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:40.954918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033585c0-a674-4dff-94d3-df172088caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:40.955192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033585c0-a674-4dff-94d3-df172088caf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:40.955934 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033585c0-a674-4dff-94d3-df172088caf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:51:40.956242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033585c0-a674-4dff-94d3-df172088caf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:40.958209 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033585c0-a674-4dff-94d3-df172088caf1 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:40.970136 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1113/2213] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:51:40.974828 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d62e0-e17e-4032-8a37-88162dfd5ba5 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:40.984410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d62e0-e17e-4032-8a37-88162dfd5ba5 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:40.989901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d30c9-b671-4ef9-b98a-28e211fcfd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:40.990551 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d30c9-b671-4ef9-b98a-28e211fcfd08 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:40.990944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d30c9-b671-4ef9-b98a-28e211fcfd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:40.991216 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d30c9-b671-4ef9-b98a-28e211fcfd08 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:40.991965 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d30c9-b671-4ef9-b98a-28e211fcfd08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:40.993919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d30c9-b671-4ef9-b98a-28e211fcfd08 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:41.024097 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1101/2214] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:51:40 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:51:41.028408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033585c0-a674-4dff-94d3-df172088caf1 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:41.039333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033585c0-a674-4dff-94d3-df172088caf1 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:41.103768 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6b6f6-72ed-44bf-81be-4e3f2bf25154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:41.104429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6b6f6-72ed-44bf-81be-4e3f2bf25154 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:41.104714 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6b6f6-72ed-44bf-81be-4e3f2bf25154 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:41.104991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6b6f6-72ed-44bf-81be-4e3f2bf25154 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:41.105712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6b6f6-72ed-44bf-81be-4e3f2bf25154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:41.107960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6b6f6-72ed-44bf-81be-4e3f2bf25154 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:41.134251 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1114/2215] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:51:41 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:51:41.138447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d30c9-b671-4ef9-b98a-28e211fcfd08 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:41.149895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d30c9-b671-4ef9-b98a-28e211fcfd08 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:41.155578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88209b-b4c6-4565-9249-f41e4c7f6449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:41.156183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88209b-b4c6-4565-9249-f41e4c7f6449 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:41.156462 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88209b-b4c6-4565-9249-f41e4c7f6449 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:41.156730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88209b-b4c6-4565-9249-f41e4c7f6449 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:41.157460 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88209b-b4c6-4565-9249-f41e4c7f6449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:41.159117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88209b-b4c6-4565-9249-f41e4c7f6449 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:41.170010 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1102/2216] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:51:41.174121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6b6f6-72ed-44bf-81be-4e3f2bf25154 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:41.184575 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6b6f6-72ed-44bf-81be-4e3f2bf25154 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:41.189752 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e3d7c-cadd-48a6-a956-eac83aab792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:41.190407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e3d7c-cadd-48a6-a956-eac83aab792f admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:41.190694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e3d7c-cadd-48a6-a956-eac83aab792f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:41.191022 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e3d7c-cadd-48a6-a956-eac83aab792f admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:41.191747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e3d7c-cadd-48a6-a956-eac83aab792f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:41.193347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e3d7c-cadd-48a6-a956-eac83aab792f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:41.203615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1115/2217] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:51:41.208140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88209b-b4c6-4565-9249-f41e4c7f6449 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:41.219030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88209b-b4c6-4565-9249-f41e4c7f6449 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:41.224680 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ddb83-d470-4158-a0ac-1223e5493077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:41.225603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ddb83-d470-4158-a0ac-1223e5493077 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:41.225877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ddb83-d470-4158-a0ac-1223e5493077 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:41.226139 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ddb83-d470-4158-a0ac-1223e5493077 admin admin] PATH_INFO: `/v3/projects/47f8c16cba1c41c1a7bcc3a41691cea0/users/6a0b059963654471950c84d0246a108a/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:41.243754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ddb83-d470-4158-a0ac-1223e5493077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f8c16cba1c41c1a7bcc3a41691cea0, user_id=6a0b059963654471950c84d0246a108a, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:41.246533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ddb83-d470-4158-a0ac-1223e5493077 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:41.262057 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1103/2218] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:51:41 2022] PUT /identity/v3/projects/47f8c16cba1c41c1a7bcc3a41691cea0/users/6a0b059963654471950c84d0246a108a/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:51:41.273369 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf309b-facb-4c49-a51b-efdf235ad7eb None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:41.273669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf309b-facb-4c49-a51b-efdf235ad7eb None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:41.273937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf309b-facb-4c49-a51b-efdf235ad7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:41.301386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e9bf309b-facb-4c49-a51b-efdf235ad7eb None None] MFA Rules not processed for user `6a0b059963654471950c84d0246a108a`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:41.302640 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e9bf309b-facb-4c49-a51b-efdf235ad7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:41.375980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1116/2219] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:51:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:41.387468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ddb83-d470-4158-a0ac-1223e5493077 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:41.389367 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-483ddb83-d470-4158-a0ac-1223e5493077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:41.414034 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:51:41.475869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ddb83-d470-4158-a0ac-1223e5493077 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:41.479936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884f742-9bc6-4e5b-b1f0-79c6f01b70e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:41.480582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884f742-9bc6-4e5b-b1f0-79c6f01b70e9 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:41.480860 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884f742-9bc6-4e5b-b1f0-79c6f01b70e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:41.481132 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884f742-9bc6-4e5b-b1f0-79c6f01b70e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:41.490138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884f742-9bc6-4e5b-b1f0-79c6f01b70e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:41.491613 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884f742-9bc6-4e5b-b1f0-79c6f01b70e9 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:41.500638 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1104/2220] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:51:42.978027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bc379-a574-43f7-bd4d-bd0e20f9eeda None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:42.978502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bc379-a574-43f7-bd4d-bd0e20f9eeda None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:42.978657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bc379-a574-43f7-bd4d-bd0e20f9eeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:42.984833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:51:42.998174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-0e8bc379-a574-43f7-bd4d-bd0e20f9eeda None None] MFA Rules not processed for user `7d8292542e8a4c429dd7575cbaccd157`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:42.999427 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0e8bc379-a574-43f7-bd4d-bd0e20f9eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:43.053686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1117/2221] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:51:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:43.067926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53893ff9-0952-4489-8078-65499c1a827a None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:43.068369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53893ff9-0952-4489-8078-65499c1a827a None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:43.068456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53893ff9-0952-4489-8078-65499c1a827a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:43.087705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-53893ff9-0952-4489-8078-65499c1a827a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:43.088902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-53893ff9-0952-4489-8078-65499c1a827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:43.151332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1105/2222] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 30 03:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:43.183249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bc379-a574-43f7-bd4d-bd0e20f9eeda None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:43.185295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0e8bc379-a574-43f7-bd4d-bd0e20f9eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:43.271414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bc379-a574-43f7-bd4d-bd0e20f9eeda None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:43.278032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fb2e4-d550-419e-aa7b-b4912e09165d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:43.278856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fb2e4-d550-419e-aa7b-b4912e09165d service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:43.279151 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fb2e4-d550-419e-aa7b-b4912e09165d service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:43.279559 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fb2e4-d550-419e-aa7b-b4912e09165d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:43.291719 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fb2e4-d550-419e-aa7b-b4912e09165d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:43.293740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fb2e4-d550-419e-aa7b-b4912e09165d service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:43.305191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1118/2223] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:51:46.239401 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93c5fc-91fd-4bff-9519-0c918aef8d2b None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:46.239967 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93c5fc-91fd-4bff-9519-0c918aef8d2b None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:46.240142 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93c5fc-91fd-4bff-9519-0c918aef8d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:46.259278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-df93c5fc-91fd-4bff-9519-0c918aef8d2b None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:46.260915 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-df93c5fc-91fd-4bff-9519-0c918aef8d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:46.270821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1106/2224] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 30 03:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:46.286882 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fb2e4-d550-419e-aa7b-b4912e09165d service nova] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:46.288472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ac0fb2e4-d550-419e-aa7b-b4912e09165d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:46.304104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fb2e4-d550-419e-aa7b-b4912e09165d service nova] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:46.309949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5e9e-e76d-4da9-a8ed-973c16750eb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:46.310602 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5e9e-e76d-4da9-a8ed-973c16750eb2 service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:46.311039 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5e9e-e76d-4da9-a8ed-973c16750eb2 service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:46.311310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5e9e-e76d-4da9-a8ed-973c16750eb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:46.320257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da5e9e-e76d-4da9-a8ed-973c16750eb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:46.321955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da5e9e-e76d-4da9-a8ed-973c16750eb2 service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:46.333104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1119/2225] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:51:46.789170 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93c5fc-91fd-4bff-9519-0c918aef8d2b None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:46.801407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93c5fc-91fd-4bff-9519-0c918aef8d2b None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:46.808068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb448a-59d9-4acb-b39c-b52c44a77512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:46.808961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb448a-59d9-4acb-b39c-b52c44a77512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:46.809230 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb448a-59d9-4acb-b39c-b52c44a77512 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:46.809519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb448a-59d9-4acb-b39c-b52c44a77512 admin admin] PATH_INFO: `/v3/users/6a0b059963654471950c84d0246a108a` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:46.810925 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb448a-59d9-4acb-b39c-b52c44a77512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0b059963654471950c84d0246a108a)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:46.813057 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb448a-59d9-4acb-b39c-b52c44a77512 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:46.870634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f9eb448a-59d9-4acb-b39c-b52c44a77512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0b059963654471950c84d0246a108a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:46.883273 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f9eb448a-59d9-4acb-b39c-b52c44a77512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0b059963654471950c84d0246a108a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:46.890327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f9eb448a-59d9-4acb-b39c-b52c44a77512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0b059963654471950c84d0246a108a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:46.891091 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f9eb448a-59d9-4acb-b39c-b52c44a77512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0b059963654471950c84d0246a108a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:46.891733 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f9eb448a-59d9-4acb-b39c-b52c44a77512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0b059963654471950c84d0246a108a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:46.906582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1107/2226] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:51:46 2022] DELETE /identity/v3/users/6a0b059963654471950c84d0246a108a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:51:46.911470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340dd9f-0fe6-40b6-ae68-c14f39e4c2ca None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:46.911763 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340dd9f-0fe6-40b6-ae68-c14f39e4c2ca None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:46.912043 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340dd9f-0fe6-40b6-ae68-c14f39e4c2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:46.929861 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-7340dd9f-0fe6-40b6-ae68-c14f39e4c2ca None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:51:46.931146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-7340dd9f-0fe6-40b6-ae68-c14f39e4c2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:46.990468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1120/2227] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:51:47.000421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb448a-59d9-4acb-b39c-b52c44a77512 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:47.001983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-f9eb448a-59d9-4acb-b39c-b52c44a77512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:47.016757 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:51:47.073149 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb448a-59d9-4acb-b39c-b52c44a77512 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:47.077112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6c861-0c70-4d05-8c3a-11bc35a8ec22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:47.077772 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c861-0c70-4d05-8c3a-11bc35a8ec22 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:47.078050 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c861-0c70-4d05-8c3a-11bc35a8ec22 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:47.078358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c861-0c70-4d05-8c3a-11bc35a8ec22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:47.089107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6c861-0c70-4d05-8c3a-11bc35a8ec22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:47.090648 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6c861-0c70-4d05-8c3a-11bc35a8ec22 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:47.101677 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1108/2228] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:51:47.855008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340dd9f-0fe6-40b6-ae68-c14f39e4c2ca None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:47.857246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-7340dd9f-0fe6-40b6-ae68-c14f39e4c2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:47.880777 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340dd9f-0fe6-40b6-ae68-c14f39e4c2ca None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:47.887910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb8d53-c437-4f7b-9dbe-f31e6671741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:47.888976 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb8d53-c437-4f7b-9dbe-f31e6671741b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:47.889374 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb8d53-c437-4f7b-9dbe-f31e6671741b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:47.889744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb8d53-c437-4f7b-9dbe-f31e6671741b admin admin] PATH_INFO: `/v3/projects/47f8c16cba1c41c1a7bcc3a41691cea0` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:47.891359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb8d53-c437-4f7b-9dbe-f31e6671741b admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f8c16cba1c41c1a7bcc3a41691cea0)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:47.893387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb8d53-c437-4f7b-9dbe-f31e6671741b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:47.910463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:51:47.945238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-74bb8d53-c437-4f7b-9dbe-f31e6671741b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f8c16cba1c41c1a7bcc3a41691cea0', 'request_id': 'req-74bb8d53-c437-4f7b-9dbe-f31e6671741b'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:47.953842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-74bb8d53-c437-4f7b-9dbe-f31e6671741b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f8c16cba1c41c1a7bcc3a41691cea0', 'request_id': 'req-74bb8d53-c437-4f7b-9dbe-f31e6671741b'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:47.961625 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-74bb8d53-c437-4f7b-9dbe-f31e6671741b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f8c16cba1c41c1a7bcc3a41691cea0', 'request_id': 'req-74bb8d53-c437-4f7b-9dbe-f31e6671741b'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:47.974209 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-74bb8d53-c437-4f7b-9dbe-f31e6671741b admin admin] The token cache is being invalidate because project 47f8c16cba1c41c1a7bcc3a41691cea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:51:47.974502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-74bb8d53-c437-4f7b-9dbe-f31e6671741b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:47.975185 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-74bb8d53-c437-4f7b-9dbe-f31e6671741b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:51:47.976988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1121/2229] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:51:47 2022] DELETE /identity/v3/projects/47f8c16cba1c41c1a7bcc3a41691cea0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:51:53.242587 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6c861-0c70-4d05-8c3a-11bc35a8ec22 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:51:53.244377 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-fdb6c861-0c70-4d05-8c3a-11bc35a8ec22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:53.335997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6c861-0c70-4d05-8c3a-11bc35a8ec22 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:51:53.401964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cce4b0-4f51-458f-8b62-6326cb0471f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13562e65139b44ab931fb8fdb41a61b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:51:53.402624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cce4b0-4f51-458f-8b62-6326cb0471f1 service placement] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:51:53.402936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cce4b0-4f51-458f-8b62-6326cb0471f1 service placement] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:51:53.403215 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cce4b0-4f51-458f-8b62-6326cb0471f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:51:53.405023 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-23cce4b0-4f51-458f-8b62-6326cb0471f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:51:53.416531 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cce4b0-4f51-458f-8b62-6326cb0471f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:51:53.418270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cce4b0-4f51-458f-8b62-6326cb0471f1 service placement] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:51:53.428979 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1109/2230] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:51:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:51:57.971494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:52:03.424303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=90 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:52:06.117593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c78465-ef81-4630-b346-6af3f99e3489 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:52:06.118080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c78465-ef81-4630-b346-6af3f99e3489 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:52:06.118183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c78465-ef81-4630-b346-6af3f99e3489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:52:06.137004 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-54c78465-ef81-4630-b346-6af3f99e3489 None None] MFA Rules not processed for user `d8be530da6cd4df2bc4eee38997e1b45`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:52:06.138235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-54c78465-ef81-4630-b346-6af3f99e3489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:52:06.199206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1122/2231] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:52:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:52:11.393567 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1102ad-f755-403a-b704-73277cca6db0 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:52:11.394133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1102ad-f755-403a-b704-73277cca6db0 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:52:11.394133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1102ad-f755-403a-b704-73277cca6db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:52:11.411344 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ef1102ad-f755-403a-b704-73277cca6db0 None None] MFA Rules not processed for user `4067f36996a348f39b50fd88f223c87b`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:52:11.412561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ef1102ad-f755-403a-b704-73277cca6db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:52:11.470261 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1110/2232] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:52:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:52:16.193501 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=25 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:52:21.463148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=25 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:52:23.242282 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e15dd-66ee-488f-852b-eefa2d53077f None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:52:23.242893 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e15dd-66ee-488f-852b-eefa2d53077f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:52:23.242893 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e15dd-66ee-488f-852b-eefa2d53077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:52:23.268870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-555e15dd-66ee-488f-852b-eefa2d53077f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:52:23.270124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-555e15dd-66ee-488f-852b-eefa2d53077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:52:23.332499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1123/2233] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 30 03:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:52:23.364963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1102ad-f755-403a-b704-73277cca6db0 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:52:23.366639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ef1102ad-f755-403a-b704-73277cca6db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:52:23.446863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1102ad-f755-403a-b704-73277cca6db0 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:52:23.452971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a8d8c-b179-4f76-9d91-d28d59497eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:52:23.453621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a8d8c-b179-4f76-9d91-d28d59497eec service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:52:23.453867 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a8d8c-b179-4f76-9d91-d28d59497eec service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:52:23.454194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a8d8c-b179-4f76-9d91-d28d59497eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:52:23.463320 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a8d8c-b179-4f76-9d91-d28d59497eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:52:23.464918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a8d8c-b179-4f76-9d91-d28d59497eec service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:52:23.474403 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1111/2234] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:52:28.593361 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0848fc5-e908-429c-b049-a693c1f9fa03 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:52:28.593995 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0848fc5-e908-429c-b049-a693c1f9fa03 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:52:28.593995 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0848fc5-e908-429c-b049-a693c1f9fa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:52:28.617878 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-c0848fc5-e908-429c-b049-a693c1f9fa03 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:52:28.619154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c0848fc5-e908-429c-b049-a693c1f9fa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:52:28.628172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1124/2235] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 30 03:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:52:28.644786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a8d8c-b179-4f76-9d91-d28d59497eec service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:52:28.656659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a8d8c-b179-4f76-9d91-d28d59497eec service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:52:28.663878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7117-1745-410f-86db-fb1924daefcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:52:28.664556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7117-1745-410f-86db-fb1924daefcb service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:52:28.664840 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7117-1745-410f-86db-fb1924daefcb service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:52:28.665116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7117-1745-410f-86db-fb1924daefcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:52:28.674756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b7117-1745-410f-86db-fb1924daefcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:52:28.676576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b7117-1745-410f-86db-fb1924daefcb service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:52:28.687840 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1112/2236] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:52:31.633254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de25d62-2fc4-4374-89a5-269ea28717cb None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:52:31.633816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de25d62-2fc4-4374-89a5-269ea28717cb None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:52:31.633816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de25d62-2fc4-4374-89a5-269ea28717cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:52:31.652409 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-3de25d62-2fc4-4374-89a5-269ea28717cb None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:52:31.653615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3de25d62-2fc4-4374-89a5-269ea28717cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:52:31.661724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1125/2237] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 30 03:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:52:31.679062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7117-1745-410f-86db-fb1924daefcb service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:52:31.690492 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7117-1745-410f-86db-fb1924daefcb service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:52:31.697240 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78f77d-4a2c-42b2-bc9c-1165d0efe3b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:52:31.697898 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78f77d-4a2c-42b2-bc9c-1165d0efe3b8 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:52:31.698181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78f77d-4a2c-42b2-bc9c-1165d0efe3b8 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:52:31.698458 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78f77d-4a2c-42b2-bc9c-1165d0efe3b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:52:31.707674 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78f77d-4a2c-42b2-bc9c-1165d0efe3b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:52:31.709362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78f77d-4a2c-42b2-bc9c-1165d0efe3b8 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:52:31.719424 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1113/2238] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:52:33.335701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88943526-bc86-4d5c-b0d0-b9fbf8c1e474 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:52:33.336326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88943526-bc86-4d5c-b0d0-b9fbf8c1e474 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:52:33.336326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88943526-bc86-4d5c-b0d0-b9fbf8c1e474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:52:33.355174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-88943526-bc86-4d5c-b0d0-b9fbf8c1e474 None None] MFA Rules not processed for user `f6dd88c437b74acfb3b54e4b8fd47e89`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:52:33.356450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-88943526-bc86-4d5c-b0d0-b9fbf8c1e474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:52:33.422181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1126/2239] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:52:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:52:34.787722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911fb0f-db1e-425c-92a8-5774217ff4c2 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:52:34.788427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911fb0f-db1e-425c-92a8-5774217ff4c2 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:52:34.788427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911fb0f-db1e-425c-92a8-5774217ff4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:52:34.807302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-9911fb0f-db1e-425c-92a8-5774217ff4c2 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:52:34.808487 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9911fb0f-db1e-425c-92a8-5774217ff4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:52:34.816543 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1114/2240] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 30 03:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:52:34.862230 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88943526-bc86-4d5c-b0d0-b9fbf8c1e474 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:52:34.878544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88943526-bc86-4d5c-b0d0-b9fbf8c1e474 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:52:34.885729 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fa6c6-2d08-4981-9952-9e84d3a7a08d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:52:34.886422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fa6c6-2d08-4981-9952-9e84d3a7a08d service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:52:34.886707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fa6c6-2d08-4981-9952-9e84d3a7a08d service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:52:34.887117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fa6c6-2d08-4981-9952-9e84d3a7a08d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:52:34.896720 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fa6c6-2d08-4981-9952-9e84d3a7a08d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:52:34.898583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fa6c6-2d08-4981-9952-9e84d3a7a08d service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:52:34.908704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1127/2241] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:52:38.026913 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a88ce-7bb5-42e0-9cf1-bb10b241d97e None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:52:38.027718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a88ce-7bb5-42e0-9cf1-bb10b241d97e None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:52:38.027972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a88ce-7bb5-42e0-9cf1-bb10b241d97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:52:38.067486 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-2e1a88ce-7bb5-42e0-9cf1-bb10b241d97e None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:52:38.068934 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2e1a88ce-7bb5-42e0-9cf1-bb10b241d97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:52:38.080036 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1115/2242] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 30 03:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:52:38.099708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fa6c6-2d08-4981-9952-9e84d3a7a08d service nova] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:52:38.101291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-695fa6c6-2d08-4981-9952-9e84d3a7a08d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:52:38.117573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fa6c6-2d08-4981-9952-9e84d3a7a08d service nova] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:52:38.124097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ffff9-4f72-4ee1-8149-6519c22efa75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:52:38.125006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ffff9-4f72-4ee1-8149-6519c22efa75 service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:52:38.125302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ffff9-4f72-4ee1-8149-6519c22efa75 service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:52:38.125717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ffff9-4f72-4ee1-8149-6519c22efa75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:52:38.135775 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ffff9-4f72-4ee1-8149-6519c22efa75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:52:38.137387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ffff9-4f72-4ee1-8149-6519c22efa75 service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:52:38.148666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1128/2243] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:52:48.051687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=52 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:52:48.143529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=70 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:53:12.120685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775408-6f57-40bd-a771-4831ea4359c6 None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:53:12.121245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775408-6f57-40bd-a771-4831ea4359c6 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:53:12.121352 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775408-6f57-40bd-a771-4831ea4359c6 None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:53:12.122881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1116/2244] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 03:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:53:12.127939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f6a4e-e6ff-4dae-8547-0999d9f8586a None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:53:12.128459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f6a4e-e6ff-4dae-8547-0999d9f8586a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:53:12.128787 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f6a4e-e6ff-4dae-8547-0999d9f8586a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:53:12.165658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-a83f6a4e-e6ff-4dae-8547-0999d9f8586a None None] MFA Rules not processed for user `13562e65139b44ab931fb8fdb41a61b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:53:12.166939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a83f6a4e-e6ff-4dae-8547-0999d9f8586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:53:12.176654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1129/2245] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 03:53:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:53:12.186799 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58775408-6f57-40bd-a771-4831ea4359c6 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:53:12.188686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-58775408-6f57-40bd-a771-4831ea4359c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:53:12.196026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f6a4e-e6ff-4dae-8547-0999d9f8586a None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:53:12.197413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a83f6a4e-e6ff-4dae-8547-0999d9f8586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:53:12.208376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58775408-6f57-40bd-a771-4831ea4359c6 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:53:12.212114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f6a4e-e6ff-4dae-8547-0999d9f8586a None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:53:12.216304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f1f33-a347-4e34-8b4c-50ce27dcff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:53:12.217239 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1f33-a347-4e34-8b4c-50ce27dcff3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:53:12.217518 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1f33-a347-4e34-8b4c-50ce27dcff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:53:12.217815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1f33-a347-4e34-8b4c-50ce27dcff3f admin admin] PATH_INFO: `/v3/users/d8be530da6cd4df2bc4eee38997e1b45` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:53:12.219072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1f33-a347-4e34-8b4c-50ce27dcff3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8be530da6cd4df2bc4eee38997e1b45)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:53:12.221002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1f33-a347-4e34-8b4c-50ce27dcff3f admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:53:12.222166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b77e09-f1ed-4a1a-a150-28f4f4cdd92b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13562e65139b44ab931fb8fdb41a61b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:53:12.222855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b77e09-f1ed-4a1a-a150-28f4f4cdd92b service placement] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:53:12.223142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b77e09-f1ed-4a1a-a150-28f4f4cdd92b service placement] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:53:12.223794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b77e09-f1ed-4a1a-a150-28f4f4cdd92b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:53:12.232385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b77e09-f1ed-4a1a-a150-28f4f4cdd92b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:53:12.233967 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b77e09-f1ed-4a1a-a150-28f4f4cdd92b service placement] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:53:12.245267 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1130/2246] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:53:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:53:12.272042 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9b7f1f33-a347-4e34-8b4c-50ce27dcff3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8be530da6cd4df2bc4eee38997e1b45'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:53:12.283911 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9b7f1f33-a347-4e34-8b4c-50ce27dcff3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8be530da6cd4df2bc4eee38997e1b45'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:53:12.290514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9b7f1f33-a347-4e34-8b4c-50ce27dcff3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8be530da6cd4df2bc4eee38997e1b45'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:53:12.291238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9b7f1f33-a347-4e34-8b4c-50ce27dcff3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8be530da6cd4df2bc4eee38997e1b45'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:53:12.291890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9b7f1f33-a347-4e34-8b4c-50ce27dcff3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8be530da6cd4df2bc4eee38997e1b45'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:53:12.311215 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1117/2247] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:53:12 2022] DELETE /identity/v3/users/d8be530da6cd4df2bc4eee38997e1b45 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:53:12.508602 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b77e09-f1ed-4a1a-a150-28f4f4cdd92b service placement] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:53:12.519831 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b77e09-f1ed-4a1a-a150-28f4f4cdd92b service placement] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:53:12.584939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:53:12.585812 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:53:12.586096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:53:12.586372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752 admin admin] PATH_INFO: `/v3/projects/0f672ff9ec9c429ab780255b18fcc528` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:53:12.587614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f672ff9ec9c429ab780255b18fcc528)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:53:12.589536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:53:12.639740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f672ff9ec9c429ab780255b18fcc528', 'request_id': 'req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:53:12.648934 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f672ff9ec9c429ab780255b18fcc528', 'request_id': 'req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:53:12.655411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f672ff9ec9c429ab780255b18fcc528', 'request_id': 'req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:53:12.665501 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752 admin admin] The token cache is being invalidate because project 0f672ff9ec9c429ab780255b18fcc528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:53:12.665787 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:53:12.666411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c72f9a2a-1a82-4f32-a126-cb4fd25f9752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:53:12.667981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1131/2248] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:53:12 2022] DELETE /identity/v3/projects/0f672ff9ec9c429ab780255b18fcc528 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:53:17.731890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b77f6c-8d05-4b75-a75a-40cc598de6a6 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:53:17.732421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b77f6c-8d05-4b75-a75a-40cc598de6a6 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:53:17.732421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b77f6c-8d05-4b75-a75a-40cc598de6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:53:17.750811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-d3b77f6c-8d05-4b75-a75a-40cc598de6a6 None None] MFA Rules not processed for user `7d8292542e8a4c429dd7575cbaccd157`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:53:17.752037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d3b77f6c-8d05-4b75-a75a-40cc598de6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:53:17.811767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1118/2249] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:53:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:53:22.664092 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:53:26.518683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b9ffa-5402-4e6b-b7e9-19e260866d35 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:53:26.519313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b9ffa-5402-4e6b-b7e9-19e260866d35 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:53:26.519426 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b9ffa-5402-4e6b-b7e9-19e260866d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:53:26.538334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-895b9ffa-5402-4e6b-b7e9-19e260866d35 None None] MFA Rules not processed for user `aa8ee32c5d484363b8af1898d2603e90`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:53:26.539617 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-895b9ffa-5402-4e6b-b7e9-19e260866d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:53:26.601703 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1132/2250] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:53:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:53:27.804744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:53:29.921919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27ee97-128d-43bf-b335-1e5e7ad902ed None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:53:29.922747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27ee97-128d-43bf-b335-1e5e7ad902ed None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:53:29.923156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27ee97-128d-43bf-b335-1e5e7ad902ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:53:29.979698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-cf27ee97-128d-43bf-b335-1e5e7ad902ed None None] MFA Rules not processed for user `4067f36996a348f39b50fd88f223c87b`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:53:29.979698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cf27ee97-128d-43bf-b335-1e5e7ad902ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:53:30.077294 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1119/2251] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:53:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:53:36.593149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=25 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:53:40.070733 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=25 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:53:48.364919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b9ffa-5402-4e6b-b7e9-19e260866d35 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:53:48.366583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-895b9ffa-5402-4e6b-b7e9-19e260866d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:53:48.427507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b9ffa-5402-4e6b-b7e9-19e260866d35 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:53:48.432293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0483c90-fc1b-45c3-bce8-0a186477efce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:53:48.433055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0483c90-fc1b-45c3-bce8-0a186477efce service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:53:48.433283 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0483c90-fc1b-45c3-bce8-0a186477efce service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:53:48.433530 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0483c90-fc1b-45c3-bce8-0a186477efce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:53:48.435909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d0483c90-fc1b-45c3-bce8-0a186477efce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:53:48.513708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0483c90-fc1b-45c3-bce8-0a186477efce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:53:48.515223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0483c90-fc1b-45c3-bce8-0a186477efce service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:53:48.529342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1133/2252] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:53:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:53:49.722169 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27ee97-128d-43bf-b335-1e5e7ad902ed None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:53:49.732947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27ee97-128d-43bf-b335-1e5e7ad902ed None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:53:49.737446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308f45a-3516-4d5e-a387-30ffa8f40224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:53:49.738116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308f45a-3516-4d5e-a387-30ffa8f40224 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:53:49.738397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308f45a-3516-4d5e-a387-30ffa8f40224 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:53:49.738671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308f45a-3516-4d5e-a387-30ffa8f40224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:53:49.740751 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3308f45a-3516-4d5e-a387-30ffa8f40224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:53:49.755656 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308f45a-3516-4d5e-a387-30ffa8f40224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:53:49.757104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308f45a-3516-4d5e-a387-30ffa8f40224 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:53:49.768903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1120/2253] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:53:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:53:55.483365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89ac9d-b75d-4b02-8ebf-cc88a2baaa9a None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:53:55.483866 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89ac9d-b75d-4b02-8ebf-cc88a2baaa9a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:53:55.484030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89ac9d-b75d-4b02-8ebf-cc88a2baaa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:53:55.535351 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-9a89ac9d-b75d-4b02-8ebf-cc88a2baaa9a None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:53:55.536573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9a89ac9d-b75d-4b02-8ebf-cc88a2baaa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:53:55.613366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1134/2254] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:53:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:53:55.664777 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308f45a-3516-4d5e-a387-30ffa8f40224 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:53:55.666365 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3308f45a-3516-4d5e-a387-30ffa8f40224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:53:55.762629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308f45a-3516-4d5e-a387-30ffa8f40224 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:53:55.768024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8a73d-b92a-4266-b4f9-8176d238c160 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:53:55.768669 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a73d-b92a-4266-b4f9-8176d238c160 service swift] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:53:55.768951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a73d-b92a-4266-b4f9-8176d238c160 service swift] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:53:55.769227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a73d-b92a-4266-b4f9-8176d238c160 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:53:55.778426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8a73d-b92a-4266-b4f9-8176d238c160 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:53:55.780066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8a73d-b92a-4266-b4f9-8176d238c160 service swift] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:53:55.788585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1121/2255] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:53:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:54:05.396510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89ac9d-b75d-4b02-8ebf-cc88a2baaa9a None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:05.407048 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89ac9d-b75d-4b02-8ebf-cc88a2baaa9a None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:05.411576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c15840-778a-45d6-b5d1-bafe29441d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:05.411867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c15840-778a-45d6-b5d1-bafe29441d7d service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:05.412214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c15840-778a-45d6-b5d1-bafe29441d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:05.412521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c15840-778a-45d6-b5d1-bafe29441d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:05.414598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-15c15840-778a-45d6-b5d1-bafe29441d7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:05.426994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:05.484161 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c15840-778a-45d6-b5d1-bafe29441d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:05.485775 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c15840-778a-45d6-b5d1-bafe29441d7d service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:05.496412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1135/2256] 10.222.0.26 () {60 vars in 1396 bytes} [Thu Jun 30 03:54:05 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:05.789400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=47 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:08.931832 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c12e-1902-4f92-af6b-a2cd5ec926bd None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:08.932536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c12e-1902-4f92-af6b-a2cd5ec926bd None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:08.932536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c12e-1902-4f92-af6b-a2cd5ec926bd None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:08.933788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1122/2257] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 03:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:54:08.939618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22efb70-b09f-4e60-90ed-851493e35e34 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:08.940059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22efb70-b09f-4e60-90ed-851493e35e34 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:08.940172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22efb70-b09f-4e60-90ed-851493e35e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:08.978431 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e22efb70-b09f-4e60-90ed-851493e35e34 None None] MFA Rules not processed for user `758b152c320e4a94921bb96541cbea98`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:08.979669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e22efb70-b09f-4e60-90ed-851493e35e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:08.989309 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1136/2258] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 03:54:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:09.002083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99c12e-1902-4f92-af6b-a2cd5ec926bd None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:09.004207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7b99c12e-1902-4f92-af6b-a2cd5ec926bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:09.103091 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99c12e-1902-4f92-af6b-a2cd5ec926bd None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:09.108194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb11a5f-e5d0-4590-a1f6-6b5ed5b8bba6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450fda3236cc4d1ba3189b6b66f65686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:09.108910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb11a5f-e5d0-4590-a1f6-6b5ed5b8bba6 service glance] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:09.109186 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb11a5f-e5d0-4590-a1f6-6b5ed5b8bba6 service glance] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:09.109457 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb11a5f-e5d0-4590-a1f6-6b5ed5b8bba6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:09.120797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb11a5f-e5d0-4590-a1f6-6b5ed5b8bba6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:09.122380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb11a5f-e5d0-4590-a1f6-6b5ed5b8bba6 service glance] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:09.134855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1123/2259] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:09.209489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b5b77-e0d3-4b00-85d3-e045d8f26de1 None None] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:09.209780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b5b77-e0d3-4b00-85d3-e045d8f26de1 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:09.210063 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b5b77-e0d3-4b00-85d3-e045d8f26de1 None None] PATH_INFO: `/` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:09.211759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1137/2260] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 03:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:54:09.220166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f9e15-40b6-4678-953b-c82fa146c835 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:09.220438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f9e15-40b6-4678-953b-c82fa146c835 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:09.220891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f9e15-40b6-4678-953b-c82fa146c835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:09.239953 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-1b9f9e15-40b6-4678-953b-c82fa146c835 None None] MFA Rules not processed for user `b3aa7416101948aba0b45129174cd988`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:09.241170 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-1b9f9e15-40b6-4678-953b-c82fa146c835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:09.247761 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1124/2261] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 03:54:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:09.260004 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b5b77-e0d3-4b00-85d3-e045d8f26de1 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:09.262092 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c48b5b77-e0d3-4b00-85d3-e045d8f26de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:09.276326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b5b77-e0d3-4b00-85d3-e045d8f26de1 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:09.280407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698a0a7-7e39-49eb-895c-4a39781159c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:09.281156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698a0a7-7e39-49eb-895c-4a39781159c4 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:09.281496 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698a0a7-7e39-49eb-895c-4a39781159c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:09.281829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698a0a7-7e39-49eb-895c-4a39781159c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:09.290143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698a0a7-7e39-49eb-895c-4a39781159c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:09.291736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698a0a7-7e39-49eb-895c-4a39781159c4 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:09.300368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1138/2262] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:09.385674 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c88c3c-84b7-48b2-bbc1-316ae7710bdd None None] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:09.385896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c88c3c-84b7-48b2-bbc1-316ae7710bdd None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:09.386164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c88c3c-84b7-48b2-bbc1-316ae7710bdd None None] PATH_INFO: `/` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:09.387843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1125/2263] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 03:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 03:54:09.393727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2f95d-86b3-4217-83dc-166fe8e83976 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:09.394081 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2f95d-86b3-4217-83dc-166fe8e83976 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:09.394422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2f95d-86b3-4217-83dc-166fe8e83976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:09.414168 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-30b2f95d-86b3-4217-83dc-166fe8e83976 None None] MFA Rules not processed for user `758b152c320e4a94921bb96541cbea98`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:09.415558 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-30b2f95d-86b3-4217-83dc-166fe8e83976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:09.426611 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1139/2264] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 03:54:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:09.437609 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c88c3c-84b7-48b2-bbc1-316ae7710bdd None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:09.449800 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c88c3c-84b7-48b2-bbc1-316ae7710bdd None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:09.454408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae7b75-62fc-4e48-b363-89c25718539a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:09.455089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae7b75-62fc-4e48-b363-89c25718539a service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:09.455758 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae7b75-62fc-4e48-b363-89c25718539a service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:09.455758 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae7b75-62fc-4e48-b363-89c25718539a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:09.467468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae7b75-62fc-4e48-b363-89c25718539a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:09.468941 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae7b75-62fc-4e48-b363-89c25718539a service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:09.481191 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1126/2265] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:09.545087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2f95d-86b3-4217-83dc-166fe8e83976 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:09.546846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-30b2f95d-86b3-4217-83dc-166fe8e83976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:09.621220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2f95d-86b3-4217-83dc-166fe8e83976 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:09.628046 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea012f8d-e8ea-4026-a377-1245891c2f8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13562e65139b44ab931fb8fdb41a61b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:09.628684 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea012f8d-e8ea-4026-a377-1245891c2f8b service placement] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:09.629064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea012f8d-e8ea-4026-a377-1245891c2f8b service placement] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:09.629393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea012f8d-e8ea-4026-a377-1245891c2f8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:09.631364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ea012f8d-e8ea-4026-a377-1245891c2f8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:09.644935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea012f8d-e8ea-4026-a377-1245891c2f8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:09.646619 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea012f8d-e8ea-4026-a377-1245891c2f8b service placement] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:09.657632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1140/2266] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:11.322379 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdaa10-0097-4128-8165-5f6967302e77 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:11.322923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdaa10-0097-4128-8165-5f6967302e77 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:11.323018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdaa10-0097-4128-8165-5f6967302e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:11.342071 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-55fdaa10-0097-4128-8165-5f6967302e77 None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:11.343321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-55fdaa10-0097-4128-8165-5f6967302e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:11.351019 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1127/2267] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:54:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:11.363487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea012f8d-e8ea-4026-a377-1245891c2f8b service placement] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:11.375331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea012f8d-e8ea-4026-a377-1245891c2f8b service placement] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:11.380700 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494db23-20ce-4261-8b6e-3e9d1c167a2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:11.381361 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494db23-20ce-4261-8b6e-3e9d1c167a2e service swift] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:11.381645 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494db23-20ce-4261-8b6e-3e9d1c167a2e service swift] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:11.381919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494db23-20ce-4261-8b6e-3e9d1c167a2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:11.391013 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494db23-20ce-4261-8b6e-3e9d1c167a2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:11.392623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494db23-20ce-4261-8b6e-3e9d1c167a2e service swift] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:11.400791 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1141/2268] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:54:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:54:21.337275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=47 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:21.397804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=78 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:23.150464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdaa10-0097-4128-8165-5f6967302e77 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:23.151992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-55fdaa10-0097-4128-8165-5f6967302e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:23.167724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdaa10-0097-4128-8165-5f6967302e77 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:23.173732 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c3896-55e1-475d-b0de-aa9121e0fda4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:23.174509 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c3896-55e1-475d-b0de-aa9121e0fda4 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:23.174932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c3896-55e1-475d-b0de-aa9121e0fda4 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:23.175302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c3896-55e1-475d-b0de-aa9121e0fda4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:23.177247 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-965c3896-55e1-475d-b0de-aa9121e0fda4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:23.190216 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c3896-55e1-475d-b0de-aa9121e0fda4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:23.192014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c3896-55e1-475d-b0de-aa9121e0fda4 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:23.206962 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1128/2269] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:23.389194 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494db23-20ce-4261-8b6e-3e9d1c167a2e service swift] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:23.410806 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494db23-20ce-4261-8b6e-3e9d1c167a2e service swift] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:23.417471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb3dd2-b169-4ba7-a9b5-e24cab104146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:23.418513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb3dd2-b169-4ba7-a9b5-e24cab104146 service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:23.418889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb3dd2-b169-4ba7-a9b5-e24cab104146 service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:23.419097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb3dd2-b169-4ba7-a9b5-e24cab104146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:23.421895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c4eb3dd2-b169-4ba7-a9b5-e24cab104146 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:23.464332 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb3dd2-b169-4ba7-a9b5-e24cab104146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:23.472457 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb3dd2-b169-4ba7-a9b5-e24cab104146 service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:23.517495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1142/2270] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:27.553135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c3896-55e1-475d-b0de-aa9121e0fda4 service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:27.563400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c3896-55e1-475d-b0de-aa9121e0fda4 service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:27.567079 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045a9c8-ff5c-44c2-b61c-d197dbcb8ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:27.567725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045a9c8-ff5c-44c2-b61c-d197dbcb8ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:27.568075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045a9c8-ff5c-44c2-b61c-d197dbcb8ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:27.568353 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045a9c8-ff5c-44c2-b61c-d197dbcb8ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:27.570201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3045a9c8-ff5c-44c2-b61c-d197dbcb8ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:27.580325 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045a9c8-ff5c-44c2-b61c-d197dbcb8ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:27.581992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045a9c8-ff5c-44c2-b61c-d197dbcb8ce1 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:27.590162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1129/2271] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:28.962358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119677b-c339-4eb8-922b-19af95f5233e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:28.963155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119677b-c339-4eb8-922b-19af95f5233e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:28.963155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119677b-c339-4eb8-922b-19af95f5233e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:28.982185 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-4119677b-c339-4eb8-922b-19af95f5233e None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:28.983470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4119677b-c339-4eb8-922b-19af95f5233e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:28.990853 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1143/2272] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 30 03:54:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:29.003011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045a9c8-ff5c-44c2-b61c-d197dbcb8ce1 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:29.015762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045a9c8-ff5c-44c2-b61c-d197dbcb8ce1 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:29.021966 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d32b4a-1da4-4fec-a91d-4c29d9818250 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:29.022610 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d32b4a-1da4-4fec-a91d-4c29d9818250 service swift] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:29.022924 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d32b4a-1da4-4fec-a91d-4c29d9818250 service swift] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:29.023201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d32b4a-1da4-4fec-a91d-4c29d9818250 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:29.031896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d32b4a-1da4-4fec-a91d-4c29d9818250 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:29.033506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d32b4a-1da4-4fec-a91d-4c29d9818250 service swift] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:29.041789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1130/2273] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:54:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:54:33.652031 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119677b-c339-4eb8-922b-19af95f5233e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:33.659905 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4119677b-c339-4eb8-922b-19af95f5233e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:33.729940 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119677b-c339-4eb8-922b-19af95f5233e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:33.734584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61593b7-9aaf-47f9-95a5-aa1c791540bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:33.735528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61593b7-9aaf-47f9-95a5-aa1c791540bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:33.735819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61593b7-9aaf-47f9-95a5-aa1c791540bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:33.736100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61593b7-9aaf-47f9-95a5-aa1c791540bf admin admin] PATH_INFO: `/v3/users/7d8292542e8a4c429dd7575cbaccd157` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:33.737348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61593b7-9aaf-47f9-95a5-aa1c791540bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d8292542e8a4c429dd7575cbaccd157)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:33.739916 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61593b7-9aaf-47f9-95a5-aa1c791540bf admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:33.793942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f61593b7-9aaf-47f9-95a5-aa1c791540bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d8292542e8a4c429dd7575cbaccd157'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:33.812101 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f61593b7-9aaf-47f9-95a5-aa1c791540bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d8292542e8a4c429dd7575cbaccd157'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:33.812889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f61593b7-9aaf-47f9-95a5-aa1c791540bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d8292542e8a4c429dd7575cbaccd157'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:33.821350 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f61593b7-9aaf-47f9-95a5-aa1c791540bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d8292542e8a4c429dd7575cbaccd157'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:33.822054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f61593b7-9aaf-47f9-95a5-aa1c791540bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d8292542e8a4c429dd7575cbaccd157'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:33.838598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1144/2274] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:33 2022] DELETE /identity/v3/users/7d8292542e8a4c429dd7575cbaccd157 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:34.020406 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d32b4a-1da4-4fec-a91d-4c29d9818250 service swift] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:34.037050 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d32b4a-1da4-4fec-a91d-4c29d9818250 service swift] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:34.099708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92556fb3-026f-4a66-81e8-1bc9f51723e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:34.100704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92556fb3-026f-4a66-81e8-1bc9f51723e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:34.101244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92556fb3-026f-4a66-81e8-1bc9f51723e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:34.101545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92556fb3-026f-4a66-81e8-1bc9f51723e4 admin admin] PATH_INFO: `/v3/projects/1adb3aff00e1452e969d782432a87539` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:34.104441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92556fb3-026f-4a66-81e8-1bc9f51723e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1adb3aff00e1452e969d782432a87539)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:34.106440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92556fb3-026f-4a66-81e8-1bc9f51723e4 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:34.156153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-92556fb3-026f-4a66-81e8-1bc9f51723e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1adb3aff00e1452e969d782432a87539', 'request_id': 'req-92556fb3-026f-4a66-81e8-1bc9f51723e4'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:34.165972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-92556fb3-026f-4a66-81e8-1bc9f51723e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1adb3aff00e1452e969d782432a87539', 'request_id': 'req-92556fb3-026f-4a66-81e8-1bc9f51723e4'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:34.172387 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-92556fb3-026f-4a66-81e8-1bc9f51723e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1adb3aff00e1452e969d782432a87539', 'request_id': 'req-92556fb3-026f-4a66-81e8-1bc9f51723e4'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:34.184140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-92556fb3-026f-4a66-81e8-1bc9f51723e4 admin admin] The token cache is being invalidate because project 1adb3aff00e1452e969d782432a87539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:34.184426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-92556fb3-026f-4a66-81e8-1bc9f51723e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:34.185091 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-92556fb3-026f-4a66-81e8-1bc9f51723e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:34.186658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1131/2275] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:34 2022] DELETE /identity/v3/projects/1adb3aff00e1452e969d782432a87539 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:34.191580 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bbf50-4183-4fcc-9ef8-81cf1ff0dfea None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:34.191962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bbf50-4183-4fcc-9ef8-81cf1ff0dfea None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:34.192345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bbf50-4183-4fcc-9ef8-81cf1ff0dfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:34.212220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-ed4bbf50-4183-4fcc-9ef8-81cf1ff0dfea None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:34.213420 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ed4bbf50-4183-4fcc-9ef8-81cf1ff0dfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:34.273640 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:34.288639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1145/2276] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:34.292299 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc866952-720b-4f47-8b66-c72dba484720 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:34.292586 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc866952-720b-4f47-8b66-c72dba484720 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:34.292888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc866952-720b-4f47-8b66-c72dba484720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:34.313279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-cc866952-720b-4f47-8b66-c72dba484720 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:34.314504 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cc866952-720b-4f47-8b66-c72dba484720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:34.324305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1132/2277] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:34.328972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bbf50-4183-4fcc-9ef8-81cf1ff0dfea None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:34.339346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bbf50-4183-4fcc-9ef8-81cf1ff0dfea None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:34.345292 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5cab8-d986-4c42-9068-dee9f62d3730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:34.345953 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5cab8-d986-4c42-9068-dee9f62d3730 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:34.346228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5cab8-d986-4c42-9068-dee9f62d3730 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:34.346498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5cab8-d986-4c42-9068-dee9f62d3730 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:34.347295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5cab8-d986-4c42-9068-dee9f62d3730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:54:34.347601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5cab8-d986-4c42-9068-dee9f62d3730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:34.349604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5cab8-d986-4c42-9068-dee9f62d3730 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:34.362055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1146/2278] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:54:34.366686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc866952-720b-4f47-8b66-c72dba484720 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:34.377603 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc866952-720b-4f47-8b66-c72dba484720 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:34.384093 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d2b79-05e9-4b57-975d-eb9711bc5b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:34.384790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d2b79-05e9-4b57-975d-eb9711bc5b4b admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:34.385123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d2b79-05e9-4b57-975d-eb9711bc5b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:34.385419 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d2b79-05e9-4b57-975d-eb9711bc5b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:34.386260 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d2b79-05e9-4b57-975d-eb9711bc5b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:34.388258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d2b79-05e9-4b57-975d-eb9711bc5b4b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:34.419762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1133/2279] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:34 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:34.424020 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5cab8-d986-4c42-9068-dee9f62d3730 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:34.435108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5cab8-d986-4c42-9068-dee9f62d3730 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:34.491780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda11aac-2c99-43d6-893d-546b9eaa8b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:34.492480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda11aac-2c99-43d6-893d-546b9eaa8b98 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:34.492759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda11aac-2c99-43d6-893d-546b9eaa8b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:34.493036 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda11aac-2c99-43d6-893d-546b9eaa8b98 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:34.493751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda11aac-2c99-43d6-893d-546b9eaa8b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:34.495759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda11aac-2c99-43d6-893d-546b9eaa8b98 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:34.518277 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1147/2280] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:34 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:34.522610 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d2b79-05e9-4b57-975d-eb9711bc5b4b admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:34.532816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d2b79-05e9-4b57-975d-eb9711bc5b4b admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:34.537616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbe386-4674-4ffc-95f0-f91d6c1bb7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:34.538298 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbe386-4674-4ffc-95f0-f91d6c1bb7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:34.538552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbe386-4674-4ffc-95f0-f91d6c1bb7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:34.538850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbe386-4674-4ffc-95f0-f91d6c1bb7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:34.539580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbe386-4674-4ffc-95f0-f91d6c1bb7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:34.541185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbe386-4674-4ffc-95f0-f91d6c1bb7d9 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:34.551469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1134/2281] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:34.555578 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda11aac-2c99-43d6-893d-546b9eaa8b98 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:34.566158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda11aac-2c99-43d6-893d-546b9eaa8b98 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:34.571239 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30154b-36c2-4a27-b140-98158b12b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:34.571906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30154b-36c2-4a27-b140-98158b12b821 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:34.572188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30154b-36c2-4a27-b140-98158b12b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:34.572492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30154b-36c2-4a27-b140-98158b12b821 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:34.573225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30154b-36c2-4a27-b140-98158b12b821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:34.575276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30154b-36c2-4a27-b140-98158b12b821 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:34.587499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1148/2282] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:34.591569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbe386-4674-4ffc-95f0-f91d6c1bb7d9 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:34.601791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbe386-4674-4ffc-95f0-f91d6c1bb7d9 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:34.606517 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6f6de-db68-471a-8d89-d91629b237ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:34.607421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6f6de-db68-471a-8d89-d91629b237ca admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:34.607697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6f6de-db68-471a-8d89-d91629b237ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:34.607969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6f6de-db68-471a-8d89-d91629b237ca admin admin] PATH_INFO: `/v3/projects/8082b142f95d4ea2a9a34b4586f4de09/users/5cf55749fb3942dd926632b2406e6c8a/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:34.616100 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:34.623552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6f6de-db68-471a-8d89-d91629b237ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8082b142f95d4ea2a9a34b4586f4de09, user_id=5cf55749fb3942dd926632b2406e6c8a, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:34.627057 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6f6de-db68-471a-8d89-d91629b237ca admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:34.642104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1135/2283] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:34 2022] PUT /identity/v3/projects/8082b142f95d4ea2a9a34b4586f4de09/users/5cf55749fb3942dd926632b2406e6c8a/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:34.652360 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6ef3a-329a-4963-a873-7c1ef384008e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:34.652940 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6ef3a-329a-4963-a873-7c1ef384008e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:34.653038 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6ef3a-329a-4963-a873-7c1ef384008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:34.680469 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-dbc6ef3a-329a-4963-a873-7c1ef384008e None None] MFA Rules not processed for user `5cf55749fb3942dd926632b2406e6c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:34.681684 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-dbc6ef3a-329a-4963-a873-7c1ef384008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:34.753798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1149/2284] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:34.758704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6f6de-db68-471a-8d89-d91629b237ca admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:34.823311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6f6de-db68-471a-8d89-d91629b237ca admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:34.829226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2bd8a-b148-4698-bff8-af5bc8086d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:34.829851 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2bd8a-b148-4698-bff8-af5bc8086d12 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:34.830142 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2bd8a-b148-4698-bff8-af5bc8086d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:34.830410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2bd8a-b148-4698-bff8-af5bc8086d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:34.831165 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2bd8a-b148-4698-bff8-af5bc8086d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:34.833598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2bd8a-b148-4698-bff8-af5bc8086d12 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:34.863884 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1136/2285] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:34 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:34.867892 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6ef3a-329a-4963-a873-7c1ef384008e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:34.873041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2bd8a-b148-4698-bff8-af5bc8086d12 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:34.874780 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-04a2bd8a-b148-4698-bff8-af5bc8086d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:34.879823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6ef3a-329a-4963-a873-7c1ef384008e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:34.937152 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:34.945101 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeb0f2-6c0a-4f5e-a1d9-8799192e6e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:34.945821 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeb0f2-6c0a-4f5e-a1d9-8799192e6e78 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:34.946349 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeb0f2-6c0a-4f5e-a1d9-8799192e6e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:34.946880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeb0f2-6c0a-4f5e-a1d9-8799192e6e78 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:34.947659 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faeb0f2-6c0a-4f5e-a1d9-8799192e6e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:34.950127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faeb0f2-6c0a-4f5e-a1d9-8799192e6e78 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:34.955874 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2bd8a-b148-4698-bff8-af5bc8086d12 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:34.962591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66995a1a-466d-43be-a02b-e0c8d6915ebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:34.963281 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995a1a-466d-43be-a02b-e0c8d6915ebf service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:34.963586 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995a1a-466d-43be-a02b-e0c8d6915ebf service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:34.963876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995a1a-466d-43be-a02b-e0c8d6915ebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:34.965887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-66995a1a-466d-43be-a02b-e0c8d6915ebf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:34.971088 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1150/2286] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:34 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:34.979559 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeb0f2-6c0a-4f5e-a1d9-8799192e6e78 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:34.990273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeb0f2-6c0a-4f5e-a1d9-8799192e6e78 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:34.995367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3b6da-a977-4cc7-b39f-ff8e51e93367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:34.996430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3b6da-a977-4cc7-b39f-ff8e51e93367 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:34.996731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3b6da-a977-4cc7-b39f-ff8e51e93367 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:34.997013 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3b6da-a977-4cc7-b39f-ff8e51e93367 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:34.997753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3b6da-a977-4cc7-b39f-ff8e51e93367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:34.999416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3b6da-a977-4cc7-b39f-ff8e51e93367 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:35.013671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1151/2287] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:35.014973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3b6da-a977-4cc7-b39f-ff8e51e93367 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:35.025553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3b6da-a977-4cc7-b39f-ff8e51e93367 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:35.029053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66995a1a-466d-43be-a02b-e0c8d6915ebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:35.030397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac26927-3cad-4422-b2b8-db01e41c2b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:35.030669 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66995a1a-466d-43be-a02b-e0c8d6915ebf service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:35.031311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac26927-3cad-4422-b2b8-db01e41c2b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:35.031599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac26927-3cad-4422-b2b8-db01e41c2b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:35.031878 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac26927-3cad-4422-b2b8-db01e41c2b98 admin admin] PATH_INFO: `/v3/projects/fc399abd838e43f193550bcbb4c9ac5e/users/b3468f2dd2b74fb28989f7b982200cc1/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:35.040741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1137/2288] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:54:35.047811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac26927-3cad-4422-b2b8-db01e41c2b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc399abd838e43f193550bcbb4c9ac5e, user_id=b3468f2dd2b74fb28989f7b982200cc1, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:35.050570 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac26927-3cad-4422-b2b8-db01e41c2b98 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:35.067415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1152/2289] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:35 2022] PUT /identity/v3/projects/fc399abd838e43f193550bcbb4c9ac5e/users/b3468f2dd2b74fb28989f7b982200cc1/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:54:35.071224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66995a1a-466d-43be-a02b-e0c8d6915ebf service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:35.082408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66995a1a-466d-43be-a02b-e0c8d6915ebf service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:35.087622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:35.141467 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cb1c0-a3c8-465e-af80-7dbe7d8c6fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:35.142173 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cb1c0-a3c8-465e-af80-7dbe7d8c6fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:35.142452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cb1c0-a3c8-465e-af80-7dbe7d8c6fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:35.142728 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cb1c0-a3c8-465e-af80-7dbe7d8c6fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:35.143499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cb1c0-a3c8-465e-af80-7dbe7d8c6fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:35.147623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cb1c0-a3c8-465e-af80-7dbe7d8c6fa3 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:35.164503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1138/2290] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:35.165842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac26927-3cad-4422-b2b8-db01e41c2b98 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:35.178813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac26927-3cad-4422-b2b8-db01e41c2b98 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:35.184805 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609547f-11a9-410d-b6e6-bc738d794b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:35.185761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609547f-11a9-410d-b6e6-bc738d794b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:35.186104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609547f-11a9-410d-b6e6-bc738d794b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:35.186385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609547f-11a9-410d-b6e6-bc738d794b60 admin admin] PATH_INFO: `/v3/projects/fc399abd838e43f193550bcbb4c9ac5e/users/b3468f2dd2b74fb28989f7b982200cc1/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:35.189018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609547f-11a9-410d-b6e6-bc738d794b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc399abd838e43f193550bcbb4c9ac5e, user_id=b3468f2dd2b74fb28989f7b982200cc1, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:35.192123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609547f-11a9-410d-b6e6-bc738d794b60 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:35.205102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1153/2291] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:35 2022] PUT /identity/v3/projects/fc399abd838e43f193550bcbb4c9ac5e/users/b3468f2dd2b74fb28989f7b982200cc1/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:35.216002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9f824-fd0b-48e2-86ab-2f8f70a843e4 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:35.216315 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9f824-fd0b-48e2-86ab-2f8f70a843e4 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:35.216597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9f824-fd0b-48e2-86ab-2f8f70a843e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:35.251390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-cba9f824-fd0b-48e2-86ab-2f8f70a843e4 None None] MFA Rules not processed for user `b3468f2dd2b74fb28989f7b982200cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:35.256469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cba9f824-fd0b-48e2-86ab-2f8f70a843e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:35.343777 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1139/2292] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:35.366266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609547f-11a9-410d-b6e6-bc738d794b60 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:35.368037 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0609547f-11a9-410d-b6e6-bc738d794b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:35.444110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609547f-11a9-410d-b6e6-bc738d794b60 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:35.448424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ec971-0511-4e1d-94e0-2a11f9621caf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:35.448939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ec971-0511-4e1d-94e0-2a11f9621caf service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:35.449265 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ec971-0511-4e1d-94e0-2a11f9621caf service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:35.450257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ec971-0511-4e1d-94e0-2a11f9621caf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:35.460041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ec971-0511-4e1d-94e0-2a11f9621caf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:35.461757 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ec971-0511-4e1d-94e0-2a11f9621caf service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:35.472580 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1154/2293] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:35.504473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9f824-fd0b-48e2-86ab-2f8f70a843e4 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:35.572975 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9f824-fd0b-48e2-86ab-2f8f70a843e4 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:35.578095 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375c510-c96f-470e-b143-1d7cb5108a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:35.578995 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375c510-c96f-470e-b143-1d7cb5108a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:35.579277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375c510-c96f-470e-b143-1d7cb5108a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:35.579553 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375c510-c96f-470e-b143-1d7cb5108a8e admin admin] PATH_INFO: `/v3/users/5cf55749fb3942dd926632b2406e6c8a` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:35.580823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375c510-c96f-470e-b143-1d7cb5108a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf55749fb3942dd926632b2406e6c8a)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:35.583014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375c510-c96f-470e-b143-1d7cb5108a8e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:35.622325 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:35.641769 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3375c510-c96f-470e-b143-1d7cb5108a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf55749fb3942dd926632b2406e6c8a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:35.656072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3375c510-c96f-470e-b143-1d7cb5108a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf55749fb3942dd926632b2406e6c8a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:35.663286 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3375c510-c96f-470e-b143-1d7cb5108a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf55749fb3942dd926632b2406e6c8a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:35.664038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3375c510-c96f-470e-b143-1d7cb5108a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf55749fb3942dd926632b2406e6c8a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:35.664693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3375c510-c96f-470e-b143-1d7cb5108a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf55749fb3942dd926632b2406e6c8a'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:35.678013 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1140/2294] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:35 2022] DELETE /identity/v3/users/5cf55749fb3942dd926632b2406e6c8a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:35.682632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fb233-2686-42eb-88ff-4a6eba1a42a9 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:35.683171 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fb233-2686-42eb-88ff-4a6eba1a42a9 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:35.683265 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fb233-2686-42eb-88ff-4a6eba1a42a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:35.701581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-655fb233-2686-42eb-88ff-4a6eba1a42a9 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:35.702832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-655fb233-2686-42eb-88ff-4a6eba1a42a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:35.766613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1155/2295] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:35.776756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375c510-c96f-470e-b143-1d7cb5108a8e admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:35.778387 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3375c510-c96f-470e-b143-1d7cb5108a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:35.841576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375c510-c96f-470e-b143-1d7cb5108a8e admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:35.845898 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34651950-270c-4117-8681-c1e91f48023e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:35.846561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34651950-270c-4117-8681-c1e91f48023e service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:35.846981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34651950-270c-4117-8681-c1e91f48023e service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:35.847258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34651950-270c-4117-8681-c1e91f48023e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:35.857711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34651950-270c-4117-8681-c1e91f48023e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:35.859234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34651950-270c-4117-8681-c1e91f48023e service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:35.869455 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1141/2296] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:36.167739 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fb233-2686-42eb-88ff-4a6eba1a42a9 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:36.169224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-655fb233-2686-42eb-88ff-4a6eba1a42a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:36.182099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fb233-2686-42eb-88ff-4a6eba1a42a9 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:36.188496 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:36.189369 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:36.189666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:36.189941 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] PATH_INFO: `/v3/projects/8082b142f95d4ea2a9a34b4586f4de09` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:36.191339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8082b142f95d4ea2a9a34b4586f4de09)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:36.193536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:36.233877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:36.246943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8082b142f95d4ea2a9a34b4586f4de09', 'request_id': 'req-92a396e6-d24b-4647-9559-ab52063056cd'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.256681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8082b142f95d4ea2a9a34b4586f4de09', 'request_id': 'req-92a396e6-d24b-4647-9559-ab52063056cd'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.263075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8082b142f95d4ea2a9a34b4586f4de09', 'request_id': 'req-92a396e6-d24b-4647-9559-ab52063056cd'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.273445 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] The token cache is being invalidate because project 8082b142f95d4ea2a9a34b4586f4de09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:36.273728 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.274394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.276028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1156/2297] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:36 2022] DELETE /identity/v3/projects/8082b142f95d4ea2a9a34b4586f4de09 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:36.280021 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34651950-270c-4117-8681-c1e91f48023e service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:36.289817 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34651950-270c-4117-8681-c1e91f48023e service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:36.350805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195712e8-ffea-4dac-83eb-23a36bb19cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:36.351720 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195712e8-ffea-4dac-83eb-23a36bb19cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:36.352006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195712e8-ffea-4dac-83eb-23a36bb19cef admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:36.352277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195712e8-ffea-4dac-83eb-23a36bb19cef admin admin] PATH_INFO: `/v3/users/b3468f2dd2b74fb28989f7b982200cc1` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:36.353480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195712e8-ffea-4dac-83eb-23a36bb19cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3468f2dd2b74fb28989f7b982200cc1)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:36.355501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195712e8-ffea-4dac-83eb-23a36bb19cef admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:36.414791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-195712e8-ffea-4dac-83eb-23a36bb19cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3468f2dd2b74fb28989f7b982200cc1'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.420537 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:36.429633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-195712e8-ffea-4dac-83eb-23a36bb19cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3468f2dd2b74fb28989f7b982200cc1'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.437499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-195712e8-ffea-4dac-83eb-23a36bb19cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3468f2dd2b74fb28989f7b982200cc1'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.438221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-195712e8-ffea-4dac-83eb-23a36bb19cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3468f2dd2b74fb28989f7b982200cc1'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.438890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-195712e8-ffea-4dac-83eb-23a36bb19cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3468f2dd2b74fb28989f7b982200cc1'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.456860 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1142/2298] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:36 2022] DELETE /identity/v3/users/b3468f2dd2b74fb28989f7b982200cc1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:36.779431 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:36.781645 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:36.800838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a396e6-d24b-4647-9559-ab52063056cd admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:36.879541 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790917c5-981b-4e1f-bab7-a8660cda36eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:36.880343 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790917c5-981b-4e1f-bab7-a8660cda36eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:36.880630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790917c5-981b-4e1f-bab7-a8660cda36eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:36.880906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790917c5-981b-4e1f-bab7-a8660cda36eb admin admin] PATH_INFO: `/v3/projects/fc399abd838e43f193550bcbb4c9ac5e` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:36.882132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790917c5-981b-4e1f-bab7-a8660cda36eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc399abd838e43f193550bcbb4c9ac5e)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:36.884105 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790917c5-981b-4e1f-bab7-a8660cda36eb admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:36.944141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-790917c5-981b-4e1f-bab7-a8660cda36eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc399abd838e43f193550bcbb4c9ac5e', 'request_id': 'req-790917c5-981b-4e1f-bab7-a8660cda36eb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.953722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-790917c5-981b-4e1f-bab7-a8660cda36eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc399abd838e43f193550bcbb4c9ac5e', 'request_id': 'req-790917c5-981b-4e1f-bab7-a8660cda36eb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.961310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-790917c5-981b-4e1f-bab7-a8660cda36eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc399abd838e43f193550bcbb4c9ac5e', 'request_id': 'req-790917c5-981b-4e1f-bab7-a8660cda36eb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.972473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-790917c5-981b-4e1f-bab7-a8660cda36eb admin admin] The token cache is being invalidate because project fc399abd838e43f193550bcbb4c9ac5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:36.972859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-790917c5-981b-4e1f-bab7-a8660cda36eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.973510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-790917c5-981b-4e1f-bab7-a8660cda36eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:36.975394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1157/2299] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:36 2022] DELETE /identity/v3/projects/fc399abd838e43f193550bcbb4c9ac5e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:36.980308 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ac97e-cd3c-4327-a9d5-08883bc46124 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:36.980598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ac97e-cd3c-4327-a9d5-08883bc46124 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:36.980930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ac97e-cd3c-4327-a9d5-08883bc46124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.006297 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-da4ac97e-cd3c-4327-a9d5-08883bc46124 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:37.007963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-da4ac97e-cd3c-4327-a9d5-08883bc46124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:37.083488 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1143/2300] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:37.093482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde2dd7-0a4f-472c-879c-578ae553a4f6 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:37.093624 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde2dd7-0a4f-472c-879c-578ae553a4f6 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:37.093896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde2dd7-0a4f-472c-879c-578ae553a4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.113405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-8fde2dd7-0a4f-472c-879c-578ae553a4f6 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:37.114610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8fde2dd7-0a4f-472c-879c-578ae553a4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:37.125642 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1158/2301] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:37.127889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ac97e-cd3c-4327-a9d5-08883bc46124 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:37.137810 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ac97e-cd3c-4327-a9d5-08883bc46124 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:37.142294 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e3cd8-87f1-4965-8375-339275c3a172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:37.143001 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e3cd8-87f1-4965-8375-339275c3a172 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:37.143290 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e3cd8-87f1-4965-8375-339275c3a172 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:37.143563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e3cd8-87f1-4965-8375-339275c3a172 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.144331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e3cd8-87f1-4965-8375-339275c3a172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:54:37.144694 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e3cd8-87f1-4965-8375-339275c3a172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:37.146323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e3cd8-87f1-4965-8375-339275c3a172 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:37.161829 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1144/2302] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:54:37.163080 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde2dd7-0a4f-472c-879c-578ae553a4f6 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:37.172486 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde2dd7-0a4f-472c-879c-578ae553a4f6 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:37.177265 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23311a-ebda-495b-8894-197b0d63462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:37.177944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23311a-ebda-495b-8894-197b0d63462c admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:37.178220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23311a-ebda-495b-8894-197b0d63462c admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:37.178495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23311a-ebda-495b-8894-197b0d63462c admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.179219 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23311a-ebda-495b-8894-197b0d63462c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:37.181114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23311a-ebda-495b-8894-197b0d63462c admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:37.211404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1159/2303] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:37 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:37.215912 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e3cd8-87f1-4965-8375-339275c3a172 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:37.228058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e3cd8-87f1-4965-8375-339275c3a172 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:37.285784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5d610-a63e-4a0b-aac6-7597e7e80df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:37.286456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d610-a63e-4a0b-aac6-7597e7e80df1 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:37.286731 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d610-a63e-4a0b-aac6-7597e7e80df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:37.287033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d610-a63e-4a0b-aac6-7597e7e80df1 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.287742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5d610-a63e-4a0b-aac6-7597e7e80df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:37.289684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5d610-a63e-4a0b-aac6-7597e7e80df1 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:37.310875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1145/2304] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:37 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:54:37.315290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23311a-ebda-495b-8894-197b0d63462c admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:37.326839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23311a-ebda-495b-8894-197b0d63462c admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:37.332574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335d7f-8377-478d-8589-944419193676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:37.333240 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335d7f-8377-478d-8589-944419193676 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:37.333519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335d7f-8377-478d-8589-944419193676 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:37.333792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335d7f-8377-478d-8589-944419193676 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.334532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da335d7f-8377-478d-8589-944419193676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:37.336205 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da335d7f-8377-478d-8589-944419193676 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:37.347220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1160/2305] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:37.351418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5d610-a63e-4a0b-aac6-7597e7e80df1 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:37.362189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5d610-a63e-4a0b-aac6-7597e7e80df1 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:37.367285 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68cb95-b93d-4044-82c6-92135d379a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:37.367948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68cb95-b93d-4044-82c6-92135d379a39 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:37.368229 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68cb95-b93d-4044-82c6-92135d379a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:37.368506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68cb95-b93d-4044-82c6-92135d379a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.369245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68cb95-b93d-4044-82c6-92135d379a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:37.370902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68cb95-b93d-4044-82c6-92135d379a39 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:37.381257 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1146/2306] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:37.385447 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335d7f-8377-478d-8589-944419193676 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:37.396029 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335d7f-8377-478d-8589-944419193676 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:37.401447 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fc258-ecf4-468c-b25e-47cdcd3b1325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:37.402328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fc258-ecf4-468c-b25e-47cdcd3b1325 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:37.402638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fc258-ecf4-468c-b25e-47cdcd3b1325 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:37.402941 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fc258-ecf4-468c-b25e-47cdcd3b1325 admin admin] PATH_INFO: `/v3/projects/ebea63c26658445ba271ebe606e6bdc3/users/f754258106ae4e5e9f019651b7bf4ea2/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.414704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:37.419445 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fc258-ecf4-468c-b25e-47cdcd3b1325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebea63c26658445ba271ebe606e6bdc3, user_id=f754258106ae4e5e9f019651b7bf4ea2, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:37.422782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fc258-ecf4-468c-b25e-47cdcd3b1325 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:37.439450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1161/2307] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:37 2022] PUT /identity/v3/projects/ebea63c26658445ba271ebe606e6bdc3/users/f754258106ae4e5e9f019651b7bf4ea2/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:37.450522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69449-fd44-4386-b9eb-64390d587d7d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:37.450873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69449-fd44-4386-b9eb-64390d587d7d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:37.451156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69449-fd44-4386-b9eb-64390d587d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.480902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-8be69449-fd44-4386-b9eb-64390d587d7d None None] MFA Rules not processed for user `f754258106ae4e5e9f019651b7bf4ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:37.482127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8be69449-fd44-4386-b9eb-64390d587d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:37.509386 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:37.550690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1147/2308] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:37.555404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fc258-ecf4-468c-b25e-47cdcd3b1325 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:37.618979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fc258-ecf4-468c-b25e-47cdcd3b1325 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:37.624898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c988c8d-8968-47cc-99f6-7d45d5bf87ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:37.625572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c988c8d-8968-47cc-99f6-7d45d5bf87ea admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:37.625854 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c988c8d-8968-47cc-99f6-7d45d5bf87ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:37.626133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c988c8d-8968-47cc-99f6-7d45d5bf87ea admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.626860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c988c8d-8968-47cc-99f6-7d45d5bf87ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:37.628809 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c988c8d-8968-47cc-99f6-7d45d5bf87ea admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:37.668593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1162/2309] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:37 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:37.671215 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be69449-fd44-4386-b9eb-64390d587d7d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:37.683613 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be69449-fd44-4386-b9eb-64390d587d7d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:37.752478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df618086-c0db-4258-94cd-07323c41e1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:37.753159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618086-c0db-4258-94cd-07323c41e1ea admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:37.753477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618086-c0db-4258-94cd-07323c41e1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:37.753705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618086-c0db-4258-94cd-07323c41e1ea admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.754627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df618086-c0db-4258-94cd-07323c41e1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:37.756733 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df618086-c0db-4258-94cd-07323c41e1ea admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:37.780904 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1148/2310] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:37 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:37.785261 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c988c8d-8968-47cc-99f6-7d45d5bf87ea admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:37.795965 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c988c8d-8968-47cc-99f6-7d45d5bf87ea admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:37.801081 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258999d-f5b9-4cf3-adf4-45b462c605f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:37.801715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258999d-f5b9-4cf3-adf4-45b462c605f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:37.801998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258999d-f5b9-4cf3-adf4-45b462c605f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:37.802273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258999d-f5b9-4cf3-adf4-45b462c605f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.803047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258999d-f5b9-4cf3-adf4-45b462c605f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:37.804637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258999d-f5b9-4cf3-adf4-45b462c605f2 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:37.815436 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1163/2311] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:37.820278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df618086-c0db-4258-94cd-07323c41e1ea admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:37.835058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df618086-c0db-4258-94cd-07323c41e1ea admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:37.840338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6028866-4577-4f26-a1f9-17a2a81fec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:37.841225 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6028866-4577-4f26-a1f9-17a2a81fec35 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:37.841506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6028866-4577-4f26-a1f9-17a2a81fec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:37.841888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6028866-4577-4f26-a1f9-17a2a81fec35 admin admin] PATH_INFO: `/v3/projects/b1ab039ce107478cb598dd79f43b998d/users/874aedaaabd54d68bf3559035fa32f2f/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.859739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6028866-4577-4f26-a1f9-17a2a81fec35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ab039ce107478cb598dd79f43b998d, user_id=874aedaaabd54d68bf3559035fa32f2f, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:37.862410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6028866-4577-4f26-a1f9-17a2a81fec35 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:37.879241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1149/2312] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:37 2022] PUT /identity/v3/projects/b1ab039ce107478cb598dd79f43b998d/users/874aedaaabd54d68bf3559035fa32f2f/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:37.883671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258999d-f5b9-4cf3-adf4-45b462c605f2 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:37.893954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258999d-f5b9-4cf3-adf4-45b462c605f2 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:37.958100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cae8f-662c-4583-a530-2d73c64682ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:37.958659 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cae8f-662c-4583-a530-2d73c64682ca admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:37.958979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cae8f-662c-4583-a530-2d73c64682ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:37.959248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cae8f-662c-4583-a530-2d73c64682ca admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.959977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cae8f-662c-4583-a530-2d73c64682ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:37.961733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cae8f-662c-4583-a530-2d73c64682ca admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:37.972149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1164/2313] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:37.976474 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6028866-4577-4f26-a1f9-17a2a81fec35 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:37.986851 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6028866-4577-4f26-a1f9-17a2a81fec35 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:37.991913 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad9a32-b692-41a0-8c65-1dc6c2088de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:37.992793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad9a32-b692-41a0-8c65-1dc6c2088de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:37.993075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad9a32-b692-41a0-8c65-1dc6c2088de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:37.993349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad9a32-b692-41a0-8c65-1dc6c2088de9 admin admin] PATH_INFO: `/v3/projects/b1ab039ce107478cb598dd79f43b998d/users/874aedaaabd54d68bf3559035fa32f2f/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:37.995406 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad9a32-b692-41a0-8c65-1dc6c2088de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ab039ce107478cb598dd79f43b998d, user_id=874aedaaabd54d68bf3559035fa32f2f, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:37.998076 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad9a32-b692-41a0-8c65-1dc6c2088de9 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:38.008595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1150/2314] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:37 2022] PUT /identity/v3/projects/b1ab039ce107478cb598dd79f43b998d/users/874aedaaabd54d68bf3559035fa32f2f/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:38.020263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0beaa5-0051-47d8-a5b0-ba190b5ec04d None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:38.020551 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0beaa5-0051-47d8-a5b0-ba190b5ec04d None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:38.020824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0beaa5-0051-47d8-a5b0-ba190b5ec04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:38.048585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-1d0beaa5-0051-47d8-a5b0-ba190b5ec04d None None] MFA Rules not processed for user `874aedaaabd54d68bf3559035fa32f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:38.049780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1d0beaa5-0051-47d8-a5b0-ba190b5ec04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:38.101039 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:38.124730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1165/2315] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:38.137928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad9a32-b692-41a0-8c65-1dc6c2088de9 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:38.139992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-34ad9a32-b692-41a0-8c65-1dc6c2088de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:38.198228 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad9a32-b692-41a0-8c65-1dc6c2088de9 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:38.202744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7611615-5868-437d-b2f5-b5e17d00c189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:38.203418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7611615-5868-437d-b2f5-b5e17d00c189 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:38.203702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7611615-5868-437d-b2f5-b5e17d00c189 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:38.203967 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7611615-5868-437d-b2f5-b5e17d00c189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:38.213746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7611615-5868-437d-b2f5-b5e17d00c189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:38.215160 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7611615-5868-437d-b2f5-b5e17d00c189 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:38.224816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1151/2316] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:38.545918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0beaa5-0051-47d8-a5b0-ba190b5ec04d None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:38.555925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0beaa5-0051-47d8-a5b0-ba190b5ec04d None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:38.560886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439684fa-3cf4-45d4-8620-aa0f78e301c1 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874aedaaabd54d68bf3559035fa32f2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1ab039ce107478cb598dd79f43b998d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:38.561548 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439684fa-3cf4-45d4-8620-aa0f78e301c1 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:38.561837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439684fa-3cf4-45d4-8620-aa0f78e301c1 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:38.562162 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439684fa-3cf4-45d4-8620-aa0f78e301c1 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:38.562942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439684fa-3cf4-45d4-8620-aa0f78e301c1 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:54:38.563517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439684fa-3cf4-45d4-8620-aa0f78e301c1 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:38.565104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439684fa-3cf4-45d4-8620-aa0f78e301c1 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:38.577285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1166/2317] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:54:38.581456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7611615-5868-437d-b2f5-b5e17d00c189 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:38.591692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7611615-5868-437d-b2f5-b5e17d00c189 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:38.596564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c206913-f883-4b29-bfb8-3a6bd177b344 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874aedaaabd54d68bf3559035fa32f2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1ab039ce107478cb598dd79f43b998d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:38.597216 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c206913-f883-4b29-bfb8-3a6bd177b344 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:38.597600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c206913-f883-4b29-bfb8-3a6bd177b344 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:38.597889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c206913-f883-4b29-bfb8-3a6bd177b344 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:38.598580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c206913-f883-4b29-bfb8-3a6bd177b344 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:38.600542 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c206913-f883-4b29-bfb8-3a6bd177b344 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:38.622135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:38.630456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1152/2318] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:38 2022] POST /identity/v3/projects => generated 354 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:38.634564 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439684fa-3cf4-45d4-8620-aa0f78e301c1 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:38.648869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439684fa-3cf4-45d4-8620-aa0f78e301c1 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:38.711393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6297d-7b91-413c-89ad-c32a8ef45992 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874aedaaabd54d68bf3559035fa32f2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1ab039ce107478cb598dd79f43b998d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:38.712079 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6297d-7b91-413c-89ad-c32a8ef45992 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:38.712369 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6297d-7b91-413c-89ad-c32a8ef45992 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:38.712649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6297d-7b91-413c-89ad-c32a8ef45992 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:38.713388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6297d-7b91-413c-89ad-c32a8ef45992 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:54:38.713707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6297d-7b91-413c-89ad-c32a8ef45992 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:38.715359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6297d-7b91-413c-89ad-c32a8ef45992 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:38.727862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1167/2319] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:54:38.766059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c206913-f883-4b29-bfb8-3a6bd177b344 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:38.777968 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c206913-f883-4b29-bfb8-3a6bd177b344 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:38.783402 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9ecd0-2836-4cee-a26e-69c9b1352251 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874aedaaabd54d68bf3559035fa32f2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1ab039ce107478cb598dd79f43b998d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:38.784270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9ecd0-2836-4cee-a26e-69c9b1352251 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:38.784563 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9ecd0-2836-4cee-a26e-69c9b1352251 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:38.784840 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9ecd0-2836-4cee-a26e-69c9b1352251 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] PATH_INFO: `/v3/projects/85a3cf8d2f98449e8e732092a342fdf5` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:38.786702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9ecd0-2836-4cee-a26e-69c9b1352251 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] RBAC: Authorizing `identity:delete_project(project_id=85a3cf8d2f98449e8e732092a342fdf5)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:38.788706 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9ecd0-2836-4cee-a26e-69c9b1352251 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:38.843171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8ad9ecd0-2836-4cee-a26e-69c9b1352251 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a3cf8d2f98449e8e732092a342fdf5', 'request_id': 'req-8ad9ecd0-2836-4cee-a26e-69c9b1352251'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:38.852265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8ad9ecd0-2836-4cee-a26e-69c9b1352251 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a3cf8d2f98449e8e732092a342fdf5', 'request_id': 'req-8ad9ecd0-2836-4cee-a26e-69c9b1352251'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:38.858626 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8ad9ecd0-2836-4cee-a26e-69c9b1352251 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a3cf8d2f98449e8e732092a342fdf5', 'request_id': 'req-8ad9ecd0-2836-4cee-a26e-69c9b1352251'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:38.870672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8ad9ecd0-2836-4cee-a26e-69c9b1352251 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] The token cache is being invalidate because project 85a3cf8d2f98449e8e732092a342fdf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:38.870990 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8ad9ecd0-2836-4cee-a26e-69c9b1352251 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:38.871723 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8ad9ecd0-2836-4cee-a26e-69c9b1352251 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:38.873391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1153/2320] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:38 2022] DELETE /identity/v3/projects/85a3cf8d2f98449e8e732092a342fdf5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:39.085116 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6297d-7b91-413c-89ad-c32a8ef45992 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:39.086991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-82f6297d-7b91-413c-89ad-c32a8ef45992 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:39.153081 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6297d-7b91-413c-89ad-c32a8ef45992 tempest-VolumeQuotaClassesTest-1650623671 tempest-VolumeQuotaClassesTest-1650623671-project-admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:39.212526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5c600-fdaa-40f2-82ba-b9d1d8ee5b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:39.213425 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5c600-fdaa-40f2-82ba-b9d1d8ee5b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:39.213702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5c600-fdaa-40f2-82ba-b9d1d8ee5b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:39.213962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5c600-fdaa-40f2-82ba-b9d1d8ee5b05 admin admin] PATH_INFO: `/v3/users/f754258106ae4e5e9f019651b7bf4ea2` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:39.215263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5c600-fdaa-40f2-82ba-b9d1d8ee5b05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f754258106ae4e5e9f019651b7bf4ea2)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:39.217200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5c600-fdaa-40f2-82ba-b9d1d8ee5b05 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:39.232128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:39.269739 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-71d5c600-fdaa-40f2-82ba-b9d1d8ee5b05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f754258106ae4e5e9f019651b7bf4ea2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:39.281264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-71d5c600-fdaa-40f2-82ba-b9d1d8ee5b05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f754258106ae4e5e9f019651b7bf4ea2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:39.281940 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-71d5c600-fdaa-40f2-82ba-b9d1d8ee5b05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f754258106ae4e5e9f019651b7bf4ea2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:39.289299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-71d5c600-fdaa-40f2-82ba-b9d1d8ee5b05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f754258106ae4e5e9f019651b7bf4ea2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:39.289946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-71d5c600-fdaa-40f2-82ba-b9d1d8ee5b05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f754258106ae4e5e9f019651b7bf4ea2'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:39.302926 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1168/2321] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:39 2022] DELETE /identity/v3/users/f754258106ae4e5e9f019651b7bf4ea2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:39.307438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee021f1-707d-4a85-961d-15704357ee61 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:39.307729 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee021f1-707d-4a85-961d-15704357ee61 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:39.308008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee021f1-707d-4a85-961d-15704357ee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:39.327118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-aee021f1-707d-4a85-961d-15704357ee61 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:39.328433 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-aee021f1-707d-4a85-961d-15704357ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:39.399994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1154/2322] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:39.411333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5c600-fdaa-40f2-82ba-b9d1d8ee5b05 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:39.413061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-71d5c600-fdaa-40f2-82ba-b9d1d8ee5b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:39.484816 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5c600-fdaa-40f2-82ba-b9d1d8ee5b05 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:39.488596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447080d-4a9e-4c65-b60d-44fc1e9e1ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:39.489226 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447080d-4a9e-4c65-b60d-44fc1e9e1ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:39.489500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447080d-4a9e-4c65-b60d-44fc1e9e1ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:39.489902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447080d-4a9e-4c65-b60d-44fc1e9e1ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:39.499286 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447080d-4a9e-4c65-b60d-44fc1e9e1ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:39.500755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447080d-4a9e-4c65-b60d-44fc1e9e1ce9 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:39.511980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1169/2323] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:39.797928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee021f1-707d-4a85-961d-15704357ee61 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:39.799652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-aee021f1-707d-4a85-961d-15704357ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:39.813124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee021f1-707d-4a85-961d-15704357ee61 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:39.820851 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:39.821844 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:39.822226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:39.823027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] PATH_INFO: `/v3/projects/ebea63c26658445ba271ebe606e6bdc3` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:39.824004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebea63c26658445ba271ebe606e6bdc3)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:39.826549 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:39.889992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebea63c26658445ba271ebe606e6bdc3', 'request_id': 'req-7fbf4439-c803-42da-a8b2-bef2deb87cb2'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:39.899848 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebea63c26658445ba271ebe606e6bdc3', 'request_id': 'req-7fbf4439-c803-42da-a8b2-bef2deb87cb2'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:39.907073 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebea63c26658445ba271ebe606e6bdc3', 'request_id': 'req-7fbf4439-c803-42da-a8b2-bef2deb87cb2'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:39.919020 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] The token cache is being invalidate because project ebea63c26658445ba271ebe606e6bdc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:39.919418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:39.920070 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:39.921638 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1155/2324] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:39 2022] DELETE /identity/v3/projects/ebea63c26658445ba271ebe606e6bdc3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:39.925994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447080d-4a9e-4c65-b60d-44fc1e9e1ce9 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:39.936419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447080d-4a9e-4c65-b60d-44fc1e9e1ce9 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:40.006720 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338ac99-c1a7-4e63-8d99-fae566f8f9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:40.008259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338ac99-c1a7-4e63-8d99-fae566f8f9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:40.008735 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338ac99-c1a7-4e63-8d99-fae566f8f9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:40.009149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338ac99-c1a7-4e63-8d99-fae566f8f9c1 admin admin] PATH_INFO: `/v3/users/874aedaaabd54d68bf3559035fa32f2f` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:40.011957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338ac99-c1a7-4e63-8d99-fae566f8f9c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=874aedaaabd54d68bf3559035fa32f2f)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:40.015129 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338ac99-c1a7-4e63-8d99-fae566f8f9c1 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:40.071692 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:40.088104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5338ac99-c1a7-4e63-8d99-fae566f8f9c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '874aedaaabd54d68bf3559035fa32f2f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:40.104602 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5338ac99-c1a7-4e63-8d99-fae566f8f9c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '874aedaaabd54d68bf3559035fa32f2f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:40.105382 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5338ac99-c1a7-4e63-8d99-fae566f8f9c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '874aedaaabd54d68bf3559035fa32f2f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:40.113248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5338ac99-c1a7-4e63-8d99-fae566f8f9c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '874aedaaabd54d68bf3559035fa32f2f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:40.113975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5338ac99-c1a7-4e63-8d99-fae566f8f9c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '874aedaaabd54d68bf3559035fa32f2f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:40.129817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1170/2325] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:39 2022] DELETE /identity/v3/users/874aedaaabd54d68bf3559035fa32f2f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:54:40.470449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:40.473135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:40.505954 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf4439-c803-42da-a8b2-bef2deb87cb2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:40.513597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:40.584569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cef31-b5e2-499a-98d6-c317c55c00cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:40.585772 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cef31-b5e2-499a-98d6-c317c55c00cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:40.586054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cef31-b5e2-499a-98d6-c317c55c00cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:40.586332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cef31-b5e2-499a-98d6-c317c55c00cd admin admin] PATH_INFO: `/v3/projects/b1ab039ce107478cb598dd79f43b998d` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:40.587699 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cef31-b5e2-499a-98d6-c317c55c00cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ab039ce107478cb598dd79f43b998d)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:40.589680 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cef31-b5e2-499a-98d6-c317c55c00cd admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:40.595199 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338ac99-c1a7-4e63-8d99-fae566f8f9c1 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:40.596587 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5338ac99-c1a7-4e63-8d99-fae566f8f9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:40.650049 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4a6cef31-b5e2-499a-98d6-c317c55c00cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ab039ce107478cb598dd79f43b998d', 'request_id': 'req-4a6cef31-b5e2-499a-98d6-c317c55c00cd'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:40.661362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4a6cef31-b5e2-499a-98d6-c317c55c00cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ab039ce107478cb598dd79f43b998d', 'request_id': 'req-4a6cef31-b5e2-499a-98d6-c317c55c00cd'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:40.669871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4a6cef31-b5e2-499a-98d6-c317c55c00cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ab039ce107478cb598dd79f43b998d', 'request_id': 'req-4a6cef31-b5e2-499a-98d6-c317c55c00cd'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:40.683357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4a6cef31-b5e2-499a-98d6-c317c55c00cd admin admin] The token cache is being invalidate because project b1ab039ce107478cb598dd79f43b998d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:40.684037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4a6cef31-b5e2-499a-98d6-c317c55c00cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:40.684935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4a6cef31-b5e2-499a-98d6-c317c55c00cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:40.687259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1156/2326] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:40 2022] DELETE /identity/v3/projects/b1ab039ce107478cb598dd79f43b998d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:40.691972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eab7b3-90d1-43a5-9894-4d735eae3cf5 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:40.692636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eab7b3-90d1-43a5-9894-4d735eae3cf5 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:40.693141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eab7b3-90d1-43a5-9894-4d735eae3cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:40.715526 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e0eab7b3-90d1-43a5-9894-4d735eae3cf5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:40.717168 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e0eab7b3-90d1-43a5-9894-4d735eae3cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:40.717653 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338ac99-c1a7-4e63-8d99-fae566f8f9c1 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:40.828379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e5ef8-5507-4aa0-af7f-ec926e275e4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:40.841255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e5ef8-5507-4aa0-af7f-ec926e275e4c service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:40.847049 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e5ef8-5507-4aa0-af7f-ec926e275e4c service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:40.847049 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e5ef8-5507-4aa0-af7f-ec926e275e4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:40.847049 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a01e5ef8-5507-4aa0-af7f-ec926e275e4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:40.858744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1157/2327] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:54:40.862132 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de548bc-b47f-40c3-80b5-82039bb82016 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:40.862466 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de548bc-b47f-40c3-80b5-82039bb82016 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:40.862846 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de548bc-b47f-40c3-80b5-82039bb82016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:40.886092 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e5ef8-5507-4aa0-af7f-ec926e275e4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:40.888192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e5ef8-5507-4aa0-af7f-ec926e275e4c service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:40.903010 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-9de548bc-b47f-40c3-80b5-82039bb82016 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:40.904365 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9de548bc-b47f-40c3-80b5-82039bb82016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:40.922171 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1171/2328] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:40.933714 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1158/2329] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:40.937768 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e5ef8-5507-4aa0-af7f-ec926e275e4c service nova] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:40.950877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e5ef8-5507-4aa0-af7f-ec926e275e4c service nova] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:40.958850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d018c-3f79-457f-ba55-653811f472fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:40.959658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d018c-3f79-457f-ba55-653811f472fb admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:40.959932 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d018c-3f79-457f-ba55-653811f472fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:40.960256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d018c-3f79-457f-ba55-653811f472fb admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:40.960964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d018c-3f79-457f-ba55-653811f472fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:54:40.961582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d018c-3f79-457f-ba55-653811f472fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:40.963040 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d018c-3f79-457f-ba55-653811f472fb admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:40.978584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1172/2330] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:54:40.983489 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de548bc-b47f-40c3-80b5-82039bb82016 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:40.998400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de548bc-b47f-40c3-80b5-82039bb82016 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:41.004659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d833c50-92db-4f7c-94cd-22e34be9de96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:41.005534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d833c50-92db-4f7c-94cd-22e34be9de96 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:41.005815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d833c50-92db-4f7c-94cd-22e34be9de96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:41.006111 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d833c50-92db-4f7c-94cd-22e34be9de96 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:41.006841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d833c50-92db-4f7c-94cd-22e34be9de96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:41.008922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d833c50-92db-4f7c-94cd-22e34be9de96 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:41.044048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1159/2331] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:40 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:41.048441 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d018c-3f79-457f-ba55-653811f472fb admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:41.059184 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d018c-3f79-457f-ba55-653811f472fb admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:41.092194 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:41.129368 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e018484-9b87-4a81-aa5d-89b8efd86952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:41.129919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e018484-9b87-4a81-aa5d-89b8efd86952 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:41.130197 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e018484-9b87-4a81-aa5d-89b8efd86952 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:41.130468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e018484-9b87-4a81-aa5d-89b8efd86952 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:41.131199 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e018484-9b87-4a81-aa5d-89b8efd86952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:41.133123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e018484-9b87-4a81-aa5d-89b8efd86952 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:41.155622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1173/2332] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:41 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:54:41.159819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d833c50-92db-4f7c-94cd-22e34be9de96 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:41.170809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d833c50-92db-4f7c-94cd-22e34be9de96 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:41.176898 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bf600-3db7-4708-b562-f1a0ce8f9c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:41.177601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bf600-3db7-4708-b562-f1a0ce8f9c54 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:41.177884 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bf600-3db7-4708-b562-f1a0ce8f9c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:41.178159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bf600-3db7-4708-b562-f1a0ce8f9c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:41.178940 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bf600-3db7-4708-b562-f1a0ce8f9c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:41.180692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bf600-3db7-4708-b562-f1a0ce8f9c54 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:41.183009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:41.196148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1160/2333] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:41.197442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e018484-9b87-4a81-aa5d-89b8efd86952 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:41.209143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e018484-9b87-4a81-aa5d-89b8efd86952 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:41.214006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf818a-9292-4baa-9b9b-6d516df80a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:41.214727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf818a-9292-4baa-9b9b-6d516df80a9f admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:41.215049 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf818a-9292-4baa-9b9b-6d516df80a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:41.215329 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf818a-9292-4baa-9b9b-6d516df80a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:41.216341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf818a-9292-4baa-9b9b-6d516df80a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:41.217859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf818a-9292-4baa-9b9b-6d516df80a9f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:41.229736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1174/2334] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:41.234025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bf600-3db7-4708-b562-f1a0ce8f9c54 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:41.246489 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bf600-3db7-4708-b562-f1a0ce8f9c54 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:41.252505 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168466c6-bcbd-49c7-b227-c483724e3d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:41.253632 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168466c6-bcbd-49c7-b227-c483724e3d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:41.253991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168466c6-bcbd-49c7-b227-c483724e3d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:41.254366 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168466c6-bcbd-49c7-b227-c483724e3d29 admin admin] PATH_INFO: `/v3/projects/6ca9363076d746a99f64b49e24de588c/users/d67e6b25397640dc9f096ffd90fc5bd3/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:41.278422 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168466c6-bcbd-49c7-b227-c483724e3d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca9363076d746a99f64b49e24de588c, user_id=d67e6b25397640dc9f096ffd90fc5bd3, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:41.281365 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168466c6-bcbd-49c7-b227-c483724e3d29 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:41.298729 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1161/2335] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:41 2022] PUT /identity/v3/projects/6ca9363076d746a99f64b49e24de588c/users/d67e6b25397640dc9f096ffd90fc5bd3/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:41.309451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d05a7e-c776-4a0c-9682-2b812056b35f None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:41.309744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d05a7e-c776-4a0c-9682-2b812056b35f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:41.310026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d05a7e-c776-4a0c-9682-2b812056b35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:41.341999 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-14d05a7e-c776-4a0c-9682-2b812056b35f None None] MFA Rules not processed for user `d67e6b25397640dc9f096ffd90fc5bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:41.343616 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-14d05a7e-c776-4a0c-9682-2b812056b35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:41.413272 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1175/2336] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:41.417799 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168466c6-bcbd-49c7-b227-c483724e3d29 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:41.483812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168466c6-bcbd-49c7-b227-c483724e3d29 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:41.488961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e41510-a0fe-4e40-8304-8d51f0a8632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:41.489696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e41510-a0fe-4e40-8304-8d51f0a8632d admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:41.489923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e41510-a0fe-4e40-8304-8d51f0a8632d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:41.490197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e41510-a0fe-4e40-8304-8d51f0a8632d admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:41.490947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e41510-a0fe-4e40-8304-8d51f0a8632d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:41.492894 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e41510-a0fe-4e40-8304-8d51f0a8632d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:41.524626 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1162/2337] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:41 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:41.528640 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d05a7e-c776-4a0c-9682-2b812056b35f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:41.540449 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d05a7e-c776-4a0c-9682-2b812056b35f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:41.610666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3e9cb-9d16-426e-8ef1-dc0db88e435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:41.611446 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e9cb-9d16-426e-8ef1-dc0db88e435a admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:41.611730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e9cb-9d16-426e-8ef1-dc0db88e435a admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:41.612006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e9cb-9d16-426e-8ef1-dc0db88e435a admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:41.612725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3e9cb-9d16-426e-8ef1-dc0db88e435a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:41.614777 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3e9cb-9d16-426e-8ef1-dc0db88e435a admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:41.638867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1176/2338] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:41 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:41.642131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e41510-a0fe-4e40-8304-8d51f0a8632d admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:41.655155 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e41510-a0fe-4e40-8304-8d51f0a8632d admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:41.660903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996e5f0-1f6c-488e-b8fd-2bb6fa6b4314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:41.661839 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e5f0-1f6c-488e-b8fd-2bb6fa6b4314 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:41.662204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e5f0-1f6c-488e-b8fd-2bb6fa6b4314 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:41.662488 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e5f0-1f6c-488e-b8fd-2bb6fa6b4314 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:41.663309 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996e5f0-1f6c-488e-b8fd-2bb6fa6b4314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:41.665780 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996e5f0-1f6c-488e-b8fd-2bb6fa6b4314 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:41.681666 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1163/2339] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:41.683629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3e9cb-9d16-426e-8ef1-dc0db88e435a admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:41.698918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3e9cb-9d16-426e-8ef1-dc0db88e435a admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:41.705030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa630f3-93bd-4ae0-bcf7-6061de956fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:41.715170 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa630f3-93bd-4ae0-bcf7-6061de956fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:41.715920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa630f3-93bd-4ae0-bcf7-6061de956fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:41.716401 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa630f3-93bd-4ae0-bcf7-6061de956fb6 admin admin] PATH_INFO: `/v3/projects/87536e08804e45db956dcf5ed18bf934/users/357f740708954508b8c8ed0ce1ce732c/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:41.738544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa630f3-93bd-4ae0-bcf7-6061de956fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87536e08804e45db956dcf5ed18bf934, user_id=357f740708954508b8c8ed0ce1ce732c, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:41.742267 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa630f3-93bd-4ae0-bcf7-6061de956fb6 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:41.755001 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:41.764429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1177/2340] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:41 2022] PUT /identity/v3/projects/87536e08804e45db956dcf5ed18bf934/users/357f740708954508b8c8ed0ce1ce732c/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:41.767703 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996e5f0-1f6c-488e-b8fd-2bb6fa6b4314 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:41.779781 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996e5f0-1f6c-488e-b8fd-2bb6fa6b4314 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:41.847646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3a4ec-9ea3-4bed-834d-021f897663bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:41.848341 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3a4ec-9ea3-4bed-834d-021f897663bc admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:41.848676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3a4ec-9ea3-4bed-834d-021f897663bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:41.848899 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3a4ec-9ea3-4bed-834d-021f897663bc admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:41.849643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3a4ec-9ea3-4bed-834d-021f897663bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:41.851314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3a4ec-9ea3-4bed-834d-021f897663bc admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:41.861885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1164/2341] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:41.866900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa630f3-93bd-4ae0-bcf7-6061de956fb6 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:41.877701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa630f3-93bd-4ae0-bcf7-6061de956fb6 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:41.884798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38e20-6b6c-449d-99d2-fdfbe83c676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:41.885721 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38e20-6b6c-449d-99d2-fdfbe83c676a admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:41.885992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38e20-6b6c-449d-99d2-fdfbe83c676a admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:41.886269 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38e20-6b6c-449d-99d2-fdfbe83c676a admin admin] PATH_INFO: `/v3/projects/87536e08804e45db956dcf5ed18bf934/users/357f740708954508b8c8ed0ce1ce732c/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:41.888304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f38e20-6b6c-449d-99d2-fdfbe83c676a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87536e08804e45db956dcf5ed18bf934, user_id=357f740708954508b8c8ed0ce1ce732c, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:41.891031 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f38e20-6b6c-449d-99d2-fdfbe83c676a admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:41.902118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1178/2342] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:41 2022] PUT /identity/v3/projects/87536e08804e45db956dcf5ed18bf934/users/357f740708954508b8c8ed0ce1ce732c/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:41.916054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea2f6-f28d-43e5-a900-f3479f4182de None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:41.916350 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea2f6-f28d-43e5-a900-f3479f4182de None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:41.916631 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea2f6-f28d-43e5-a900-f3479f4182de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:41.944189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-7ecea2f6-f28d-43e5-a900-f3479f4182de None None] MFA Rules not processed for user `357f740708954508b8c8ed0ce1ce732c`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:41.945437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7ecea2f6-f28d-43e5-a900-f3479f4182de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:41.978788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:42.021984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1165/2343] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:42.033843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38e20-6b6c-449d-99d2-fdfbe83c676a admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:42.036084 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-25f38e20-6b6c-449d-99d2-fdfbe83c676a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:42.099442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38e20-6b6c-449d-99d2-fdfbe83c676a admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:42.103513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29977652-dff9-48da-b8bf-ef605bdafff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:42.104165 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29977652-dff9-48da-b8bf-ef605bdafff0 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:42.104449 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29977652-dff9-48da-b8bf-ef605bdafff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:42.104723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29977652-dff9-48da-b8bf-ef605bdafff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:42.114993 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29977652-dff9-48da-b8bf-ef605bdafff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:42.116436 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29977652-dff9-48da-b8bf-ef605bdafff0 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:42.126844 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1179/2344] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:42.210305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecea2f6-f28d-43e5-a900-f3479f4182de None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:42.220302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecea2f6-f28d-43e5-a900-f3479f4182de None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:42.224429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130fa90-377f-451d-b0cb-aa8beb920e08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:42.225087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130fa90-377f-451d-b0cb-aa8beb920e08 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:42.225349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130fa90-377f-451d-b0cb-aa8beb920e08 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:42.225618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130fa90-377f-451d-b0cb-aa8beb920e08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:42.289624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130fa90-377f-451d-b0cb-aa8beb920e08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:42.291132 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130fa90-377f-451d-b0cb-aa8beb920e08 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:42.300272 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1166/2345] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:46.415015 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29977652-dff9-48da-b8bf-ef605bdafff0 service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:46.416460 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-29977652-dff9-48da-b8bf-ef605bdafff0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:46.482955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29977652-dff9-48da-b8bf-ef605bdafff0 service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:46.487166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b423a3d-d7a8-4980-b83b-73d42988b0fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:46.487823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b423a3d-d7a8-4980-b83b-73d42988b0fa service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:46.488107 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b423a3d-d7a8-4980-b83b-73d42988b0fa service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:46.488386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b423a3d-d7a8-4980-b83b-73d42988b0fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:46.490632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9b423a3d-d7a8-4980-b83b-73d42988b0fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:46.566156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b423a3d-d7a8-4980-b83b-73d42988b0fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:46.569008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b423a3d-d7a8-4980-b83b-73d42988b0fa service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:46.580485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1180/2346] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:47.149438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130fa90-377f-451d-b0cb-aa8beb920e08 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:47.161864 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130fa90-377f-451d-b0cb-aa8beb920e08 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:47.168189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44b9b2-a687-4b40-82d3-bcd3d5f15c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:47.169331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44b9b2-a687-4b40-82d3-bcd3d5f15c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:47.169884 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44b9b2-a687-4b40-82d3-bcd3d5f15c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:47.170170 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44b9b2-a687-4b40-82d3-bcd3d5f15c34 admin admin] PATH_INFO: `/v3/users/d67e6b25397640dc9f096ffd90fc5bd3` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:47.171771 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44b9b2-a687-4b40-82d3-bcd3d5f15c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67e6b25397640dc9f096ffd90fc5bd3)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:47.173789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44b9b2-a687-4b40-82d3-bcd3d5f15c34 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:47.231470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-fc44b9b2-a687-4b40-82d3-bcd3d5f15c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67e6b25397640dc9f096ffd90fc5bd3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:47.248037 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-fc44b9b2-a687-4b40-82d3-bcd3d5f15c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67e6b25397640dc9f096ffd90fc5bd3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:47.256413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-fc44b9b2-a687-4b40-82d3-bcd3d5f15c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67e6b25397640dc9f096ffd90fc5bd3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:47.257297 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-fc44b9b2-a687-4b40-82d3-bcd3d5f15c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67e6b25397640dc9f096ffd90fc5bd3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:47.257929 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-fc44b9b2-a687-4b40-82d3-bcd3d5f15c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67e6b25397640dc9f096ffd90fc5bd3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:47.277010 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1167/2347] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:47 2022] DELETE /identity/v3/users/d67e6b25397640dc9f096ffd90fc5bd3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:47.281591 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee87ce-1be0-4ec3-8266-2ba3a84984c0 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:47.281990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee87ce-1be0-4ec3-8266-2ba3a84984c0 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:47.282366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee87ce-1be0-4ec3-8266-2ba3a84984c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:47.300580 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-b0ee87ce-1be0-4ec3-8266-2ba3a84984c0 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:47.302263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b0ee87ce-1be0-4ec3-8266-2ba3a84984c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:47.339930 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:47.373427 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1181/2348] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:47.384007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44b9b2-a687-4b40-82d3-bcd3d5f15c34 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:47.387042 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-fc44b9b2-a687-4b40-82d3-bcd3d5f15c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:47.445257 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:47.467696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44b9b2-a687-4b40-82d3-bcd3d5f15c34 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:47.471627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e03096-93fe-4544-abd9-31f647a7afe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:47.472443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e03096-93fe-4544-abd9-31f647a7afe4 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:47.472853 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e03096-93fe-4544-abd9-31f647a7afe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:47.473209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e03096-93fe-4544-abd9-31f647a7afe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:47.485905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e03096-93fe-4544-abd9-31f647a7afe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:47.486986 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e03096-93fe-4544-abd9-31f647a7afe4 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:47.498500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1168/2349] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:47.818387 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee87ce-1be0-4ec3-8266-2ba3a84984c0 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:47.820462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b0ee87ce-1be0-4ec3-8266-2ba3a84984c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:47.834422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee87ce-1be0-4ec3-8266-2ba3a84984c0 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:47.840070 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:47.841050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:47.841394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:47.841735 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] PATH_INFO: `/v3/projects/6ca9363076d746a99f64b49e24de588c` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:47.843097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca9363076d746a99f64b49e24de588c)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:47.854890 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:47.908249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca9363076d746a99f64b49e24de588c', 'request_id': 'req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:47.917628 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca9363076d746a99f64b49e24de588c', 'request_id': 'req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:47.924204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca9363076d746a99f64b49e24de588c', 'request_id': 'req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:47.935831 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] The token cache is being invalidate because project 6ca9363076d746a99f64b49e24de588c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:47.936037 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:47.936683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:47.938438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1182/2350] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:47 2022] DELETE /identity/v3/projects/6ca9363076d746a99f64b49e24de588c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:47.942973 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e03096-93fe-4544-abd9-31f647a7afe4 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:47.952903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e03096-93fe-4544-abd9-31f647a7afe4 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:48.009321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a5b10-ce5a-45b5-adab-a42442c21b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:48.010207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a5b10-ce5a-45b5-adab-a42442c21b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:48.010482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a5b10-ce5a-45b5-adab-a42442c21b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:48.010749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a5b10-ce5a-45b5-adab-a42442c21b2f admin admin] PATH_INFO: `/v3/users/357f740708954508b8c8ed0ce1ce732c` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:48.012065 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a5b10-ce5a-45b5-adab-a42442c21b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=357f740708954508b8c8ed0ce1ce732c)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:48.014102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a5b10-ce5a-45b5-adab-a42442c21b2f admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:48.069951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e12a5b10-ce5a-45b5-adab-a42442c21b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '357f740708954508b8c8ed0ce1ce732c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:48.087642 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e12a5b10-ce5a-45b5-adab-a42442c21b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '357f740708954508b8c8ed0ce1ce732c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:48.095440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e12a5b10-ce5a-45b5-adab-a42442c21b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '357f740708954508b8c8ed0ce1ce732c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:48.096202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e12a5b10-ce5a-45b5-adab-a42442c21b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '357f740708954508b8c8ed0ce1ce732c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:48.096863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e12a5b10-ce5a-45b5-adab-a42442c21b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '357f740708954508b8c8ed0ce1ce732c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:48.110664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1169/2351] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:47 2022] DELETE /identity/v3/users/357f740708954508b8c8ed0ce1ce732c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:48.523957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:48.526305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:48.542450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d73d7-d733-4836-ad7e-b6fd16a0c4ab admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:48.616119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e50a7d-50aa-420b-b817-e124a5425635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:48.617199 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e50a7d-50aa-420b-b817-e124a5425635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:48.617585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e50a7d-50aa-420b-b817-e124a5425635 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:48.617977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e50a7d-50aa-420b-b817-e124a5425635 admin admin] PATH_INFO: `/v3/projects/87536e08804e45db956dcf5ed18bf934` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:48.619607 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e50a7d-50aa-420b-b817-e124a5425635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87536e08804e45db956dcf5ed18bf934)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:48.621863 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e50a7d-50aa-420b-b817-e124a5425635 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:48.697673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-01e50a7d-50aa-420b-b817-e124a5425635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87536e08804e45db956dcf5ed18bf934', 'request_id': 'req-01e50a7d-50aa-420b-b817-e124a5425635'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:48.712177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-01e50a7d-50aa-420b-b817-e124a5425635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87536e08804e45db956dcf5ed18bf934', 'request_id': 'req-01e50a7d-50aa-420b-b817-e124a5425635'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:48.725500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-01e50a7d-50aa-420b-b817-e124a5425635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87536e08804e45db956dcf5ed18bf934', 'request_id': 'req-01e50a7d-50aa-420b-b817-e124a5425635'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:48.729239 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:48.744024 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-01e50a7d-50aa-420b-b817-e124a5425635 admin admin] The token cache is being invalidate because project 87536e08804e45db956dcf5ed18bf934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:48.744411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-01e50a7d-50aa-420b-b817-e124a5425635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:48.745911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-01e50a7d-50aa-420b-b817-e124a5425635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:48.748238 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1183/2352] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:48 2022] DELETE /identity/v3/projects/87536e08804e45db956dcf5ed18bf934 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:48.753182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8fecd-f677-4852-8ffa-54a83b0ab630 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:48.753888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8fecd-f677-4852-8ffa-54a83b0ab630 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:48.753888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8fecd-f677-4852-8ffa-54a83b0ab630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:48.772840 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-98a8fecd-f677-4852-8ffa-54a83b0ab630 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:48.774216 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-98a8fecd-f677-4852-8ffa-54a83b0ab630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:48.869245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1170/2353] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:54:48.877520 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e76f7-209c-412e-99b2-afc670199886 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:48.877982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e76f7-209c-412e-99b2-afc670199886 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:48.878467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e76f7-209c-412e-99b2-afc670199886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:48.901771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-607e76f7-209c-412e-99b2-afc670199886 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:48.903075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-607e76f7-209c-412e-99b2-afc670199886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:48.912302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1184/2354] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:48.916798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8fecd-f677-4852-8ffa-54a83b0ab630 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:48.922874 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:48.929987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8fecd-f677-4852-8ffa-54a83b0ab630 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:48.937499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240cf1b-057c-4e62-9ffc-832f5245068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:48.938672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240cf1b-057c-4e62-9ffc-832f5245068c admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:48.939383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240cf1b-057c-4e62-9ffc-832f5245068c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:48.939851 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240cf1b-057c-4e62-9ffc-832f5245068c admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:48.940802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240cf1b-057c-4e62-9ffc-832f5245068c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:54:48.941301 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240cf1b-057c-4e62-9ffc-832f5245068c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:48.943041 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240cf1b-057c-4e62-9ffc-832f5245068c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:48.962875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1171/2355] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:54:48.964910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e76f7-209c-412e-99b2-afc670199886 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:48.975452 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e76f7-209c-412e-99b2-afc670199886 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:48.982712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228c7e3-791f-439d-b11b-797dc14f76a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:48.983612 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c7e3-791f-439d-b11b-797dc14f76a5 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:48.983891 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c7e3-791f-439d-b11b-797dc14f76a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:48.984191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c7e3-791f-439d-b11b-797dc14f76a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:48.984987 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228c7e3-791f-439d-b11b-797dc14f76a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:48.986956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228c7e3-791f-439d-b11b-797dc14f76a5 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:49.015919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1185/2356] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:48 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:49.020390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240cf1b-057c-4e62-9ffc-832f5245068c admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:49.030335 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240cf1b-057c-4e62-9ffc-832f5245068c admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:49.099473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57741a-4f37-42f6-95ce-e6e444945396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:49.100230 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57741a-4f37-42f6-95ce-e6e444945396 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:49.100556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57741a-4f37-42f6-95ce-e6e444945396 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:49.100831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57741a-4f37-42f6-95ce-e6e444945396 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:49.101527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57741a-4f37-42f6-95ce-e6e444945396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:49.103501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57741a-4f37-42f6-95ce-e6e444945396 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:49.130812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1172/2357] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:49 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:49.136405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228c7e3-791f-439d-b11b-797dc14f76a5 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:49.153290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228c7e3-791f-439d-b11b-797dc14f76a5 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:49.168386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cc9af-a5de-44dc-80ea-5a69fd2dbbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:49.169140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cc9af-a5de-44dc-80ea-5a69fd2dbbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:49.169746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cc9af-a5de-44dc-80ea-5a69fd2dbbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:49.169746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cc9af-a5de-44dc-80ea-5a69fd2dbbd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:49.170515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cc9af-a5de-44dc-80ea-5a69fd2dbbd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:49.172519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cc9af-a5de-44dc-80ea-5a69fd2dbbd3 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:49.185449 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1186/2358] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:49.190712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57741a-4f37-42f6-95ce-e6e444945396 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:49.204573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57741a-4f37-42f6-95ce-e6e444945396 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:49.212892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02d172-cd30-4878-86f2-01bd25dbd4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:49.213677 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02d172-cd30-4878-86f2-01bd25dbd4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:49.213971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02d172-cd30-4878-86f2-01bd25dbd4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:49.214321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02d172-cd30-4878-86f2-01bd25dbd4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:49.215219 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02d172-cd30-4878-86f2-01bd25dbd4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:49.216921 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02d172-cd30-4878-86f2-01bd25dbd4c3 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:49.229588 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1173/2359] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:49.235382 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cc9af-a5de-44dc-80ea-5a69fd2dbbd3 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:49.249003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cc9af-a5de-44dc-80ea-5a69fd2dbbd3 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:49.253723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04def5f-871c-429d-a7dc-cdbec4b80ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:49.254661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04def5f-871c-429d-a7dc-cdbec4b80ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:49.254984 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04def5f-871c-429d-a7dc-cdbec4b80ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:49.255269 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04def5f-871c-429d-a7dc-cdbec4b80ae8 admin admin] PATH_INFO: `/v3/projects/55d494a985f44b7392a541caa6dda675/users/077efaaf0f4647fb97d6876d33cd8d73/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:49.270903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04def5f-871c-429d-a7dc-cdbec4b80ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d494a985f44b7392a541caa6dda675, user_id=077efaaf0f4647fb97d6876d33cd8d73, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:49.273504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04def5f-871c-429d-a7dc-cdbec4b80ae8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:49.306804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1187/2360] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:49 2022] PUT /identity/v3/projects/55d494a985f44b7392a541caa6dda675/users/077efaaf0f4647fb97d6876d33cd8d73/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:49.309060 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567bd8d-e45f-40ba-94e4-716e59327c4d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:49.309385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567bd8d-e45f-40ba-94e4-716e59327c4d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:49.309662 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567bd8d-e45f-40ba-94e4-716e59327c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:49.338087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-c567bd8d-e45f-40ba-94e4-716e59327c4d None None] MFA Rules not processed for user `077efaaf0f4647fb97d6876d33cd8d73`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:49.339732 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-c567bd8d-e45f-40ba-94e4-716e59327c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:49.423708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1174/2361] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:49.424908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04def5f-871c-429d-a7dc-cdbec4b80ae8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:49.496929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04def5f-871c-429d-a7dc-cdbec4b80ae8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:49.502921 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e9097-10fd-4213-8cf5-77b94f1191d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:49.503828 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e9097-10fd-4213-8cf5-77b94f1191d8 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:49.504100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e9097-10fd-4213-8cf5-77b94f1191d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:49.504476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e9097-10fd-4213-8cf5-77b94f1191d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:49.505302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e9097-10fd-4213-8cf5-77b94f1191d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:49.507264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e9097-10fd-4213-8cf5-77b94f1191d8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:49.541079 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1188/2362] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:49 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:49.542504 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567bd8d-e45f-40ba-94e4-716e59327c4d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:49.560185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567bd8d-e45f-40ba-94e4-716e59327c4d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:49.642816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:49.651963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fbd1a-b73c-4f62-9b32-fce11066a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:49.652979 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fbd1a-b73c-4f62-9b32-fce11066a734 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:49.653328 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fbd1a-b73c-4f62-9b32-fce11066a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:49.653773 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fbd1a-b73c-4f62-9b32-fce11066a734 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:49.655321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fbd1a-b73c-4f62-9b32-fce11066a734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:49.658316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fbd1a-b73c-4f62-9b32-fce11066a734 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:49.687204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1175/2363] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:49 2022] POST /identity/v3/users => generated 298 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:49.691076 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e9097-10fd-4213-8cf5-77b94f1191d8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:49.708263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e9097-10fd-4213-8cf5-77b94f1191d8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:49.718261 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54628ca5-94b6-4203-8527-ad92f8b8a068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:49.719535 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54628ca5-94b6-4203-8527-ad92f8b8a068 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:49.720030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54628ca5-94b6-4203-8527-ad92f8b8a068 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:49.720545 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54628ca5-94b6-4203-8527-ad92f8b8a068 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:49.721792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54628ca5-94b6-4203-8527-ad92f8b8a068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:49.724607 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54628ca5-94b6-4203-8527-ad92f8b8a068 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:49.739632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1189/2364] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:54:49.743281 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fbd1a-b73c-4f62-9b32-fce11066a734 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:49.756238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fbd1a-b73c-4f62-9b32-fce11066a734 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:49.760994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a88791-36db-459b-8f1b-19dfc8e3597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:49.761935 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a88791-36db-459b-8f1b-19dfc8e3597a admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:49.762479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a88791-36db-459b-8f1b-19dfc8e3597a admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:49.762479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a88791-36db-459b-8f1b-19dfc8e3597a admin admin] PATH_INFO: `/v3/projects/250f84c32424456788481dfbb3c020c3/users/c08d9ec5a7dd49ada61867470789ffaa/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:49.781583 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a88791-36db-459b-8f1b-19dfc8e3597a admin admin] RBAC: Authorizing `identity:create_grant(project_id=250f84c32424456788481dfbb3c020c3, user_id=c08d9ec5a7dd49ada61867470789ffaa, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:49.784250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a88791-36db-459b-8f1b-19dfc8e3597a admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:49.799808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1176/2365] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:49 2022] PUT /identity/v3/projects/250f84c32424456788481dfbb3c020c3/users/c08d9ec5a7dd49ada61867470789ffaa/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:54:49.803615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54628ca5-94b6-4203-8527-ad92f8b8a068 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:49.815648 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54628ca5-94b6-4203-8527-ad92f8b8a068 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:49.909553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0072e-2059-42cb-80a9-de6b9c1ca842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:49.910611 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0072e-2059-42cb-80a9-de6b9c1ca842 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:49.910611 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0072e-2059-42cb-80a9-de6b9c1ca842 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:49.910944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0072e-2059-42cb-80a9-de6b9c1ca842 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:49.912082 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0072e-2059-42cb-80a9-de6b9c1ca842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:49.913726 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0072e-2059-42cb-80a9-de6b9c1ca842 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:49.916456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:49.935113 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1190/2366] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:49.937301 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a88791-36db-459b-8f1b-19dfc8e3597a admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:49.954738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a88791-36db-459b-8f1b-19dfc8e3597a admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:49.965002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0b8f4-6f0e-44d3-9bc4-8fa9c8b626dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:49.966185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b8f4-6f0e-44d3-9bc4-8fa9c8b626dc admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:49.966564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b8f4-6f0e-44d3-9bc4-8fa9c8b626dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:49.966717 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b8f4-6f0e-44d3-9bc4-8fa9c8b626dc admin admin] PATH_INFO: `/v3/projects/250f84c32424456788481dfbb3c020c3/users/c08d9ec5a7dd49ada61867470789ffaa/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:49.970686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0b8f4-6f0e-44d3-9bc4-8fa9c8b626dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=250f84c32424456788481dfbb3c020c3, user_id=c08d9ec5a7dd49ada61867470789ffaa, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:49.973596 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0b8f4-6f0e-44d3-9bc4-8fa9c8b626dc admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:49.989403 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1177/2367] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:49 2022] PUT /identity/v3/projects/250f84c32424456788481dfbb3c020c3/users/c08d9ec5a7dd49ada61867470789ffaa/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:49.999589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0072e-2059-42cb-80a9-de6b9c1ca842 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:50.007307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1dc0072e-2059-42cb-80a9-de6b9c1ca842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:50.025263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0072e-2059-42cb-80a9-de6b9c1ca842 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:50.075218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947e66-e152-43ba-aa79-17cd8aefefe8 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:50.075218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947e66-e152-43ba-aa79-17cd8aefefe8 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:50.075218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947e66-e152-43ba-aa79-17cd8aefefe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:50.106947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-2b947e66-e152-43ba-aa79-17cd8aefefe8 None None] MFA Rules not processed for user `c08d9ec5a7dd49ada61867470789ffaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:50.106947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2b947e66-e152-43ba-aa79-17cd8aefefe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:50.117915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad1802-58e8-4a4a-ae47-e6813ba2a14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:50.119052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad1802-58e8-4a4a-ae47-e6813ba2a14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:50.119426 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad1802-58e8-4a4a-ae47-e6813ba2a14f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:50.119763 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad1802-58e8-4a4a-ae47-e6813ba2a14f admin admin] PATH_INFO: `/v3/users/aa8ee32c5d484363b8af1898d2603e90` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:50.121044 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad1802-58e8-4a4a-ae47-e6813ba2a14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa8ee32c5d484363b8af1898d2603e90)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:50.123089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad1802-58e8-4a4a-ae47-e6813ba2a14f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:50.173754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-eaad1802-58e8-4a4a-ae47-e6813ba2a14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa8ee32c5d484363b8af1898d2603e90'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:50.186531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-eaad1802-58e8-4a4a-ae47-e6813ba2a14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa8ee32c5d484363b8af1898d2603e90'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:50.187060 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1178/2368] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:50.187321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-eaad1802-58e8-4a4a-ae47-e6813ba2a14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa8ee32c5d484363b8af1898d2603e90'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:50.191803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b947e66-e152-43ba-aa79-17cd8aefefe8 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:50.194237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2b947e66-e152-43ba-aa79-17cd8aefefe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:50.195397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-eaad1802-58e8-4a4a-ae47-e6813ba2a14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa8ee32c5d484363b8af1898d2603e90'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:50.196233 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-eaad1802-58e8-4a4a-ae47-e6813ba2a14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa8ee32c5d484363b8af1898d2603e90'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:50.213974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1191/2369] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:49 2022] DELETE /identity/v3/users/aa8ee32c5d484363b8af1898d2603e90 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:50.213974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad1802-58e8-4a4a-ae47-e6813ba2a14f admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:50.213974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-eaad1802-58e8-4a4a-ae47-e6813ba2a14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:50.275616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b947e66-e152-43ba-aa79-17cd8aefefe8 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:50.290738 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad1802-58e8-4a4a-ae47-e6813ba2a14f admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:50.295758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a6848-486e-4604-935e-f2f91bde67ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:50.296428 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a6848-486e-4604-935e-f2f91bde67ab service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:50.296708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a6848-486e-4604-935e-f2f91bde67ab service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:50.296975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a6848-486e-4604-935e-f2f91bde67ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:50.299441 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8b2a6848-486e-4604-935e-f2f91bde67ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:50.335014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa6470-7562-4a7b-b65b-b98b6965447b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:50.335756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa6470-7562-4a7b-b65b-b98b6965447b service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:50.336243 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa6470-7562-4a7b-b65b-b98b6965447b service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:50.336629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa6470-7562-4a7b-b65b-b98b6965447b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:50.337710 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:50.339576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-11fa6470-7562-4a7b-b65b-b98b6965447b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:50.350908 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:50.377591 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a6848-486e-4604-935e-f2f91bde67ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:50.379026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a6848-486e-4604-935e-f2f91bde67ab service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:50.392783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1192/2370] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:50.413282 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a6848-486e-4604-935e-f2f91bde67ab service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:50.415042 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8b2a6848-486e-4604-935e-f2f91bde67ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:50.431283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa6470-7562-4a7b-b65b-b98b6965447b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:50.434279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa6470-7562-4a7b-b65b-b98b6965447b service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:50.442205 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a6848-486e-4604-935e-f2f91bde67ab service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:50.449704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9535f98-037d-485e-9d53-cf6dceda3e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:50.450707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9535f98-037d-485e-9d53-cf6dceda3e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:50.451169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9535f98-037d-485e-9d53-cf6dceda3e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:50.451482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9535f98-037d-485e-9d53-cf6dceda3e7b admin admin] PATH_INFO: `/v3/projects/6817f59f39094a58b284ae0a0dbab465` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:50.452738 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9535f98-037d-485e-9d53-cf6dceda3e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6817f59f39094a58b284ae0a0dbab465)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:50.454527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1179/2371] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:50.454648 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9535f98-037d-485e-9d53-cf6dceda3e7b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:50.503659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa6470-7562-4a7b-b65b-b98b6965447b service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:50.513368 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa6470-7562-4a7b-b65b-b98b6965447b service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:50.517271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-a9535f98-037d-485e-9d53-cf6dceda3e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6817f59f39094a58b284ae0a0dbab465', 'request_id': 'req-a9535f98-037d-485e-9d53-cf6dceda3e7b'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:50.528025 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-a9535f98-037d-485e-9d53-cf6dceda3e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6817f59f39094a58b284ae0a0dbab465', 'request_id': 'req-a9535f98-037d-485e-9d53-cf6dceda3e7b'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:50.541038 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-a9535f98-037d-485e-9d53-cf6dceda3e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6817f59f39094a58b284ae0a0dbab465', 'request_id': 'req-a9535f98-037d-485e-9d53-cf6dceda3e7b'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:50.559562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-a9535f98-037d-485e-9d53-cf6dceda3e7b admin admin] The token cache is being invalidate because project 6817f59f39094a58b284ae0a0dbab465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:50.560092 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-a9535f98-037d-485e-9d53-cf6dceda3e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:50.560773 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-a9535f98-037d-485e-9d53-cf6dceda3e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:50.566142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1193/2372] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:50 2022] DELETE /identity/v3/projects/6817f59f39094a58b284ae0a0dbab465 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:50.568620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b22d6-828c-4be3-8229-ba1cfb01c20d None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:50.568905 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b22d6-828c-4be3-8229-ba1cfb01c20d None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:50.569192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b22d6-828c-4be3-8229-ba1cfb01c20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:50.570794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfec4f-f064-4500-8100-3047bc4a2155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:50.571465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfec4f-f064-4500-8100-3047bc4a2155 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:50.571751 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfec4f-f064-4500-8100-3047bc4a2155 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:50.572029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfec4f-f064-4500-8100-3047bc4a2155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:50.574215 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-45cfec4f-f064-4500-8100-3047bc4a2155 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:50.593518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-5a2b22d6-828c-4be3-8229-ba1cfb01c20d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:50.595047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5a2b22d6-828c-4be3-8229-ba1cfb01c20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:50.657336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfec4f-f064-4500-8100-3047bc4a2155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:50.658847 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfec4f-f064-4500-8100-3047bc4a2155 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:50.669884 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1180/2373] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:50.674070 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1194/2374] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:54:50.686126 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3067b-c116-462a-a2ec-798d7070bbe6 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:50.686413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3067b-c116-462a-a2ec-798d7070bbe6 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:50.686692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3067b-c116-462a-a2ec-798d7070bbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:50.719625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-33f3067b-c116-462a-a2ec-798d7070bbe6 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:50.721003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-33f3067b-c116-462a-a2ec-798d7070bbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:50.733138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1181/2375] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:50.737596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b22d6-828c-4be3-8229-ba1cfb01c20d None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:50.756836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b22d6-828c-4be3-8229-ba1cfb01c20d None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:50.761824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011031ba-0c68-412a-8f1c-66c3dafe4176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:50.762483 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011031ba-0c68-412a-8f1c-66c3dafe4176 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:50.762869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011031ba-0c68-412a-8f1c-66c3dafe4176 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:50.763148 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011031ba-0c68-412a-8f1c-66c3dafe4176 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:50.763894 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011031ba-0c68-412a-8f1c-66c3dafe4176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:54:50.764206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011031ba-0c68-412a-8f1c-66c3dafe4176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:50.766340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011031ba-0c68-412a-8f1c-66c3dafe4176 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:50.786313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1195/2376] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:54:50.790811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3067b-c116-462a-a2ec-798d7070bbe6 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:50.804363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3067b-c116-462a-a2ec-798d7070bbe6 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:50.809437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be37608-1e0c-41ec-b7ef-75640d247c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:50.810422 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37608-1e0c-41ec-b7ef-75640d247c1c admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:50.810804 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37608-1e0c-41ec-b7ef-75640d247c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:50.811179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37608-1e0c-41ec-b7ef-75640d247c1c admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:50.812599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be37608-1e0c-41ec-b7ef-75640d247c1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:50.814922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be37608-1e0c-41ec-b7ef-75640d247c1c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:50.863049 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1182/2377] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:50 2022] POST /identity/v3/projects => generated 365 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:50.864661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011031ba-0c68-412a-8f1c-66c3dafe4176 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:50.876574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011031ba-0c68-412a-8f1c-66c3dafe4176 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:50.926171 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:50.960876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15616a-263f-433e-b0b7-37ac95ec04f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:50.961638 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15616a-263f-433e-b0b7-37ac95ec04f0 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:50.961994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15616a-263f-433e-b0b7-37ac95ec04f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:50.962493 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15616a-263f-433e-b0b7-37ac95ec04f0 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:50.963233 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15616a-263f-433e-b0b7-37ac95ec04f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:50.965592 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15616a-263f-433e-b0b7-37ac95ec04f0 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:50.992316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be37608-1e0c-41ec-b7ef-75640d247c1c admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:50.994801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1196/2378] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:50 2022] POST /identity/v3/users => generated 283 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:50.994957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-1be37608-1e0c-41ec-b7ef-75640d247c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:50.999381 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15616a-263f-433e-b0b7-37ac95ec04f0 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:51.008554 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be37608-1e0c-41ec-b7ef-75640d247c1c admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:51.013211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b8f80-85ee-40b8-81f9-d29c908ed713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:51.013578 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15616a-263f-433e-b0b7-37ac95ec04f0 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:51.014237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b8f80-85ee-40b8-81f9-d29c908ed713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:51.014600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b8f80-85ee-40b8-81f9-d29c908ed713 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:51.015088 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b8f80-85ee-40b8-81f9-d29c908ed713 admin admin] PATH_INFO: `/v3/users/077efaaf0f4647fb97d6876d33cd8d73` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:51.016598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b8f80-85ee-40b8-81f9-d29c908ed713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=077efaaf0f4647fb97d6876d33cd8d73)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:51.018694 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b8f80-85ee-40b8-81f9-d29c908ed713 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:51.019719 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063443a-29b7-44b8-a5df-f48291381eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:51.021256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063443a-29b7-44b8-a5df-f48291381eac admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:51.021546 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063443a-29b7-44b8-a5df-f48291381eac admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:51.021827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063443a-29b7-44b8-a5df-f48291381eac admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:51.023100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063443a-29b7-44b8-a5df-f48291381eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:51.025255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063443a-29b7-44b8-a5df-f48291381eac admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:51.036708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1197/2379] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:51.040404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063443a-29b7-44b8-a5df-f48291381eac admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:51.044848 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:51.052838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063443a-29b7-44b8-a5df-f48291381eac admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:51.059318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344683d-613d-4b5d-be99-f4ccf86a6791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:51.059993 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344683d-613d-4b5d-be99-f4ccf86a6791 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:51.060264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344683d-613d-4b5d-be99-f4ccf86a6791 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:51.060548 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344683d-613d-4b5d-be99-f4ccf86a6791 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:51.061372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344683d-613d-4b5d-be99-f4ccf86a6791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:51.063014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344683d-613d-4b5d-be99-f4ccf86a6791 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:51.080346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1198/2380] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:54:51.080567 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-695b8f80-85ee-40b8-81f9-d29c908ed713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '077efaaf0f4647fb97d6876d33cd8d73'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:51.081377 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344683d-613d-4b5d-be99-f4ccf86a6791 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:51.091910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344683d-613d-4b5d-be99-f4ccf86a6791 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:51.095040 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-695b8f80-85ee-40b8-81f9-d29c908ed713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '077efaaf0f4647fb97d6876d33cd8d73'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:51.097320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb86d5-7206-44fd-993e-6af675e2c2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:51.098581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb86d5-7206-44fd-993e-6af675e2c2f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:51.099087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb86d5-7206-44fd-993e-6af675e2c2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:51.099555 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb86d5-7206-44fd-993e-6af675e2c2f2 admin admin] PATH_INFO: `/v3/projects/a38bbb2a795445bdb8d277b01e9f1ab5/users/b006850d42b44b1aa8511d1dd1819518/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:51.102614 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-695b8f80-85ee-40b8-81f9-d29c908ed713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '077efaaf0f4647fb97d6876d33cd8d73'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:51.103361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-695b8f80-85ee-40b8-81f9-d29c908ed713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '077efaaf0f4647fb97d6876d33cd8d73'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:51.103966 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-695b8f80-85ee-40b8-81f9-d29c908ed713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '077efaaf0f4647fb97d6876d33cd8d73'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:51.118530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1183/2381] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:50 2022] DELETE /identity/v3/users/077efaaf0f4647fb97d6876d33cd8d73 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:51.121834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb86d5-7206-44fd-993e-6af675e2c2f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a38bbb2a795445bdb8d277b01e9f1ab5, user_id=b006850d42b44b1aa8511d1dd1819518, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:51.122981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5327a4-c656-4fa9-9553-fd8ab7618a20 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:51.123274 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5327a4-c656-4fa9-9553-fd8ab7618a20 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:51.123553 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5327a4-c656-4fa9-9553-fd8ab7618a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:51.125657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb86d5-7206-44fd-993e-6af675e2c2f2 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:51.140496 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1199/2382] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:51 2022] PUT /identity/v3/projects/a38bbb2a795445bdb8d277b01e9f1ab5/users/b006850d42b44b1aa8511d1dd1819518/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:54:51.149943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-ea5327a4-c656-4fa9-9553-fd8ab7618a20 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:51.151181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a0f6-1220-4ff9-9520-62a0539f11b2 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:51.151312 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ea5327a4-c656-4fa9-9553-fd8ab7618a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:51.151544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a0f6-1220-4ff9-9520-62a0539f11b2 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:51.151896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a0f6-1220-4ff9-9520-62a0539f11b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:51.184470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-26f4a0f6-1220-4ff9-9520-62a0539f11b2 None None] MFA Rules not processed for user `b006850d42b44b1aa8511d1dd1819518`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:51.186430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-26f4a0f6-1220-4ff9-9520-62a0539f11b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:51.224961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1184/2383] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:54:51.234370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5327a4-c656-4fa9-9553-fd8ab7618a20 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:51.235805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ea5327a4-c656-4fa9-9553-fd8ab7618a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:51.270383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1200/2384] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:51.283447 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4a0f6-1220-4ff9-9520-62a0539f11b2 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:51.285095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-26f4a0f6-1220-4ff9-9520-62a0539f11b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:51.302461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5327a4-c656-4fa9-9553-fd8ab7618a20 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:51.306956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca062ded-f906-477e-8b7a-21b84468d881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:51.307941 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca062ded-f906-477e-8b7a-21b84468d881 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:51.307941 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca062ded-f906-477e-8b7a-21b84468d881 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:51.308151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca062ded-f906-477e-8b7a-21b84468d881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:51.317955 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca062ded-f906-477e-8b7a-21b84468d881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:51.319477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca062ded-f906-477e-8b7a-21b84468d881 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:51.330496 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1185/2385] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:51.346724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4a0f6-1220-4ff9-9520-62a0539f11b2 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:51.352741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dd4f7-0b79-4861-9403-6677861077ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:51.353404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dd4f7-0b79-4861-9403-6677861077ea service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:51.353834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dd4f7-0b79-4861-9403-6677861077ea service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:51.354234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dd4f7-0b79-4861-9403-6677861077ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:51.364839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dd4f7-0b79-4861-9403-6677861077ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:51.366325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dd4f7-0b79-4861-9403-6677861077ea service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:51.380920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1201/2386] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:54:51.629668 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca062ded-f906-477e-8b7a-21b84468d881 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:51.631266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ca062ded-f906-477e-8b7a-21b84468d881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:51.647439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca062ded-f906-477e-8b7a-21b84468d881 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:51.658063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:51.659204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:51.659327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:51.659508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] PATH_INFO: `/v3/projects/55d494a985f44b7392a541caa6dda675` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:51.661365 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d494a985f44b7392a541caa6dda675)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:51.663417 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:51.749544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:51.761937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d494a985f44b7392a541caa6dda675', 'request_id': 'req-9fc30a2b-7373-44f4-b85d-1f39676cd206'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:51.779425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d494a985f44b7392a541caa6dda675', 'request_id': 'req-9fc30a2b-7373-44f4-b85d-1f39676cd206'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:51.802811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d494a985f44b7392a541caa6dda675', 'request_id': 'req-9fc30a2b-7373-44f4-b85d-1f39676cd206'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:51.823589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] The token cache is being invalidate because project 55d494a985f44b7392a541caa6dda675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:51.824348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:51.825081 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:51.827230 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1186/2387] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:51 2022] DELETE /identity/v3/projects/55d494a985f44b7392a541caa6dda675 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:51.831192 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dd4f7-0b79-4861-9403-6677861077ea service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:51.844582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dd4f7-0b79-4861-9403-6677861077ea service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:51.858275 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:51.919686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f0cd4-a6f7-4e6f-bfe5-3cf569f04e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:51.921894 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0cd4-a6f7-4e6f-bfe5-3cf569f04e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:51.922305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0cd4-a6f7-4e6f-bfe5-3cf569f04e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:51.923183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0cd4-a6f7-4e6f-bfe5-3cf569f04e1e admin admin] PATH_INFO: `/v3/users/c08d9ec5a7dd49ada61867470789ffaa` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:51.923954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f0cd4-a6f7-4e6f-bfe5-3cf569f04e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08d9ec5a7dd49ada61867470789ffaa)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:51.925919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f0cd4-a6f7-4e6f-bfe5-3cf569f04e1e admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:51.978174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9e3f0cd4-a6f7-4e6f-bfe5-3cf569f04e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08d9ec5a7dd49ada61867470789ffaa'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:51.991007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9e3f0cd4-a6f7-4e6f-bfe5-3cf569f04e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08d9ec5a7dd49ada61867470789ffaa'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:51.991824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9e3f0cd4-a6f7-4e6f-bfe5-3cf569f04e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08d9ec5a7dd49ada61867470789ffaa'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:51.999508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9e3f0cd4-a6f7-4e6f-bfe5-3cf569f04e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08d9ec5a7dd49ada61867470789ffaa'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:52.000268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9e3f0cd4-a6f7-4e6f-bfe5-3cf569f04e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08d9ec5a7dd49ada61867470789ffaa'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:52.016905 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1202/2388] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:51 2022] DELETE /identity/v3/users/c08d9ec5a7dd49ada61867470789ffaa => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:54:52.294216 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:52.295782 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:52.317709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc30a2b-7373-44f4-b85d-1f39676cd206 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:52.391415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:52.392531 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:52.392915 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:52.393306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348 admin admin] PATH_INFO: `/v3/projects/250f84c32424456788481dfbb3c020c3` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:52.394989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=250f84c32424456788481dfbb3c020c3)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:52.397502 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:52.462630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '250f84c32424456788481dfbb3c020c3', 'request_id': 'req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:52.475439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '250f84c32424456788481dfbb3c020c3', 'request_id': 'req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:52.484460 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '250f84c32424456788481dfbb3c020c3', 'request_id': 'req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:52.498578 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348 admin admin] The token cache is being invalidate because project 250f84c32424456788481dfbb3c020c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:52.499089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:52.499843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b048de7b-8c2a-4cc9-bca6-df9bb64c9348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:52.501927 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1187/2389] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:52 2022] DELETE /identity/v3/projects/250f84c32424456788481dfbb3c020c3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:52.506798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25a30-e13f-4734-bed2-90c426b8f4f8 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:52.507098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25a30-e13f-4734-bed2-90c426b8f4f8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:52.507375 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25a30-e13f-4734-bed2-90c426b8f4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:52.526420 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-1bf25a30-e13f-4734-bed2-90c426b8f4f8 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:52.527711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1bf25a30-e13f-4734-bed2-90c426b8f4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:52.595299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1203/2390] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:52.603705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ef578-0425-49da-8898-0756dfa26d92 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:52.603993 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ef578-0425-49da-8898-0756dfa26d92 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:52.604275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ef578-0425-49da-8898-0756dfa26d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:52.623851 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-8d9ef578-0425-49da-8898-0756dfa26d92 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:52.625103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8d9ef578-0425-49da-8898-0756dfa26d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:52.634906 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1188/2391] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:54:52.639244 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf25a30-e13f-4734-bed2-90c426b8f4f8 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:52.649570 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf25a30-e13f-4734-bed2-90c426b8f4f8 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:52.654464 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ea8d0-5897-4bbd-b00f-bd8326a87c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:52.655185 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ea8d0-5897-4bbd-b00f-bd8326a87c0e admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:52.655474 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ea8d0-5897-4bbd-b00f-bd8326a87c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:52.655780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ea8d0-5897-4bbd-b00f-bd8326a87c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:52.656508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ea8d0-5897-4bbd-b00f-bd8326a87c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:54:52.657104 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ea8d0-5897-4bbd-b00f-bd8326a87c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:52.658536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ea8d0-5897-4bbd-b00f-bd8326a87c0e admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:52.672609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1204/2392] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:54:52.677176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ef578-0425-49da-8898-0756dfa26d92 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:52.692846 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ef578-0425-49da-8898-0756dfa26d92 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:52.701720 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5540a-20ea-47eb-b625-aa0ac80d88d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:52.702852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5540a-20ea-47eb-b625-aa0ac80d88d7 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:52.703227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5540a-20ea-47eb-b625-aa0ac80d88d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:52.703722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5540a-20ea-47eb-b625-aa0ac80d88d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:52.704634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5540a-20ea-47eb-b625-aa0ac80d88d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:52.708484 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5540a-20ea-47eb-b625-aa0ac80d88d7 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:52.752966 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1189/2393] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:52 2022] POST /identity/v3/projects => generated 361 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:52.757835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ea8d0-5897-4bbd-b00f-bd8326a87c0e admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:52.769409 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ea8d0-5897-4bbd-b00f-bd8326a87c0e admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:52.789512 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:52.852684 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7241de-767e-43e1-bb24-0385e4aa51e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:52.854302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7241de-767e-43e1-bb24-0385e4aa51e5 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:52.854843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7241de-767e-43e1-bb24-0385e4aa51e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:52.855339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7241de-767e-43e1-bb24-0385e4aa51e5 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:52.856254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7241de-767e-43e1-bb24-0385e4aa51e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:52.858596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7241de-767e-43e1-bb24-0385e4aa51e5 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:52.889785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1205/2394] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:52 2022] POST /identity/v3/users => generated 281 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:52.891482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5540a-20ea-47eb-b625-aa0ac80d88d7 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:52.905164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5540a-20ea-47eb-b625-aa0ac80d88d7 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:52.917482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677362bd-22fe-4925-b4a1-f14041342a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:52.918321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677362bd-22fe-4925-b4a1-f14041342a1d admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:52.918707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677362bd-22fe-4925-b4a1-f14041342a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:52.919224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677362bd-22fe-4925-b4a1-f14041342a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:52.920048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677362bd-22fe-4925-b4a1-f14041342a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:52.921968 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677362bd-22fe-4925-b4a1-f14041342a1d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:52.934215 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1190/2395] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:52.938529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7241de-767e-43e1-bb24-0385e4aa51e5 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:52.950186 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7241de-767e-43e1-bb24-0385e4aa51e5 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:52.955553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766e47d-b664-44aa-a38f-cd7c7196df93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:52.956287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766e47d-b664-44aa-a38f-cd7c7196df93 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:52.956636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766e47d-b664-44aa-a38f-cd7c7196df93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:52.956977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766e47d-b664-44aa-a38f-cd7c7196df93 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:52.958049 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766e47d-b664-44aa-a38f-cd7c7196df93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:52.960803 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766e47d-b664-44aa-a38f-cd7c7196df93 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:52.973013 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1206/2396] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:54:52.977496 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677362bd-22fe-4925-b4a1-f14041342a1d admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:52.987907 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677362bd-22fe-4925-b4a1-f14041342a1d admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:52.992944 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d2d8e-10f9-4d19-8b54-995c6889f29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:52.993916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d2d8e-10f9-4d19-8b54-995c6889f29b admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:52.994203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d2d8e-10f9-4d19-8b54-995c6889f29b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:52.994478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d2d8e-10f9-4d19-8b54-995c6889f29b admin admin] PATH_INFO: `/v3/projects/2c85111c949a41a5b2e7f60591703413/users/b76111863c064761bd27ce2ba7faea88/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:53.008269 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:53.011913 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d2d8e-10f9-4d19-8b54-995c6889f29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c85111c949a41a5b2e7f60591703413, user_id=b76111863c064761bd27ce2ba7faea88, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:53.016820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d2d8e-10f9-4d19-8b54-995c6889f29b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:53.040245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1191/2397] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:52 2022] PUT /identity/v3/projects/2c85111c949a41a5b2e7f60591703413/users/b76111863c064761bd27ce2ba7faea88/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:53.052447 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557463fb-01e7-4ab2-bad2-5176c8a1d0e8 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:53.053020 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557463fb-01e7-4ab2-bad2-5176c8a1d0e8 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:53.053020 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557463fb-01e7-4ab2-bad2-5176c8a1d0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:53.083372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-557463fb-01e7-4ab2-bad2-5176c8a1d0e8 None None] MFA Rules not processed for user `b76111863c064761bd27ce2ba7faea88`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:53.084645 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-557463fb-01e7-4ab2-bad2-5176c8a1d0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:53.162271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1207/2398] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:53.206053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d2d8e-10f9-4d19-8b54-995c6889f29b admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:53.208258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-bd8d2d8e-10f9-4d19-8b54-995c6889f29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:53.315171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d2d8e-10f9-4d19-8b54-995c6889f29b admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:53.319793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a5641-cba0-43a9-88dc-7b7dd272ab51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:53.320773 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a5641-cba0-43a9-88dc-7b7dd272ab51 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:53.321145 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a5641-cba0-43a9-88dc-7b7dd272ab51 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:53.321645 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a5641-cba0-43a9-88dc-7b7dd272ab51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:53.335926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a5641-cba0-43a9-88dc-7b7dd272ab51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:53.337402 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a5641-cba0-43a9-88dc-7b7dd272ab51 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:53.356407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1192/2399] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:53.363144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557463fb-01e7-4ab2-bad2-5176c8a1d0e8 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:53.455444 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557463fb-01e7-4ab2-bad2-5176c8a1d0e8 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:53.460327 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d22a3-169d-4ff8-89fe-a49c07a3a372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:53.461222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d22a3-169d-4ff8-89fe-a49c07a3a372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:53.461507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d22a3-169d-4ff8-89fe-a49c07a3a372 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:53.461790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d22a3-169d-4ff8-89fe-a49c07a3a372 admin admin] PATH_INFO: `/v3/users/b76111863c064761bd27ce2ba7faea88` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:53.463037 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d22a3-169d-4ff8-89fe-a49c07a3a372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b76111863c064761bd27ce2ba7faea88)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:53.464978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d22a3-169d-4ff8-89fe-a49c07a3a372 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:53.509912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:53.530144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c52d22a3-169d-4ff8-89fe-a49c07a3a372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b76111863c064761bd27ce2ba7faea88'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:53.548381 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c52d22a3-169d-4ff8-89fe-a49c07a3a372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b76111863c064761bd27ce2ba7faea88'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:53.549473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c52d22a3-169d-4ff8-89fe-a49c07a3a372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b76111863c064761bd27ce2ba7faea88'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:53.557786 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c52d22a3-169d-4ff8-89fe-a49c07a3a372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b76111863c064761bd27ce2ba7faea88'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:53.558531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c52d22a3-169d-4ff8-89fe-a49c07a3a372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b76111863c064761bd27ce2ba7faea88'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:53.572630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1208/2400] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:53 2022] DELETE /identity/v3/users/b76111863c064761bd27ce2ba7faea88 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:54:53.577643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ece55-46de-4464-affc-89ce1989903d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:53.577932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ece55-46de-4464-affc-89ce1989903d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:53.578209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ece55-46de-4464-affc-89ce1989903d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:53.595854 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-dc8ece55-46de-4464-affc-89ce1989903d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:53.597074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-dc8ece55-46de-4464-affc-89ce1989903d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:53.658527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1193/2401] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:53.668801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d22a3-169d-4ff8-89fe-a49c07a3a372 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:53.670252 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c52d22a3-169d-4ff8-89fe-a49c07a3a372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:53.746373 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d22a3-169d-4ff8-89fe-a49c07a3a372 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:53.752548 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e3a73-e5a2-4896-801f-92251ae27ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:53.753294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e3a73-e5a2-4896-801f-92251ae27ddb service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:53.753670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e3a73-e5a2-4896-801f-92251ae27ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:53.754041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e3a73-e5a2-4896-801f-92251ae27ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:53.764237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e3a73-e5a2-4896-801f-92251ae27ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:53.765762 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e3a73-e5a2-4896-801f-92251ae27ddb service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:53.775711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1209/2402] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:53.999844 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ece55-46de-4464-affc-89ce1989903d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:54.002056 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-dc8ece55-46de-4464-affc-89ce1989903d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:54.017076 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ece55-46de-4464-affc-89ce1989903d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:54.025789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302cb22-603d-4a18-aa5f-fdbf59bf48ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:54.026730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302cb22-603d-4a18-aa5f-fdbf59bf48ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.027045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302cb22-603d-4a18-aa5f-fdbf59bf48ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.027401 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302cb22-603d-4a18-aa5f-fdbf59bf48ac admin admin] PATH_INFO: `/v3/users/4067f36996a348f39b50fd88f223c87b` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.034227 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302cb22-603d-4a18-aa5f-fdbf59bf48ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4067f36996a348f39b50fd88f223c87b)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:54.036802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302cb22-603d-4a18-aa5f-fdbf59bf48ac admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:54.102020 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e302cb22-603d-4a18-aa5f-fdbf59bf48ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4067f36996a348f39b50fd88f223c87b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.109095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e3a73-e5a2-4896-801f-92251ae27ddb service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:54.111210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1c5e3a73-e5a2-4896-801f-92251ae27ddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:54.119830 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e302cb22-603d-4a18-aa5f-fdbf59bf48ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4067f36996a348f39b50fd88f223c87b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.130541 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e3a73-e5a2-4896-801f-92251ae27ddb service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:54.131882 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e302cb22-603d-4a18-aa5f-fdbf59bf48ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4067f36996a348f39b50fd88f223c87b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.132980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e302cb22-603d-4a18-aa5f-fdbf59bf48ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4067f36996a348f39b50fd88f223c87b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.133729 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e302cb22-603d-4a18-aa5f-fdbf59bf48ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4067f36996a348f39b50fd88f223c87b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.135680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e2d58-f430-43f9-a872-294042eea495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:54.136727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e2d58-f430-43f9-a872-294042eea495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.137014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e2d58-f430-43f9-a872-294042eea495 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.137375 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e2d58-f430-43f9-a872-294042eea495 admin admin] PATH_INFO: `/v3/projects/2c85111c949a41a5b2e7f60591703413` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.138828 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e2d58-f430-43f9-a872-294042eea495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c85111c949a41a5b2e7f60591703413)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:54.140732 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e2d58-f430-43f9-a872-294042eea495 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:54.149267 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1194/2403] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:53 2022] DELETE /identity/v3/users/4067f36996a348f39b50fd88f223c87b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:54.193806 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-886e2d58-f430-43f9-a872-294042eea495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c85111c949a41a5b2e7f60591703413', 'request_id': 'req-886e2d58-f430-43f9-a872-294042eea495'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.203164 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-886e2d58-f430-43f9-a872-294042eea495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c85111c949a41a5b2e7f60591703413', 'request_id': 'req-886e2d58-f430-43f9-a872-294042eea495'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.210427 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-886e2d58-f430-43f9-a872-294042eea495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c85111c949a41a5b2e7f60591703413', 'request_id': 'req-886e2d58-f430-43f9-a872-294042eea495'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.222046 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-886e2d58-f430-43f9-a872-294042eea495 admin admin] The token cache is being invalidate because project 2c85111c949a41a5b2e7f60591703413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:54.222371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-886e2d58-f430-43f9-a872-294042eea495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.223276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-886e2d58-f430-43f9-a872-294042eea495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.224896 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1210/2404] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:54 2022] DELETE /identity/v3/projects/2c85111c949a41a5b2e7f60591703413 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:54:54.230264 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cbaa5-949d-4a0c-a77a-87a5a1b60bad None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.230557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cbaa5-949d-4a0c-a77a-87a5a1b60bad None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.230863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cbaa5-949d-4a0c-a77a-87a5a1b60bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.243246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:54.249753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-453cbaa5-949d-4a0c-a77a-87a5a1b60bad None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:54.252353 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-453cbaa5-949d-4a0c-a77a-87a5a1b60bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:54.322273 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1195/2405] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:54.330338 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e53e0a-f6e0-4597-97b2-7e6b957f5265 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.330631 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e53e0a-f6e0-4597-97b2-7e6b957f5265 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.330993 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e53e0a-f6e0-4597-97b2-7e6b957f5265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.348048 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cbaa5-949d-4a0c-a77a-87a5a1b60bad None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:54.349636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-453cbaa5-949d-4a0c-a77a-87a5a1b60bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:54.363074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cbaa5-949d-4a0c-a77a-87a5a1b60bad None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:54.366696 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-40e53e0a-f6e0-4597-97b2-7e6b957f5265 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:54.368410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-40e53e0a-f6e0-4597-97b2-7e6b957f5265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:54.368638 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24f8d1-5771-4733-a552-3cac67934742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:54.369922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24f8d1-5771-4733-a552-3cac67934742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.370031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24f8d1-5771-4733-a552-3cac67934742 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.370251 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24f8d1-5771-4733-a552-3cac67934742 admin admin] PATH_INFO: `/v3/projects/7da7cf00a1a04d34ac15d06e1451133a` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.371487 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24f8d1-5771-4733-a552-3cac67934742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da7cf00a1a04d34ac15d06e1451133a)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:54.373519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24f8d1-5771-4733-a552-3cac67934742 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:54.380625 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1211/2406] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:54.386261 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e53e0a-f6e0-4597-97b2-7e6b957f5265 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:54.405209 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e53e0a-f6e0-4597-97b2-7e6b957f5265 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:54.422255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206acf2b-58a0-4970-83f2-097b902d7001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:54.423900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206acf2b-58a0-4970-83f2-097b902d7001 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.424291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206acf2b-58a0-4970-83f2-097b902d7001 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.424651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206acf2b-58a0-4970-83f2-097b902d7001 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.425741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206acf2b-58a0-4970-83f2-097b902d7001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:54:54.426550 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206acf2b-58a0-4970-83f2-097b902d7001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:54.428313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206acf2b-58a0-4970-83f2-097b902d7001 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:54.440776 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9b24f8d1-5771-4733-a552-3cac67934742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da7cf00a1a04d34ac15d06e1451133a', 'request_id': 'req-9b24f8d1-5771-4733-a552-3cac67934742'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.448264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1212/2407] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:54:54.453467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206acf2b-58a0-4970-83f2-097b902d7001 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:54.455808 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9b24f8d1-5771-4733-a552-3cac67934742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da7cf00a1a04d34ac15d06e1451133a', 'request_id': 'req-9b24f8d1-5771-4733-a552-3cac67934742'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.465397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9b24f8d1-5771-4733-a552-3cac67934742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da7cf00a1a04d34ac15d06e1451133a', 'request_id': 'req-9b24f8d1-5771-4733-a552-3cac67934742'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.469018 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206acf2b-58a0-4970-83f2-097b902d7001 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:54.483146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9b24f8d1-5771-4733-a552-3cac67934742 admin admin] The token cache is being invalidate because project 7da7cf00a1a04d34ac15d06e1451133a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:54.483279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9b24f8d1-5771-4733-a552-3cac67934742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.484083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9b24f8d1-5771-4733-a552-3cac67934742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:54.486000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1196/2408] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:54 2022] DELETE /identity/v3/projects/7da7cf00a1a04d34ac15d06e1451133a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:54:54.486410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:54.491736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667e502-c6f7-41e6-b6e4-47267a1a3da7 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.491736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667e502-c6f7-41e6-b6e4-47267a1a3da7 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.491736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667e502-c6f7-41e6-b6e4-47267a1a3da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.513047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-a667e502-c6f7-41e6-b6e4-47267a1a3da7 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:54.514485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a667e502-c6f7-41e6-b6e4-47267a1a3da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:54.558642 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f826d-7145-47a1-b122-5e18df622453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:54.559356 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f826d-7145-47a1-b122-5e18df622453 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.559642 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f826d-7145-47a1-b122-5e18df622453 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.560323 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f826d-7145-47a1-b122-5e18df622453 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.561029 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f826d-7145-47a1-b122-5e18df622453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:54.563503 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f826d-7145-47a1-b122-5e18df622453 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:54.606961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1213/2410] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:54 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:54:54.607222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1197/2410] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:54.607337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f826d-7145-47a1-b122-5e18df622453 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:54.607337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a10f826d-7145-47a1-b122-5e18df622453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:54.610405 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de269514-4e37-40a7-95f5-0590a6f07f30 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.611104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de269514-4e37-40a7-95f5-0590a6f07f30 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.611104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de269514-4e37-40a7-95f5-0590a6f07f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.633011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-de269514-4e37-40a7-95f5-0590a6f07f30 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:54.634234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-de269514-4e37-40a7-95f5-0590a6f07f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:54.664665 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:54.690651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f826d-7145-47a1-b122-5e18df622453 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:54.698539 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0d329-8f9b-4235-a960-0f56d27bda6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:54.699538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0d329-8f9b-4235-a960-0f56d27bda6d admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.699871 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0d329-8f9b-4235-a960-0f56d27bda6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.700169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0d329-8f9b-4235-a960-0f56d27bda6d admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.700847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0d329-8f9b-4235-a960-0f56d27bda6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:54.703097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0d329-8f9b-4235-a960-0f56d27bda6d admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:54.713661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1198/2411] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:54.718513 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de269514-4e37-40a7-95f5-0590a6f07f30 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:54.729581 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de269514-4e37-40a7-95f5-0590a6f07f30 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:54.733849 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1214/2412] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:54 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:54.738038 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0d329-8f9b-4235-a960-0f56d27bda6d admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:54.738745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ddaad-8ee4-4e03-9d45-c9604e7e6e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:54.739568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ddaad-8ee4-4e03-9d45-c9604e7e6e4a admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.739848 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ddaad-8ee4-4e03-9d45-c9604e7e6e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.740146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ddaad-8ee4-4e03-9d45-c9604e7e6e4a admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.740933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ddaad-8ee4-4e03-9d45-c9604e7e6e4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:54:54.741244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ddaad-8ee4-4e03-9d45-c9604e7e6e4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:54.742910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ddaad-8ee4-4e03-9d45-c9604e7e6e4a admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:54.753614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0d329-8f9b-4235-a960-0f56d27bda6d admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:54.762145 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1199/2413] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:54:54.762346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10255bec-e68e-4618-9c84-1b3b5330add8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:54.762346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10255bec-e68e-4618-9c84-1b3b5330add8 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.762346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10255bec-e68e-4618-9c84-1b3b5330add8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.762346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10255bec-e68e-4618-9c84-1b3b5330add8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.762637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10255bec-e68e-4618-9c84-1b3b5330add8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:54.762724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ddaad-8ee4-4e03-9d45-c9604e7e6e4a admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:54.763029 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10255bec-e68e-4618-9c84-1b3b5330add8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:54.772560 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ddaad-8ee4-4e03-9d45-c9604e7e6e4a admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:54.774800 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1215/2414] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:54.777424 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cc7c2-7d17-4643-b528-f3de5c651451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:54.778405 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cc7c2-7d17-4643-b528-f3de5c651451 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.778702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10255bec-e68e-4618-9c84-1b3b5330add8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:54.778842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cc7c2-7d17-4643-b528-f3de5c651451 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.779240 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cc7c2-7d17-4643-b528-f3de5c651451 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.779954 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cc7c2-7d17-4643-b528-f3de5c651451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:54.782035 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cc7c2-7d17-4643-b528-f3de5c651451 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:54.790391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10255bec-e68e-4618-9c84-1b3b5330add8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:54.796532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af3e3c-beeb-444c-a03e-2998b69ee925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:54.797311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af3e3c-beeb-444c-a03e-2998b69ee925 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.797628 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af3e3c-beeb-444c-a03e-2998b69ee925 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.798015 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af3e3c-beeb-444c-a03e-2998b69ee925 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.798929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af3e3c-beeb-444c-a03e-2998b69ee925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:54.800648 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af3e3c-beeb-444c-a03e-2998b69ee925 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:54.810878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1200/2415] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:54 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:54:54.815009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cc7c2-7d17-4643-b528-f3de5c651451 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:54.818219 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1216/2416] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:54:54.819331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af3e3c-beeb-444c-a03e-2998b69ee925 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:54.830062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af3e3c-beeb-444c-a03e-2998b69ee925 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:54.884997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cc7c2-7d17-4643-b528-f3de5c651451 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:54.888874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eac833-d1ce-42e1-a9eb-f7c8ad37e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:54.889784 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eac833-d1ce-42e1-a9eb-f7c8ad37e2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.889929 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e42cd-3c66-41c4-b2af-892688499433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:54.890065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eac833-d1ce-42e1-a9eb-f7c8ad37e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.890341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eac833-d1ce-42e1-a9eb-f7c8ad37e2f8 admin admin] PATH_INFO: `/v3/projects/59e6360c5e214744ac3c8ff7e4028073/users/66dfcebe89de4bd79f1775f212f86fad/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.890863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e42cd-3c66-41c4-b2af-892688499433 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.891234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e42cd-3c66-41c4-b2af-892688499433 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.891621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e42cd-3c66-41c4-b2af-892688499433 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.892420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e42cd-3c66-41c4-b2af-892688499433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:54.894524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e42cd-3c66-41c4-b2af-892688499433 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:54.902125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:54.906880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eac833-d1ce-42e1-a9eb-f7c8ad37e2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e6360c5e214744ac3c8ff7e4028073, user_id=66dfcebe89de4bd79f1775f212f86fad, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:54.910986 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eac833-d1ce-42e1-a9eb-f7c8ad37e2f8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:54.920204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1201/2417] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:54 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:54:54.921520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e42cd-3c66-41c4-b2af-892688499433 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:54.926068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1217/2418] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:54 2022] PUT /identity/v3/projects/59e6360c5e214744ac3c8ff7e4028073/users/66dfcebe89de4bd79f1775f212f86fad/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:54:54.931815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e42cd-3c66-41c4-b2af-892688499433 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:54.936468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b712b-91e7-48d3-8162-4eb5f39e1f18 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.936782 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b712b-91e7-48d3-8162-4eb5f39e1f18 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.937059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b712b-91e7-48d3-8162-4eb5f39e1f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.968248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-bb5b712b-91e7-48d3-8162-4eb5f39e1f18 None None] MFA Rules not processed for user `66dfcebe89de4bd79f1775f212f86fad`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:54.969462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-bb5b712b-91e7-48d3-8162-4eb5f39e1f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:54.991956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28341786-1004-46cd-b4c9-8080545b2534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:54.992778 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28341786-1004-46cd-b4c9-8080545b2534 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:54.993139 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28341786-1004-46cd-b4c9-8080545b2534 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:54.993462 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28341786-1004-46cd-b4c9-8080545b2534 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:54.994198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28341786-1004-46cd-b4c9-8080545b2534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:54.995998 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28341786-1004-46cd-b4c9-8080545b2534 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:55.009429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1202/2419] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:54:55.010433 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28341786-1004-46cd-b4c9-8080545b2534 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:55.020750 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28341786-1004-46cd-b4c9-8080545b2534 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:55.025532 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737c6af-703e-43ed-a02a-7e1ee688572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:55.026185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737c6af-703e-43ed-a02a-7e1ee688572b admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:55.026463 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737c6af-703e-43ed-a02a-7e1ee688572b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:55.026736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737c6af-703e-43ed-a02a-7e1ee688572b admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:55.027525 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737c6af-703e-43ed-a02a-7e1ee688572b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:55.029119 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737c6af-703e-43ed-a02a-7e1ee688572b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:55.039370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1218/2420] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:55.042715 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1203/2421] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:54:55.043756 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b712b-91e7-48d3-8162-4eb5f39e1f18 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:55.051587 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737c6af-703e-43ed-a02a-7e1ee688572b admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:55.053515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6737c6af-703e-43ed-a02a-7e1ee688572b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:55.054393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b712b-91e7-48d3-8162-4eb5f39e1f18 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:55.058958 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d19e07-2dda-4628-89dd-165219a06e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:55.059851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d19e07-2dda-4628-89dd-165219a06e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:55.060133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d19e07-2dda-4628-89dd-165219a06e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:55.060420 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d19e07-2dda-4628-89dd-165219a06e87 admin admin] PATH_INFO: `/v3/projects/b6e28ccb6efc4e448ff52873a27c8f02/users/5d569b47ac024e2ca73b689cd500d1ad/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:55.067972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:55.077007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d19e07-2dda-4628-89dd-165219a06e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e28ccb6efc4e448ff52873a27c8f02, user_id=5d569b47ac024e2ca73b689cd500d1ad, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:55.079711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d19e07-2dda-4628-89dd-165219a06e87 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:55.093932 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1219/2422] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:55 2022] PUT /identity/v3/projects/b6e28ccb6efc4e448ff52873a27c8f02/users/5d569b47ac024e2ca73b689cd500d1ad/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:55.104677 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575c6af-c5f8-4d46-ace2-6e475ceb0de3 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:55.104992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575c6af-c5f8-4d46-ace2-6e475ceb0de3 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:55.105269 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575c6af-c5f8-4d46-ace2-6e475ceb0de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:55.114435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737c6af-703e-43ed-a02a-7e1ee688572b admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:55.131224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-9575c6af-c5f8-4d46-ace2-6e475ceb0de3 None None] MFA Rules not processed for user `5d569b47ac024e2ca73b689cd500d1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:55.132458 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9575c6af-c5f8-4d46-ace2-6e475ceb0de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:55.162772 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54c1cd-d737-454f-b1c1-a303a4f1d4c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:55.163455 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54c1cd-d737-454f-b1c1-a303a4f1d4c6 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:55.163764 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54c1cd-d737-454f-b1c1-a303a4f1d4c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:55.164045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54c1cd-d737-454f-b1c1-a303a4f1d4c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:55.198404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1220/2423] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:54:55.204931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575c6af-c5f8-4d46-ace2-6e475ceb0de3 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:55.223058 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54c1cd-d737-454f-b1c1-a303a4f1d4c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:55.224698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54c1cd-d737-454f-b1c1-a303a4f1d4c6 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:55.233877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1204/2424] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:54:55.251046 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:55.269646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575c6af-c5f8-4d46-ace2-6e475ceb0de3 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:55.274247 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485407c-49fc-489d-b8fa-4adfb07e1c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:55.274949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485407c-49fc-489d-b8fa-4adfb07e1c94 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:55.275240 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485407c-49fc-489d-b8fa-4adfb07e1c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:55.275518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485407c-49fc-489d-b8fa-4adfb07e1c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:55.276217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485407c-49fc-489d-b8fa-4adfb07e1c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:55.278134 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485407c-49fc-489d-b8fa-4adfb07e1c94 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:55.306009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1221/2425] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:55 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:54:55.309444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54c1cd-d737-454f-b1c1-a303a4f1d4c6 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:55.320383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54c1cd-d737-454f-b1c1-a303a4f1d4c6 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:55.380224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cfe05-6c82-4e0a-86a8-4fe2405c8d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:55.380909 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cfe05-6c82-4e0a-86a8-4fe2405c8d90 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:55.381214 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cfe05-6c82-4e0a-86a8-4fe2405c8d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:55.381527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cfe05-6c82-4e0a-86a8-4fe2405c8d90 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:55.382213 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cfe05-6c82-4e0a-86a8-4fe2405c8d90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:55.384286 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cfe05-6c82-4e0a-86a8-4fe2405c8d90 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:55.406533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1205/2426] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:55 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:55.410526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485407c-49fc-489d-b8fa-4adfb07e1c94 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:55.422147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485407c-49fc-489d-b8fa-4adfb07e1c94 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:55.428193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb61f6e-1a8d-483a-b7c9-6592f92c5f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:55.428871 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61f6e-1a8d-483a-b7c9-6592f92c5f7d admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:55.429158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61f6e-1a8d-483a-b7c9-6592f92c5f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:55.429438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61f6e-1a8d-483a-b7c9-6592f92c5f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:55.430177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb61f6e-1a8d-483a-b7c9-6592f92c5f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:55.431842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb61f6e-1a8d-483a-b7c9-6592f92c5f7d admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:55.447659 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1222/2427] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:54:55.449448 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cfe05-6c82-4e0a-86a8-4fe2405c8d90 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:55.460287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cfe05-6c82-4e0a-86a8-4fe2405c8d90 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:55.465279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ef1b4-d846-471d-9b07-965a925cf4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:55.466164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ef1b4-d846-471d-9b07-965a925cf4b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:55.466476 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ef1b4-d846-471d-9b07-965a925cf4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:55.466839 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ef1b4-d846-471d-9b07-965a925cf4b6 admin admin] PATH_INFO: `/v3/projects/d68786e2529142a0bf1e163b06b34464/users/4d8eb8d1da914beb8a5f0ede80987d98/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:55.478575 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:55.496591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ef1b4-d846-471d-9b07-965a925cf4b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68786e2529142a0bf1e163b06b34464, user_id=4d8eb8d1da914beb8a5f0ede80987d98, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:55.499358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ef1b4-d846-471d-9b07-965a925cf4b6 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:55.534793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1206/2428] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:55 2022] PUT /identity/v3/projects/d68786e2529142a0bf1e163b06b34464/users/4d8eb8d1da914beb8a5f0ede80987d98/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:54:55.539307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb61f6e-1a8d-483a-b7c9-6592f92c5f7d admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:55.555337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb61f6e-1a8d-483a-b7c9-6592f92c5f7d admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:55.622235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6f72a-e8cc-436d-af78-756cc3b913f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:55.623304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6f72a-e8cc-436d-af78-756cc3b913f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:55.623594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6f72a-e8cc-436d-af78-756cc3b913f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:55.623985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6f72a-e8cc-436d-af78-756cc3b913f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:55.624724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6f72a-e8cc-436d-af78-756cc3b913f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:55.626473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6f72a-e8cc-436d-af78-756cc3b913f5 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:55.637222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1223/2429] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:55.641263 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ef1b4-d846-471d-9b07-965a925cf4b6 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:55.653295 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ef1b4-d846-471d-9b07-965a925cf4b6 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:55.658262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa56e1c-2005-4012-a0ab-6cb6db35b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:55.659472 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa56e1c-2005-4012-a0ab-6cb6db35b075 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:55.659840 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa56e1c-2005-4012-a0ab-6cb6db35b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:55.660135 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa56e1c-2005-4012-a0ab-6cb6db35b075 admin admin] PATH_INFO: `/v3/projects/d68786e2529142a0bf1e163b06b34464/users/4d8eb8d1da914beb8a5f0ede80987d98/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:55.662236 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa56e1c-2005-4012-a0ab-6cb6db35b075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68786e2529142a0bf1e163b06b34464, user_id=4d8eb8d1da914beb8a5f0ede80987d98, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:55.665019 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa56e1c-2005-4012-a0ab-6cb6db35b075 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:55.676384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1207/2430] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:55 2022] PUT /identity/v3/projects/d68786e2529142a0bf1e163b06b34464/users/4d8eb8d1da914beb8a5f0ede80987d98/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:55.688081 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea53e-7333-4a3a-a957-4f2eba43bb91 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:55.688333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea53e-7333-4a3a-a957-4f2eba43bb91 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:55.688608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea53e-7333-4a3a-a957-4f2eba43bb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:55.717256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-9f6ea53e-7333-4a3a-a957-4f2eba43bb91 None None] MFA Rules not processed for user `4d8eb8d1da914beb8a5f0ede80987d98`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:55.718599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9f6ea53e-7333-4a3a-a957-4f2eba43bb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:55.803962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1224/2431] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:55.819529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa56e1c-2005-4012-a0ab-6cb6db35b075 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:55.821605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cfa56e1c-2005-4012-a0ab-6cb6db35b075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:55.899012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa56e1c-2005-4012-a0ab-6cb6db35b075 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:55.902880 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5933ff-a3ec-4541-b8c2-8195ff14eadc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:55.904163 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5933ff-a3ec-4541-b8c2-8195ff14eadc service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:55.904163 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5933ff-a3ec-4541-b8c2-8195ff14eadc service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:55.904163 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5933ff-a3ec-4541-b8c2-8195ff14eadc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:55.915027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5933ff-a3ec-4541-b8c2-8195ff14eadc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:55.916488 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5933ff-a3ec-4541-b8c2-8195ff14eadc service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:55.933796 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1208/2432] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:56.410646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ea53e-7333-4a3a-a957-4f2eba43bb91 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:56.457322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:56.477755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ea53e-7333-4a3a-a957-4f2eba43bb91 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:56.482300 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb120b4-4790-47f0-bb96-4822e4d4c2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:56.483223 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb120b4-4790-47f0-bb96-4822e4d4c2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:56.483506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb120b4-4790-47f0-bb96-4822e4d4c2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:56.483779 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb120b4-4790-47f0-bb96-4822e4d4c2a9 admin admin] PATH_INFO: `/v3/users/5d569b47ac024e2ca73b689cd500d1ad` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:56.484982 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb120b4-4790-47f0-bb96-4822e4d4c2a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d569b47ac024e2ca73b689cd500d1ad)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:56.486948 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb120b4-4790-47f0-bb96-4822e4d4c2a9 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:56.547366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6cb120b4-4790-47f0-bb96-4822e4d4c2a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d569b47ac024e2ca73b689cd500d1ad'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:56.559637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6cb120b4-4790-47f0-bb96-4822e4d4c2a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d569b47ac024e2ca73b689cd500d1ad'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:56.560335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6cb120b4-4790-47f0-bb96-4822e4d4c2a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d569b47ac024e2ca73b689cd500d1ad'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:56.570621 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6cb120b4-4790-47f0-bb96-4822e4d4c2a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d569b47ac024e2ca73b689cd500d1ad'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:56.571428 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6cb120b4-4790-47f0-bb96-4822e4d4c2a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d569b47ac024e2ca73b689cd500d1ad'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:56.600035 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1225/2433] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:56 2022] DELETE /identity/v3/users/5d569b47ac024e2ca73b689cd500d1ad => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:56.601856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d052b9-81f0-4073-ae99-eb012a9dd6bd None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:56.602317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d052b9-81f0-4073-ae99-eb012a9dd6bd None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:56.602317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d052b9-81f0-4073-ae99-eb012a9dd6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:56.622310 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-74d052b9-81f0-4073-ae99-eb012a9dd6bd None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:56.626050 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-74d052b9-81f0-4073-ae99-eb012a9dd6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:56.695870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1209/2434] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:56.706435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb120b4-4790-47f0-bb96-4822e4d4c2a9 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:56.708285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6cb120b4-4790-47f0-bb96-4822e4d4c2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:56.778571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb120b4-4790-47f0-bb96-4822e4d4c2a9 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:56.782657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce4fa9-b9ce-4ad7-8191-dfe57f966a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:56.783458 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce4fa9-b9ce-4ad7-8191-dfe57f966a63 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:56.783744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce4fa9-b9ce-4ad7-8191-dfe57f966a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:56.784021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce4fa9-b9ce-4ad7-8191-dfe57f966a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:56.802119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce4fa9-b9ce-4ad7-8191-dfe57f966a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:56.803751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce4fa9-b9ce-4ad7-8191-dfe57f966a63 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:56.820236 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1226/2435] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:57.129480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d052b9-81f0-4073-ae99-eb012a9dd6bd None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:57.130561 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-74d052b9-81f0-4073-ae99-eb012a9dd6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:57.143500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d052b9-81f0-4073-ae99-eb012a9dd6bd None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:57.148608 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:57.149485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:57.149767 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:57.150043 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] PATH_INFO: `/v3/projects/b6e28ccb6efc4e448ff52873a27c8f02` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:57.151265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e28ccb6efc4e448ff52873a27c8f02)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:57.153188 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:57.203884 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e28ccb6efc4e448ff52873a27c8f02', 'request_id': 'req-e506dbe3-1e8e-4df7-9f76-9faae8473c10'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.213773 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e28ccb6efc4e448ff52873a27c8f02', 'request_id': 'req-e506dbe3-1e8e-4df7-9f76-9faae8473c10'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.220617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e28ccb6efc4e448ff52873a27c8f02', 'request_id': 'req-e506dbe3-1e8e-4df7-9f76-9faae8473c10'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.229022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:57.233237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] The token cache is being invalidate because project b6e28ccb6efc4e448ff52873a27c8f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:57.233802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.234988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.237045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1210/2436] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:57 2022] DELETE /identity/v3/projects/b6e28ccb6efc4e448ff52873a27c8f02 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:57.241584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce4fa9-b9ce-4ad7-8191-dfe57f966a63 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:57.251616 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce4fa9-b9ce-4ad7-8191-dfe57f966a63 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:57.321741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44744a-f215-48f5-9720-f3bc704495fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:57.322636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44744a-f215-48f5-9720-f3bc704495fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:57.322949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44744a-f215-48f5-9720-f3bc704495fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:57.323221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44744a-f215-48f5-9720-f3bc704495fd admin admin] PATH_INFO: `/v3/users/4d8eb8d1da914beb8a5f0ede80987d98` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:57.324761 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44744a-f215-48f5-9720-f3bc704495fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8eb8d1da914beb8a5f0ede80987d98)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:57.326960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44744a-f215-48f5-9720-f3bc704495fd admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:57.329739 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:57.381485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-ab44744a-f215-48f5-9720-f3bc704495fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8eb8d1da914beb8a5f0ede80987d98'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.394972 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-ab44744a-f215-48f5-9720-f3bc704495fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8eb8d1da914beb8a5f0ede80987d98'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.395679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-ab44744a-f215-48f5-9720-f3bc704495fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8eb8d1da914beb8a5f0ede80987d98'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.402848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-ab44744a-f215-48f5-9720-f3bc704495fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8eb8d1da914beb8a5f0ede80987d98'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.403722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-ab44744a-f215-48f5-9720-f3bc704495fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8eb8d1da914beb8a5f0ede80987d98'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.419347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1227/2437] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:57 2022] DELETE /identity/v3/users/4d8eb8d1da914beb8a5f0ede80987d98 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:57.700296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:57.701928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:57.721738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506dbe3-1e8e-4df7-9f76-9faae8473c10 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:57.800237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:57.802064 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:57.802584 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:57.803088 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e admin admin] PATH_INFO: `/v3/projects/d68786e2529142a0bf1e163b06b34464` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:57.804793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d68786e2529142a0bf1e163b06b34464)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:57.806877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:57.861925 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd68786e2529142a0bf1e163b06b34464', 'request_id': 'req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.872826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd68786e2529142a0bf1e163b06b34464', 'request_id': 'req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.879902 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd68786e2529142a0bf1e163b06b34464', 'request_id': 'req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.892628 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e admin admin] The token cache is being invalidate because project d68786e2529142a0bf1e163b06b34464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:57.892923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.893652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f1e801d5-6a03-450f-a1d2-124ce4b8e86e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:57.895719 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1211/2438] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:57 2022] DELETE /identity/v3/projects/d68786e2529142a0bf1e163b06b34464 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:57.900810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76907890-2484-43c8-a28a-043065d6f187 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:57.901083 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76907890-2484-43c8-a28a-043065d6f187 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:57.901362 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76907890-2484-43c8-a28a-043065d6f187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:57.920064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-76907890-2484-43c8-a28a-043065d6f187 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:57.921285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-76907890-2484-43c8-a28a-043065d6f187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:57.988183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1228/2439] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:57.996042 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacf2ce-61b6-4893-9248-58a84bace799 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:57.996323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacf2ce-61b6-4893-9248-58a84bace799 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:57.996599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacf2ce-61b6-4893-9248-58a84bace799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.019371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-1dacf2ce-61b6-4893-9248-58a84bace799 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:58.021653 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-1dacf2ce-61b6-4893-9248-58a84bace799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:58.031798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1212/2440] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:58.036868 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76907890-2484-43c8-a28a-043065d6f187 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:58.046851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76907890-2484-43c8-a28a-043065d6f187 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:58.051961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f63829-aa3d-41eb-9d05-5b93387cb221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:58.052625 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63829-aa3d-41eb-9d05-5b93387cb221 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.052902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63829-aa3d-41eb-9d05-5b93387cb221 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.053174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63829-aa3d-41eb-9d05-5b93387cb221 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.053956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f63829-aa3d-41eb-9d05-5b93387cb221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:54:58.054251 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f63829-aa3d-41eb-9d05-5b93387cb221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:58.055914 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f63829-aa3d-41eb-9d05-5b93387cb221 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:58.067953 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1229/2441] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:54:58.072870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacf2ce-61b6-4893-9248-58a84bace799 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:58.086012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacf2ce-61b6-4893-9248-58a84bace799 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:58.092554 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986eee9e-f790-417a-9669-4088b4fc0c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:58.093219 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986eee9e-f790-417a-9669-4088b4fc0c54 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.093502 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986eee9e-f790-417a-9669-4088b4fc0c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.093804 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986eee9e-f790-417a-9669-4088b4fc0c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.094599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986eee9e-f790-417a-9669-4088b4fc0c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:58.096552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986eee9e-f790-417a-9669-4088b4fc0c54 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:58.125890 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1213/2442] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:58 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:54:58.130712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f63829-aa3d-41eb-9d05-5b93387cb221 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:58.140700 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f63829-aa3d-41eb-9d05-5b93387cb221 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:58.198219 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236e8dd-3fc3-446c-a17d-b7b2c54cf8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:58.199319 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236e8dd-3fc3-446c-a17d-b7b2c54cf8dd admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.199607 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236e8dd-3fc3-446c-a17d-b7b2c54cf8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.199885 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236e8dd-3fc3-446c-a17d-b7b2c54cf8dd admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.200593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236e8dd-3fc3-446c-a17d-b7b2c54cf8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:58.202535 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236e8dd-3fc3-446c-a17d-b7b2c54cf8dd admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:58.218481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:58.225676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1230/2443] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:58 2022] POST /identity/v3/users => generated 278 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:54:58.229849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986eee9e-f790-417a-9669-4088b4fc0c54 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:58.240469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986eee9e-f790-417a-9669-4088b4fc0c54 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:58.245899 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e9c7-32ea-4ed1-b7e8-fd91c242c41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:58.246569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e9c7-32ea-4ed1-b7e8-fd91c242c41d admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.246891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e9c7-32ea-4ed1-b7e8-fd91c242c41d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.247206 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e9c7-32ea-4ed1-b7e8-fd91c242c41d admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.247934 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344e9c7-32ea-4ed1-b7e8-fd91c242c41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:58.249565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344e9c7-32ea-4ed1-b7e8-fd91c242c41d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:58.261107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1214/2444] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:58.265319 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236e8dd-3fc3-446c-a17d-b7b2c54cf8dd admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:58.276704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236e8dd-3fc3-446c-a17d-b7b2c54cf8dd admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:58.282658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2793be2-f9cc-4254-823d-13ffc131c7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:58.283358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2793be2-f9cc-4254-823d-13ffc131c7eb admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.283647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2793be2-f9cc-4254-823d-13ffc131c7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.283920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2793be2-f9cc-4254-823d-13ffc131c7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.284647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2793be2-f9cc-4254-823d-13ffc131c7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:58.286744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2793be2-f9cc-4254-823d-13ffc131c7eb admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:58.298143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1231/2445] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:58.302886 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e9c7-32ea-4ed1-b7e8-fd91c242c41d admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:58.313399 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e9c7-32ea-4ed1-b7e8-fd91c242c41d admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:58.318786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e38ed-2b1f-46bd-a85d-5814957aecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:58.319640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e38ed-2b1f-46bd-a85d-5814957aecd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.319920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e38ed-2b1f-46bd-a85d-5814957aecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.320196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e38ed-2b1f-46bd-a85d-5814957aecd2 admin admin] PATH_INFO: `/v3/projects/0ad0d4b2a4b74a6788fb0cf884b2bc96/users/1a7977c3dc4d45c8971c9ac338c6025c/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.335908 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e38ed-2b1f-46bd-a85d-5814957aecd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad0d4b2a4b74a6788fb0cf884b2bc96, user_id=1a7977c3dc4d45c8971c9ac338c6025c, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:58.338574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e38ed-2b1f-46bd-a85d-5814957aecd2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:58.354961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1215/2446] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:58 2022] PUT /identity/v3/projects/0ad0d4b2a4b74a6788fb0cf884b2bc96/users/1a7977c3dc4d45c8971c9ac338c6025c/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:58.368869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e4eff-cc18-444f-bb23-2f1e5b5b36ba None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.368869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e4eff-cc18-444f-bb23-2f1e5b5b36ba None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.368869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e4eff-cc18-444f-bb23-2f1e5b5b36ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.369914 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e38ed-2b1f-46bd-a85d-5814957aecd2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:58.371772 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a68e38ed-2b1f-46bd-a85d-5814957aecd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:58.397220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-729e4eff-cc18-444f-bb23-2f1e5b5b36ba None None] MFA Rules not processed for user `1a7977c3dc4d45c8971c9ac338c6025c`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:58.398490 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-729e4eff-cc18-444f-bb23-2f1e5b5b36ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:58.404687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:58.441730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e38ed-2b1f-46bd-a85d-5814957aecd2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:58.446473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563f708-78b5-416e-967c-ad8fe1b5723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:58.447426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563f708-78b5-416e-967c-ad8fe1b5723e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.447694 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563f708-78b5-416e-967c-ad8fe1b5723e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.447961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563f708-78b5-416e-967c-ad8fe1b5723e admin admin] PATH_INFO: `/v3/users/66dfcebe89de4bd79f1775f212f86fad` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.449460 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563f708-78b5-416e-967c-ad8fe1b5723e admin admin] RBAC: Authorizing `identity:delete_user(user_id=66dfcebe89de4bd79f1775f212f86fad)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:58.451439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563f708-78b5-416e-967c-ad8fe1b5723e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:58.468014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1232/2447] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:58 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:58.472494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e4eff-cc18-444f-bb23-2f1e5b5b36ba None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:58.484162 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e4eff-cc18-444f-bb23-2f1e5b5b36ba None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:58.489020 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1632b-d160-44d7-b83f-ba4898c8e177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:58.489688 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1632b-d160-44d7-b83f-ba4898c8e177 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.489973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1632b-d160-44d7-b83f-ba4898c8e177 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.490270 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1632b-d160-44d7-b83f-ba4898c8e177 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.490935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1632b-d160-44d7-b83f-ba4898c8e177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:58.492830 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1632b-d160-44d7-b83f-ba4898c8e177 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:58.500997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-6563f708-78b5-416e-967c-ad8fe1b5723e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66dfcebe89de4bd79f1775f212f86fad'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:58.513613 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-6563f708-78b5-416e-967c-ad8fe1b5723e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66dfcebe89de4bd79f1775f212f86fad'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:58.521863 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1233/2448] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:58 2022] POST /identity/v3/projects => generated 355 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:54:58.522018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-6563f708-78b5-416e-967c-ad8fe1b5723e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66dfcebe89de4bd79f1775f212f86fad'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:58.522018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-6563f708-78b5-416e-967c-ad8fe1b5723e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66dfcebe89de4bd79f1775f212f86fad'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:58.522018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-6563f708-78b5-416e-967c-ad8fe1b5723e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66dfcebe89de4bd79f1775f212f86fad'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:58.523416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1632b-d160-44d7-b83f-ba4898c8e177 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:58.525055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a6b1632b-d160-44d7-b83f-ba4898c8e177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:58.537018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1216/2449] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:54:58 2022] DELETE /identity/v3/users/66dfcebe89de4bd79f1775f212f86fad => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:54:58.541503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840ba48-7212-4732-a5b1-58a09331bd98 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.541788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840ba48-7212-4732-a5b1-58a09331bd98 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.542069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840ba48-7212-4732-a5b1-58a09331bd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.560012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6840ba48-7212-4732-a5b1-58a09331bd98 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:58.561229 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6840ba48-7212-4732-a5b1-58a09331bd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:58.594470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1632b-d160-44d7-b83f-ba4898c8e177 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:58.624435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1217/2450] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:54:58.634394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840ba48-7212-4732-a5b1-58a09331bd98 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:58.635900 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6840ba48-7212-4732-a5b1-58a09331bd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:58.652410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f30d7-1afd-46d5-a7e3-e2a998fad46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:58.653094 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f30d7-1afd-46d5-a7e3-e2a998fad46f admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.653383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f30d7-1afd-46d5-a7e3-e2a998fad46f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.653663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f30d7-1afd-46d5-a7e3-e2a998fad46f admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.654363 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f30d7-1afd-46d5-a7e3-e2a998fad46f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:58.656340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f30d7-1afd-46d5-a7e3-e2a998fad46f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:58.664745 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:58.682284 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1234/2451] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:58 2022] POST /identity/v3/users => generated 284 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:54:58.683392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f30d7-1afd-46d5-a7e3-e2a998fad46f admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:58.687292 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:58.693658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f30d7-1afd-46d5-a7e3-e2a998fad46f admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:58.695416 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840ba48-7212-4732-a5b1-58a09331bd98 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:58.700200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686018d4-c3f0-470a-9ddd-3a87523a17c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:58.701005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686018d4-c3f0-470a-9ddd-3a87523a17c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.701365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686018d4-c3f0-470a-9ddd-3a87523a17c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.701642 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686018d4-c3f0-470a-9ddd-3a87523a17c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.701751 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2161b-2bfd-46c0-89b5-21658b18c51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:58.702385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686018d4-c3f0-470a-9ddd-3a87523a17c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:58.702888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2161b-2bfd-46c0-89b5-21658b18c51c service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.703171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2161b-2bfd-46c0-89b5-21658b18c51c service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.703441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2161b-2bfd-46c0-89b5-21658b18c51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.704048 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686018d4-c3f0-470a-9ddd-3a87523a17c5 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:58.714222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2161b-2bfd-46c0-89b5-21658b18c51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:58.715879 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1235/2452] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:58.716213 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2161b-2bfd-46c0-89b5-21658b18c51c service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:58.719970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686018d4-c3f0-470a-9ddd-3a87523a17c5 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:58.727860 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1218/2453] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:58.729483 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686018d4-c3f0-470a-9ddd-3a87523a17c5 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:58.734007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9a41b-e750-4c38-b003-2c00261061fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:58.734927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a41b-e750-4c38-b003-2c00261061fb admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.735207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a41b-e750-4c38-b003-2c00261061fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.735482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a41b-e750-4c38-b003-2c00261061fb admin admin] PATH_INFO: `/v3/projects/75d0cbd0933348e2a5d7588e67743d29/users/1de379c963fe43de86191bfc7ff3a325/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.751043 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9a41b-e750-4c38-b003-2c00261061fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d0cbd0933348e2a5d7588e67743d29, user_id=1de379c963fe43de86191bfc7ff3a325, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:58.753907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9a41b-e750-4c38-b003-2c00261061fb admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:58.770683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1236/2454] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:58 2022] PUT /identity/v3/projects/75d0cbd0933348e2a5d7588e67743d29/users/1de379c963fe43de86191bfc7ff3a325/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:54:58.775158 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2161b-2bfd-46c0-89b5-21658b18c51c service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:58.785723 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2161b-2bfd-46c0-89b5-21658b18c51c service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:58.852311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cee753-7ae5-4df9-91c7-694d5b044353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:58.853296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cee753-7ae5-4df9-91c7-694d5b044353 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.853296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cee753-7ae5-4df9-91c7-694d5b044353 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.853516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cee753-7ae5-4df9-91c7-694d5b044353 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.854206 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cee753-7ae5-4df9-91c7-694d5b044353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:58.855896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cee753-7ae5-4df9-91c7-694d5b044353 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:58.867076 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1219/2455] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:58.871276 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9a41b-e750-4c38-b003-2c00261061fb admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:58.896318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9a41b-e750-4c38-b003-2c00261061fb admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:58.901610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b54f55-f487-4b6d-8b45-fd7715e876cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:58.902515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b54f55-f487-4b6d-8b45-fd7715e876cf admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.902831 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b54f55-f487-4b6d-8b45-fd7715e876cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.903110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b54f55-f487-4b6d-8b45-fd7715e876cf admin admin] PATH_INFO: `/v3/projects/75d0cbd0933348e2a5d7588e67743d29/users/1de379c963fe43de86191bfc7ff3a325/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.905341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b54f55-f487-4b6d-8b45-fd7715e876cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d0cbd0933348e2a5d7588e67743d29, user_id=1de379c963fe43de86191bfc7ff3a325, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:58.908653 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b54f55-f487-4b6d-8b45-fd7715e876cf admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:58.920099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1237/2456] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:58 2022] PUT /identity/v3/projects/75d0cbd0933348e2a5d7588e67743d29/users/1de379c963fe43de86191bfc7ff3a325/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:54:58.930625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdd357-1eb5-4291-a2c6-66104e17547d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:58.930960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdd357-1eb5-4291-a2c6-66104e17547d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:58.931232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdd357-1eb5-4291-a2c6-66104e17547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:58.958629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-8dfdd357-1eb5-4291-a2c6-66104e17547d None None] MFA Rules not processed for user `1de379c963fe43de86191bfc7ff3a325`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:58.959888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8dfdd357-1eb5-4291-a2c6-66104e17547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:59.019516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b54f55-f487-4b6d-8b45-fd7715e876cf admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:59.021495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e0b54f55-f487-4b6d-8b45-fd7715e876cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:59.065322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1220/2457] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:58 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:59.078996 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdd357-1eb5-4291-a2c6-66104e17547d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:59.082611 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8dfdd357-1eb5-4291-a2c6-66104e17547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:59.108459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b54f55-f487-4b6d-8b45-fd7715e876cf admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:59.113983 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:59.115305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:59.115305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:59.115571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] PATH_INFO: `/v3/projects/59e6360c5e214744ac3c8ff7e4028073` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:59.117291 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59e6360c5e214744ac3c8ff7e4028073)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:59.119268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:59.155850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdd357-1eb5-4291-a2c6-66104e17547d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:59.162219 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6506c3-29a4-413e-bceb-614b2f46cf46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:59.163017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6506c3-29a4-413e-bceb-614b2f46cf46 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:59.163379 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6506c3-29a4-413e-bceb-614b2f46cf46 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:59.163863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6506c3-29a4-413e-bceb-614b2f46cf46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:59.175433 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6506c3-29a4-413e-bceb-614b2f46cf46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:59.178188 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6506c3-29a4-413e-bceb-614b2f46cf46 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:59.180759 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e6360c5e214744ac3c8ff7e4028073', 'request_id': 'req-9e3793cb-06aa-4cde-8874-3880429d8571'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:59.192107 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e6360c5e214744ac3c8ff7e4028073', 'request_id': 'req-9e3793cb-06aa-4cde-8874-3880429d8571'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:59.192836 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1221/2458] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:59 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:54:59.201924 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e6360c5e214744ac3c8ff7e4028073', 'request_id': 'req-9e3793cb-06aa-4cde-8874-3880429d8571'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:59.214979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] The token cache is being invalidate because project 59e6360c5e214744ac3c8ff7e4028073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:54:59.215347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:59.216048 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:54:59.217964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1238/2459] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:54:59 2022] DELETE /identity/v3/projects/59e6360c5e214744ac3c8ff7e4028073 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:59.224383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbbf67-aef0-416f-ab85-a2e342055497 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:59.224383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbbf67-aef0-416f-ab85-a2e342055497 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:59.224663 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbbf67-aef0-416f-ab85-a2e342055497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:59.253459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-10bbbf67-aef0-416f-ab85-a2e342055497 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:59.255495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-10bbbf67-aef0-416f-ab85-a2e342055497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:59.268973 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:59.291463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:59.292978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:59.336511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1222/2460] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:59.338406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:59.345571 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4170b3-b627-48a6-aaee-2ea006c0f1f7 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:59.345879 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4170b3-b627-48a6-aaee-2ea006c0f1f7 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:59.346141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4170b3-b627-48a6-aaee-2ea006c0f1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:59.365545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-7c4170b3-b627-48a6-aaee-2ea006c0f1f7 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:59.365743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3793cb-06aa-4cde-8874-3880429d8571 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:59.366811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7c4170b3-b627-48a6-aaee-2ea006c0f1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:59.370716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b42b06-ca62-478d-b26f-e50b86c911de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:59.371507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b42b06-ca62-478d-b26f-e50b86c911de service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:59.371794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b42b06-ca62-478d-b26f-e50b86c911de service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:59.372075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b42b06-ca62-478d-b26f-e50b86c911de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:59.374078 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e5b42b06-ca62-478d-b26f-e50b86c911de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:59.376938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1223/2461] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:54:59.381173 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4170b3-b627-48a6-aaee-2ea006c0f1f7 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:59.390575 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4170b3-b627-48a6-aaee-2ea006c0f1f7 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:59.395407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321d6d2-7021-4595-97b6-f38c6751839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:59.396055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321d6d2-7021-4595-97b6-f38c6751839b admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:59.396340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321d6d2-7021-4595-97b6-f38c6751839b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:59.396613 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321d6d2-7021-4595-97b6-f38c6751839b admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:59.397350 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321d6d2-7021-4595-97b6-f38c6751839b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:54:59.397659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321d6d2-7021-4595-97b6-f38c6751839b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:59.400002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321d6d2-7021-4595-97b6-f38c6751839b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:59.412964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1224/2462] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:54:59.417130 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321d6d2-7021-4595-97b6-f38c6751839b admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:59.429089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321d6d2-7021-4595-97b6-f38c6751839b admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:59.433813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb4fa6-ff39-40dc-a076-8c503848a9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:59.434468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb4fa6-ff39-40dc-a076-8c503848a9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:59.434746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb4fa6-ff39-40dc-a076-8c503848a9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:59.435052 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb4fa6-ff39-40dc-a076-8c503848a9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:59.435737 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb4fa6-ff39-40dc-a076-8c503848a9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:59.437802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb4fa6-ff39-40dc-a076-8c503848a9b6 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:59.439844 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b42b06-ca62-478d-b26f-e50b86c911de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:59.441301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b42b06-ca62-478d-b26f-e50b86c911de service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:59.451507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1239/2463] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:59 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:54:59.470345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1225/2464] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:54:59 2022] POST /identity/v3/projects => generated 361 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:54:59.474701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b42b06-ca62-478d-b26f-e50b86c911de service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:59.486005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b42b06-ca62-478d-b26f-e50b86c911de service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:59.545356 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e1968-ae37-4c43-bb1f-5e01bc81a0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:59.546048 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e1968-ae37-4c43-bb1f-5e01bc81a0bb admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:59.546333 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e1968-ae37-4c43-bb1f-5e01bc81a0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:59.546609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e1968-ae37-4c43-bb1f-5e01bc81a0bb admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:59.547356 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e1968-ae37-4c43-bb1f-5e01bc81a0bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:59.549301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e1968-ae37-4c43-bb1f-5e01bc81a0bb admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:59.578355 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1240/2465] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:54:59 2022] POST /identity/v3/users => generated 281 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:54:59.579647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb4fa6-ff39-40dc-a076-8c503848a9b6 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:59.593719 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb4fa6-ff39-40dc-a076-8c503848a9b6 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:59.600850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd86b6-b814-4ef3-b1c6-fac236c3b4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:59.601544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd86b6-b814-4ef3-b1c6-fac236c3b4df admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:59.601983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd86b6-b814-4ef3-b1c6-fac236c3b4df admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:59.602413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd86b6-b814-4ef3-b1c6-fac236c3b4df admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:59.603456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd86b6-b814-4ef3-b1c6-fac236c3b4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:59.605891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd86b6-b814-4ef3-b1c6-fac236c3b4df admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:59.617455 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1226/2466] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:54:59.621495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e1968-ae37-4c43-bb1f-5e01bc81a0bb admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:59.631584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e1968-ae37-4c43-bb1f-5e01bc81a0bb admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:59.636039 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30910fd7-0c71-4948-86ca-ea874c0d6921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:59.636705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30910fd7-0c71-4948-86ca-ea874c0d6921 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:59.636976 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30910fd7-0c71-4948-86ca-ea874c0d6921 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:59.637249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30910fd7-0c71-4948-86ca-ea874c0d6921 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:59.637976 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30910fd7-0c71-4948-86ca-ea874c0d6921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:59.639618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30910fd7-0c71-4948-86ca-ea874c0d6921 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:59.649962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1241/2467] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:54:59.654260 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd86b6-b814-4ef3-b1c6-fac236c3b4df admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:59.664298 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd86b6-b814-4ef3-b1c6-fac236c3b4df admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:59.668931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b913e0-6a37-45ff-a951-a837189d9f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:59.669818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b913e0-6a37-45ff-a951-a837189d9f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:59.670101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b913e0-6a37-45ff-a951-a837189d9f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:59.670381 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b913e0-6a37-45ff-a951-a837189d9f48 admin admin] PATH_INFO: `/v3/projects/eaf6f90bfc7144459630cf11c578905a/users/b7cc504771b944009a42915445058ebd/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:59.685012 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b913e0-6a37-45ff-a951-a837189d9f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf6f90bfc7144459630cf11c578905a, user_id=b7cc504771b944009a42915445058ebd, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:59.687725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b913e0-6a37-45ff-a951-a837189d9f48 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:59.702721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1227/2468] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:54:59 2022] PUT /identity/v3/projects/eaf6f90bfc7144459630cf11c578905a/users/b7cc504771b944009a42915445058ebd/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:54:59.713521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ae737-06c3-4b38-bbab-ec2a1c1e907e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:59.713784 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ae737-06c3-4b38-bbab-ec2a1c1e907e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:59.714089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ae737-06c3-4b38-bbab-ec2a1c1e907e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:59.741794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-529ae737-06c3-4b38-bbab-ec2a1c1e907e None None] MFA Rules not processed for user `b7cc504771b944009a42915445058ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:54:59.743078 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-529ae737-06c3-4b38-bbab-ec2a1c1e907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:54:59.806520 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:54:59.817362 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1242/2469] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:54:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:54:59.829125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b913e0-6a37-45ff-a951-a837189d9f48 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:54:59.886224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b913e0-6a37-45ff-a951-a837189d9f48 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:54:59.890347 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba40660-b1c9-4542-bb80-be821e50ded1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:54:59.891045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba40660-b1c9-4542-bb80-be821e50ded1 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:54:59.891326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba40660-b1c9-4542-bb80-be821e50ded1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:54:59.891602 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba40660-b1c9-4542-bb80-be821e50ded1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:54:59.900344 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba40660-b1c9-4542-bb80-be821e50ded1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:54:59.901793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba40660-b1c9-4542-bb80-be821e50ded1 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:54:59.910658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1228/2470] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:54:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:00.158021 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ae737-06c3-4b38-bbab-ec2a1c1e907e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:00.159517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-529ae737-06c3-4b38-bbab-ec2a1c1e907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:00.238149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ae737-06c3-4b38-bbab-ec2a1c1e907e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:00.243694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70690d0b-104c-4758-b09f-68d4aa8214e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:00.244588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70690d0b-104c-4758-b09f-68d4aa8214e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:00.244868 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70690d0b-104c-4758-b09f-68d4aa8214e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:00.245140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70690d0b-104c-4758-b09f-68d4aa8214e7 admin admin] PATH_INFO: `/v3/users/b006850d42b44b1aa8511d1dd1819518` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:00.246347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70690d0b-104c-4758-b09f-68d4aa8214e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b006850d42b44b1aa8511d1dd1819518)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:00.248324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70690d0b-104c-4758-b09f-68d4aa8214e7 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:00.298167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-70690d0b-104c-4758-b09f-68d4aa8214e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b006850d42b44b1aa8511d1dd1819518'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:00.310933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-70690d0b-104c-4758-b09f-68d4aa8214e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b006850d42b44b1aa8511d1dd1819518'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:00.311615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-70690d0b-104c-4758-b09f-68d4aa8214e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b006850d42b44b1aa8511d1dd1819518'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:00.319285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-70690d0b-104c-4758-b09f-68d4aa8214e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b006850d42b44b1aa8511d1dd1819518'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:00.320022 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-70690d0b-104c-4758-b09f-68d4aa8214e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b006850d42b44b1aa8511d1dd1819518'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:00.335402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1243/2471] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:00 2022] DELETE /identity/v3/users/b006850d42b44b1aa8511d1dd1819518 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:00.340278 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f79b0b-0fc8-41cf-a0c5-8df27eb71e7b None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:00.340560 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f79b0b-0fc8-41cf-a0c5-8df27eb71e7b None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:00.340840 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f79b0b-0fc8-41cf-a0c5-8df27eb71e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:00.358409 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-73f79b0b-0fc8-41cf-a0c5-8df27eb71e7b None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:00.359651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-73f79b0b-0fc8-41cf-a0c5-8df27eb71e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:00.407131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:00.433626 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1229/2472] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:00.444791 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70690d0b-104c-4758-b09f-68d4aa8214e7 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:00.446310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-70690d0b-104c-4758-b09f-68d4aa8214e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:00.506753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70690d0b-104c-4758-b09f-68d4aa8214e7 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:00.510573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03d57a-a372-4e5b-bc3f-9b95f6ba11be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:00.511257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03d57a-a372-4e5b-bc3f-9b95f6ba11be service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:00.511539 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03d57a-a372-4e5b-bc3f-9b95f6ba11be service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:00.511815 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03d57a-a372-4e5b-bc3f-9b95f6ba11be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:00.521103 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03d57a-a372-4e5b-bc3f-9b95f6ba11be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:00.522825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03d57a-a372-4e5b-bc3f-9b95f6ba11be service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:00.532328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1244/2473] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:00.804129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f79b0b-0fc8-41cf-a0c5-8df27eb71e7b None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:00.805672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-73f79b0b-0fc8-41cf-a0c5-8df27eb71e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:00.819954 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f79b0b-0fc8-41cf-a0c5-8df27eb71e7b None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:00.825302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ec85b-e4fa-4b52-b53d-113f17fd7729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:00.826671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ec85b-e4fa-4b52-b53d-113f17fd7729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:00.826998 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ec85b-e4fa-4b52-b53d-113f17fd7729 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:00.827316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ec85b-e4fa-4b52-b53d-113f17fd7729 admin admin] PATH_INFO: `/v3/projects/a38bbb2a795445bdb8d277b01e9f1ab5` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:00.828785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ec85b-e4fa-4b52-b53d-113f17fd7729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a38bbb2a795445bdb8d277b01e9f1ab5)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:00.830816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ec85b-e4fa-4b52-b53d-113f17fd7729 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:00.881319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-145ec85b-e4fa-4b52-b53d-113f17fd7729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a38bbb2a795445bdb8d277b01e9f1ab5', 'request_id': 'req-145ec85b-e4fa-4b52-b53d-113f17fd7729'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:00.889003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-145ec85b-e4fa-4b52-b53d-113f17fd7729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a38bbb2a795445bdb8d277b01e9f1ab5', 'request_id': 'req-145ec85b-e4fa-4b52-b53d-113f17fd7729'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:00.894649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-145ec85b-e4fa-4b52-b53d-113f17fd7729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a38bbb2a795445bdb8d277b01e9f1ab5', 'request_id': 'req-145ec85b-e4fa-4b52-b53d-113f17fd7729'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:00.905855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-145ec85b-e4fa-4b52-b53d-113f17fd7729 admin admin] The token cache is being invalidate because project a38bbb2a795445bdb8d277b01e9f1ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:00.906071 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-145ec85b-e4fa-4b52-b53d-113f17fd7729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:00.906689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-145ec85b-e4fa-4b52-b53d-113f17fd7729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:00.908290 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1230/2474] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:00 2022] DELETE /identity/v3/projects/a38bbb2a795445bdb8d277b01e9f1ab5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:00.913531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c824f6d-9315-4819-84c6-a8558a7d353c None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:00.913861 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c824f6d-9315-4819-84c6-a8558a7d353c None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:00.914144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c824f6d-9315-4819-84c6-a8558a7d353c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:00.932491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-2c824f6d-9315-4819-84c6-a8558a7d353c None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:00.933730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2c824f6d-9315-4819-84c6-a8558a7d353c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:00.946793 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:00.997391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1245/2475] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:01.005641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc7706-0405-4792-b643-11cda6715536 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.005951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc7706-0405-4792-b643-11cda6715536 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.006222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc7706-0405-4792-b643-11cda6715536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.026552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-fcdc7706-0405-4792-b643-11cda6715536 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:01.027798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-fcdc7706-0405-4792-b643-11cda6715536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:01.036851 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1231/2476] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:01.041396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c824f6d-9315-4819-84c6-a8558a7d353c None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:01.051369 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c824f6d-9315-4819-84c6-a8558a7d353c None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:01.057227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3854c-6f65-4803-a175-6d9b869ae377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:01.057931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3854c-6f65-4803-a175-6d9b869ae377 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.058211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3854c-6f65-4803-a175-6d9b869ae377 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.058478 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3854c-6f65-4803-a175-6d9b869ae377 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.059423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3854c-6f65-4803-a175-6d9b869ae377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:01.059559 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3854c-6f65-4803-a175-6d9b869ae377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:01.061237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3854c-6f65-4803-a175-6d9b869ae377 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:01.078367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1246/2477] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:55:01.082912 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc7706-0405-4792-b643-11cda6715536 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:01.092395 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc7706-0405-4792-b643-11cda6715536 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:01.098185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05714b2a-4f27-4cfe-92f4-73a6612be481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:01.098865 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05714b2a-4f27-4cfe-92f4-73a6612be481 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.099134 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05714b2a-4f27-4cfe-92f4-73a6612be481 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.099406 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05714b2a-4f27-4cfe-92f4-73a6612be481 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.100126 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05714b2a-4f27-4cfe-92f4-73a6612be481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:01.102033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05714b2a-4f27-4cfe-92f4-73a6612be481 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:01.141515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1232/2478] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:01 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:01.145833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3854c-6f65-4803-a175-6d9b869ae377 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:01.156419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3854c-6f65-4803-a175-6d9b869ae377 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:01.232062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0746b-946b-4397-bd54-209807e80f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:01.233910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0746b-946b-4397-bd54-209807e80f23 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.234207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0746b-946b-4397-bd54-209807e80f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.234518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0746b-946b-4397-bd54-209807e80f23 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.235312 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0746b-946b-4397-bd54-209807e80f23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:01.237337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0746b-946b-4397-bd54-209807e80f23 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:01.261065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1247/2479] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:01 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:01.265311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05714b2a-4f27-4cfe-92f4-73a6612be481 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:01.276109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05714b2a-4f27-4cfe-92f4-73a6612be481 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:01.280966 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7c9ae-8538-4b9a-8c1b-47bc54bd9e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:01.281650 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7c9ae-8538-4b9a-8c1b-47bc54bd9e8e admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.281891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7c9ae-8538-4b9a-8c1b-47bc54bd9e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.282141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7c9ae-8538-4b9a-8c1b-47bc54bd9e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.283030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7c9ae-8538-4b9a-8c1b-47bc54bd9e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:01.284689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7c9ae-8538-4b9a-8c1b-47bc54bd9e8e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:01.295458 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1233/2480] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:01.299678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0746b-946b-4397-bd54-209807e80f23 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:01.311060 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0746b-946b-4397-bd54-209807e80f23 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:01.324992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd82b0-d5be-4a0f-b359-b187b2df0534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:01.324992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd82b0-d5be-4a0f-b359-b187b2df0534 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.324992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd82b0-d5be-4a0f-b359-b187b2df0534 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.324992 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd82b0-d5be-4a0f-b359-b187b2df0534 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.325376 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd82b0-d5be-4a0f-b359-b187b2df0534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:01.325376 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd82b0-d5be-4a0f-b359-b187b2df0534 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:01.330599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1248/2481] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:01.335218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7c9ae-8538-4b9a-8c1b-47bc54bd9e8e admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:01.347680 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7c9ae-8538-4b9a-8c1b-47bc54bd9e8e admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:01.353262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a29ff7-4588-4b60-a04a-c87199116c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:01.354150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a29ff7-4588-4b60-a04a-c87199116c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.354444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a29ff7-4588-4b60-a04a-c87199116c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.354718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a29ff7-4588-4b60-a04a-c87199116c45 admin admin] PATH_INFO: `/v3/projects/da57111ee8d84d6f9f04ef49579a2776/users/37588e9c54d3466395a63544120b9254/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.370271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a29ff7-4588-4b60-a04a-c87199116c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da57111ee8d84d6f9f04ef49579a2776, user_id=37588e9c54d3466395a63544120b9254, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:01.372978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a29ff7-4588-4b60-a04a-c87199116c45 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:01.388768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1234/2482] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:01 2022] PUT /identity/v3/projects/da57111ee8d84d6f9f04ef49579a2776/users/37588e9c54d3466395a63544120b9254/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:01.400623 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25022f5-dde5-43ce-91bf-8dd4989bfb14 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.401095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25022f5-dde5-43ce-91bf-8dd4989bfb14 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.401424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25022f5-dde5-43ce-91bf-8dd4989bfb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.431101 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e25022f5-dde5-43ce-91bf-8dd4989bfb14 None None] MFA Rules not processed for user `37588e9c54d3466395a63544120b9254`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:01.432301 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e25022f5-dde5-43ce-91bf-8dd4989bfb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:01.498516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1249/2483] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:01.503255 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a29ff7-4588-4b60-a04a-c87199116c45 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:01.556304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:01.570562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a29ff7-4588-4b60-a04a-c87199116c45 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:01.576478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8603b1d-4936-45fb-8953-8993ec23cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:01.577142 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8603b1d-4936-45fb-8953-8993ec23cdce admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.577420 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8603b1d-4936-45fb-8953-8993ec23cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.577689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8603b1d-4936-45fb-8953-8993ec23cdce admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.578376 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8603b1d-4936-45fb-8953-8993ec23cdce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:01.580468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8603b1d-4936-45fb-8953-8993ec23cdce admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:01.607765 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1235/2484] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:01 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:01.611809 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25022f5-dde5-43ce-91bf-8dd4989bfb14 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:01.623009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25022f5-dde5-43ce-91bf-8dd4989bfb14 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:01.632643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:01.685994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa36f2-4806-415b-a433-3f0fb812101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:01.686811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa36f2-4806-415b-a433-3f0fb812101f admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.687399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa36f2-4806-415b-a433-3f0fb812101f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.687600 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa36f2-4806-415b-a433-3f0fb812101f admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.688463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa36f2-4806-415b-a433-3f0fb812101f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:01.690719 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa36f2-4806-415b-a433-3f0fb812101f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:01.715416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1250/2485] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:01 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:01.719405 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8603b1d-4936-45fb-8953-8993ec23cdce admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:01.731276 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8603b1d-4936-45fb-8953-8993ec23cdce admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:01.736816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60933eb4-7676-4ea6-9296-9a251854d250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:01.737595 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60933eb4-7676-4ea6-9296-9a251854d250 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.737981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60933eb4-7676-4ea6-9296-9a251854d250 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.738311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60933eb4-7676-4ea6-9296-9a251854d250 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.739140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60933eb4-7676-4ea6-9296-9a251854d250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:01.740873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60933eb4-7676-4ea6-9296-9a251854d250 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:01.752487 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1236/2486] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:01.756674 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa36f2-4806-415b-a433-3f0fb812101f admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:01.767016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa36f2-4806-415b-a433-3f0fb812101f admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:01.771810 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b341ed-2c46-4c66-a92a-cd1f6a5dee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:01.772855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b341ed-2c46-4c66-a92a-cd1f6a5dee57 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.773149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b341ed-2c46-4c66-a92a-cd1f6a5dee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.773556 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b341ed-2c46-4c66-a92a-cd1f6a5dee57 admin admin] PATH_INFO: `/v3/projects/6fd26b6f51db41789947a2036720ba0d/users/c872bd1bb568486fb42f8c3a322e3adf/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.789959 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b341ed-2c46-4c66-a92a-cd1f6a5dee57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd26b6f51db41789947a2036720ba0d, user_id=c872bd1bb568486fb42f8c3a322e3adf, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:01.792800 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b341ed-2c46-4c66-a92a-cd1f6a5dee57 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:01.808082 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1251/2487] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:01 2022] PUT /identity/v3/projects/6fd26b6f51db41789947a2036720ba0d/users/c872bd1bb568486fb42f8c3a322e3adf/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:01.812367 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60933eb4-7676-4ea6-9296-9a251854d250 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:01.823916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60933eb4-7676-4ea6-9296-9a251854d250 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:01.884698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c526884-7810-4794-95b4-ac955d467404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:01.885380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c526884-7810-4794-95b4-ac955d467404 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.885656 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c526884-7810-4794-95b4-ac955d467404 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.885929 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c526884-7810-4794-95b4-ac955d467404 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.886662 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c526884-7810-4794-95b4-ac955d467404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:01.888497 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c526884-7810-4794-95b4-ac955d467404 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:01.899148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1237/2488] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:01.903298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b341ed-2c46-4c66-a92a-cd1f6a5dee57 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:01.913796 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b341ed-2c46-4c66-a92a-cd1f6a5dee57 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:01.918287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40508f1-aecc-4da9-9511-c59e9e65f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:01.919206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40508f1-aecc-4da9-9511-c59e9e65f853 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.919484 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40508f1-aecc-4da9-9511-c59e9e65f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.919755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40508f1-aecc-4da9-9511-c59e9e65f853 admin admin] PATH_INFO: `/v3/projects/6fd26b6f51db41789947a2036720ba0d/users/c872bd1bb568486fb42f8c3a322e3adf/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.921735 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40508f1-aecc-4da9-9511-c59e9e65f853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd26b6f51db41789947a2036720ba0d, user_id=c872bd1bb568486fb42f8c3a322e3adf, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:01.924427 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40508f1-aecc-4da9-9511-c59e9e65f853 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:01.934845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1252/2489] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:01 2022] PUT /identity/v3/projects/6fd26b6f51db41789947a2036720ba0d/users/c872bd1bb568486fb42f8c3a322e3adf/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:01.945435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f8829-e045-4156-8c58-38349b106f16 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:01.945793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f8829-e045-4156-8c58-38349b106f16 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:01.946019 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f8829-e045-4156-8c58-38349b106f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:01.975743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-381f8829-e045-4156-8c58-38349b106f16 None None] MFA Rules not processed for user `c872bd1bb568486fb42f8c3a322e3adf`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:01.977405 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-381f8829-e045-4156-8c58-38349b106f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:02.050138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1238/2490] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:02.062210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40508f1-aecc-4da9-9511-c59e9e65f853 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:02.064489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e40508f1-aecc-4da9-9511-c59e9e65f853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:02.137396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40508f1-aecc-4da9-9511-c59e9e65f853 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:02.141735 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda90a5-10d5-41c6-b91f-616cba2e4013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:02.142395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda90a5-10d5-41c6-b91f-616cba2e4013 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:02.142676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda90a5-10d5-41c6-b91f-616cba2e4013 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:02.143251 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda90a5-10d5-41c6-b91f-616cba2e4013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:02.153397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda90a5-10d5-41c6-b91f-616cba2e4013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:02.155004 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda90a5-10d5-41c6-b91f-616cba2e4013 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:02.167450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1253/2491] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:02.246432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f8829-e045-4156-8c58-38349b106f16 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:02.256384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f8829-e045-4156-8c58-38349b106f16 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:02.260589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf52fa2-f87f-4391-8e29-c7e802f1b105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:02.261233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52fa2-f87f-4391-8e29-c7e802f1b105 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:02.261515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52fa2-f87f-4391-8e29-c7e802f1b105 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:02.261786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52fa2-f87f-4391-8e29-c7e802f1b105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:02.306464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:02.321343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf52fa2-f87f-4391-8e29-c7e802f1b105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:02.322829 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf52fa2-f87f-4391-8e29-c7e802f1b105 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:02.332020 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1239/2492] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:11.520953 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda90a5-10d5-41c6-b91f-616cba2e4013 service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:11.522424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9cda90a5-10d5-41c6-b91f-616cba2e4013 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:11.588669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda90a5-10d5-41c6-b91f-616cba2e4013 service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:11.593484 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0de2fc-b511-40bf-8a2d-4f5d81b86734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:11.594135 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de2fc-b511-40bf-8a2d-4f5d81b86734 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:11.594415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de2fc-b511-40bf-8a2d-4f5d81b86734 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:11.594689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de2fc-b511-40bf-8a2d-4f5d81b86734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:11.596516 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ac0de2fc-b511-40bf-8a2d-4f5d81b86734 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:11.618164 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:11.667243 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0de2fc-b511-40bf-8a2d-4f5d81b86734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:11.668843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0de2fc-b511-40bf-8a2d-4f5d81b86734 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:11.679097 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1254/2493] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:12.328007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=7 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:14.660677 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf52fa2-f87f-4391-8e29-c7e802f1b105 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:14.663686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-1bf52fa2-f87f-4391-8e29-c7e802f1b105 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:14.699886 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf52fa2-f87f-4391-8e29-c7e802f1b105 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:14.707643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600d3f6-6057-4db5-bad5-db30789c066c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:14.708846 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600d3f6-6057-4db5-bad5-db30789c066c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:14.709559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600d3f6-6057-4db5-bad5-db30789c066c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:14.709559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600d3f6-6057-4db5-bad5-db30789c066c admin admin] PATH_INFO: `/v3/users/1a7977c3dc4d45c8971c9ac338c6025c` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:14.711690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600d3f6-6057-4db5-bad5-db30789c066c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a7977c3dc4d45c8971c9ac338c6025c)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:14.714425 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600d3f6-6057-4db5-bad5-db30789c066c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:14.782928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3600d3f6-6057-4db5-bad5-db30789c066c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a7977c3dc4d45c8971c9ac338c6025c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:14.799613 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3600d3f6-6057-4db5-bad5-db30789c066c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a7977c3dc4d45c8971c9ac338c6025c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:14.808524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3600d3f6-6057-4db5-bad5-db30789c066c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a7977c3dc4d45c8971c9ac338c6025c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:14.809900 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3600d3f6-6057-4db5-bad5-db30789c066c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a7977c3dc4d45c8971c9ac338c6025c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:14.811431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3600d3f6-6057-4db5-bad5-db30789c066c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a7977c3dc4d45c8971c9ac338c6025c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:14.831580 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1240/2494] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:14 2022] DELETE /identity/v3/users/1a7977c3dc4d45c8971c9ac338c6025c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:14.836445 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b67bd8-9845-4501-a98a-86a3a2153aa7 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:14.836970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b67bd8-9845-4501-a98a-86a3a2153aa7 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:14.837064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b67bd8-9845-4501-a98a-86a3a2153aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:14.862754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-27b67bd8-9845-4501-a98a-86a3a2153aa7 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:14.864000 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-27b67bd8-9845-4501-a98a-86a3a2153aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:14.928384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600d3f6-6057-4db5-bad5-db30789c066c admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:14.930475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3600d3f6-6057-4db5-bad5-db30789c066c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:14.959590 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1255/2495] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:14.972278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b67bd8-9845-4501-a98a-86a3a2153aa7 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:14.973834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-27b67bd8-9845-4501-a98a-86a3a2153aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:15.037651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600d3f6-6057-4db5-bad5-db30789c066c admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:15.049182 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b67bd8-9845-4501-a98a-86a3a2153aa7 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:15.049731 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843a9d1-15f2-4e56-bb3f-faa714387afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:15.050751 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843a9d1-15f2-4e56-bb3f-faa714387afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:15.051119 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843a9d1-15f2-4e56-bb3f-faa714387afd admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:15.051331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843a9d1-15f2-4e56-bb3f-faa714387afd admin admin] PATH_INFO: `/v3/users/f6dd88c437b74acfb3b54e4b8fd47e89` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:15.052707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843a9d1-15f2-4e56-bb3f-faa714387afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6dd88c437b74acfb3b54e4b8fd47e89)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:15.053712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417b69-c1dd-4e29-bdea-6e7b8a92932d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:15.054572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417b69-c1dd-4e29-bdea-6e7b8a92932d service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:15.054701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843a9d1-15f2-4e56-bb3f-faa714387afd admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:15.054947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417b69-c1dd-4e29-bdea-6e7b8a92932d service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:15.055269 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417b69-c1dd-4e29-bdea-6e7b8a92932d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:15.068673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417b69-c1dd-4e29-bdea-6e7b8a92932d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:15.070208 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417b69-c1dd-4e29-bdea-6e7b8a92932d service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:15.084633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1256/2496] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:15.122211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4843a9d1-15f2-4e56-bb3f-faa714387afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6dd88c437b74acfb3b54e4b8fd47e89'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.144847 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4843a9d1-15f2-4e56-bb3f-faa714387afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6dd88c437b74acfb3b54e4b8fd47e89'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.153336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4843a9d1-15f2-4e56-bb3f-faa714387afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6dd88c437b74acfb3b54e4b8fd47e89'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.154245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4843a9d1-15f2-4e56-bb3f-faa714387afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6dd88c437b74acfb3b54e4b8fd47e89'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.155202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4843a9d1-15f2-4e56-bb3f-faa714387afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6dd88c437b74acfb3b54e4b8fd47e89'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.157375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:15.173805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1241/2497] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:14 2022] DELETE /identity/v3/users/f6dd88c437b74acfb3b54e4b8fd47e89 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:15.489508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417b69-c1dd-4e29-bdea-6e7b8a92932d service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:15.497980 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843a9d1-15f2-4e56-bb3f-faa714387afd admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:15.499568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-4843a9d1-15f2-4e56-bb3f-faa714387afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:15.509405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417b69-c1dd-4e29-bdea-6e7b8a92932d service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:15.586138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843a9d1-15f2-4e56-bb3f-faa714387afd admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:15.589094 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:15.589975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:15.590257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:15.590534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa admin admin] PATH_INFO: `/v3/projects/9e49753ac49f48d794f5866dd76d3848` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:15.590755 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:15.591651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:15.591798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e49753ac49f48d794f5866dd76d3848)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:15.591936 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:15.592193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] PATH_INFO: `/v3/projects/0ad0d4b2a4b74a6788fb0cf884b2bc96` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:15.593360 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad0d4b2a4b74a6788fb0cf884b2bc96)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:15.593718 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:15.595290 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:15.596485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:15.647527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e49753ac49f48d794f5866dd76d3848', 'request_id': 'req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.652007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad0d4b2a4b74a6788fb0cf884b2bc96', 'request_id': 'req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.659605 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e49753ac49f48d794f5866dd76d3848', 'request_id': 'req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.660371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad0d4b2a4b74a6788fb0cf884b2bc96', 'request_id': 'req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.666375 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad0d4b2a4b74a6788fb0cf884b2bc96', 'request_id': 'req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.667420 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e49753ac49f48d794f5866dd76d3848', 'request_id': 'req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.678510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa admin admin] The token cache is being invalidate because project 9e49753ac49f48d794f5866dd76d3848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:15.678699 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] The token cache is being invalidate because project 0ad0d4b2a4b74a6788fb0cf884b2bc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:15.678867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.679044 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.679560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-e765e31b-6a1d-4eb5-a937-be3dd1b8f8fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.679789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.681161 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1257/2498] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:15 2022] DELETE /identity/v3/projects/9e49753ac49f48d794f5866dd76d3848 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:15.681327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1242/2499] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:15 2022] DELETE /identity/v3/projects/0ad0d4b2a4b74a6788fb0cf884b2bc96 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:15.686281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958d54d-65bf-4ce6-937b-13b98095695a None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:15.686617 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958d54d-65bf-4ce6-937b-13b98095695a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:15.687096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958d54d-65bf-4ce6-937b-13b98095695a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:15.688193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:15.689550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:15.708220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e958d54d-65bf-4ce6-937b-13b98095695a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:15.709470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e958d54d-65bf-4ce6-937b-13b98095695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:15.763549 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a18d1-6fa6-4a5e-8fc3-d84f70d8bc99 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:15.768102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894cee6-900a-4f7d-bf0c-e71db00d9950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:15.768989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894cee6-900a-4f7d-bf0c-e71db00d9950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:15.769274 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894cee6-900a-4f7d-bf0c-e71db00d9950 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:15.769567 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894cee6-900a-4f7d-bf0c-e71db00d9950 admin admin] PATH_INFO: `/v3/users/1de379c963fe43de86191bfc7ff3a325` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:15.770751 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894cee6-900a-4f7d-bf0c-e71db00d9950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de379c963fe43de86191bfc7ff3a325)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:15.771959 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1258/2500] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:15.778323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894cee6-900a-4f7d-bf0c-e71db00d9950 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:15.779775 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca978000-8337-499f-856b-609ef4a9297d None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:15.780063 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca978000-8337-499f-856b-609ef4a9297d None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:15.780338 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca978000-8337-499f-856b-609ef4a9297d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:15.796587 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:15.801802 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-ca978000-8337-499f-856b-609ef4a9297d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:15.803183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ca978000-8337-499f-856b-609ef4a9297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:15.812286 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1259/2501] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:15.816639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca978000-8337-499f-856b-609ef4a9297d None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:15.826185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b894cee6-900a-4f7d-bf0c-e71db00d9950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de379c963fe43de86191bfc7ff3a325'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.827031 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca978000-8337-499f-856b-609ef4a9297d None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:15.831718 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062eadf-05e5-431d-8e03-e47cfa746c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:15.832367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062eadf-05e5-431d-8e03-e47cfa746c9d admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:15.832646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062eadf-05e5-431d-8e03-e47cfa746c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:15.832916 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062eadf-05e5-431d-8e03-e47cfa746c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:15.833639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062eadf-05e5-431d-8e03-e47cfa746c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:15.833945 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062eadf-05e5-431d-8e03-e47cfa746c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:15.835579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062eadf-05e5-431d-8e03-e47cfa746c9d admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:15.838519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b894cee6-900a-4f7d-bf0c-e71db00d9950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de379c963fe43de86191bfc7ff3a325'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.847951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1260/2502] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:55:15.852340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b894cee6-900a-4f7d-bf0c-e71db00d9950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de379c963fe43de86191bfc7ff3a325'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.852543 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062eadf-05e5-431d-8e03-e47cfa746c9d admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:15.853139 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b894cee6-900a-4f7d-bf0c-e71db00d9950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de379c963fe43de86191bfc7ff3a325'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.854396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e062eadf-05e5-431d-8e03-e47cfa746c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:15.859560 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b894cee6-900a-4f7d-bf0c-e71db00d9950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de379c963fe43de86191bfc7ff3a325'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:15.868348 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062eadf-05e5-431d-8e03-e47cfa746c9d admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:15.874629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1155410-f49e-4ee8-8097-70b579dd0962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:15.875845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155410-f49e-4ee8-8097-70b579dd0962 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:15.876131 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155410-f49e-4ee8-8097-70b579dd0962 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:15.876411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155410-f49e-4ee8-8097-70b579dd0962 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:15.877118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1155410-f49e-4ee8-8097-70b579dd0962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:15.879116 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1155410-f49e-4ee8-8097-70b579dd0962 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:15.883837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1243/2503] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:15 2022] DELETE /identity/v3/users/1de379c963fe43de86191bfc7ff3a325 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:15.912113 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1261/2504] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:15 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:55:15.913401 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894cee6-900a-4f7d-bf0c-e71db00d9950 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:15.995872 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894cee6-900a-4f7d-bf0c-e71db00d9950 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:16.068234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87183f19-6b73-476d-b1a5-9d3a14d040da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:16.068920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87183f19-6b73-476d-b1a5-9d3a14d040da admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.069208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87183f19-6b73-476d-b1a5-9d3a14d040da admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.069477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87183f19-6b73-476d-b1a5-9d3a14d040da admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.070179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87183f19-6b73-476d-b1a5-9d3a14d040da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:16.072156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87183f19-6b73-476d-b1a5-9d3a14d040da admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:16.101343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1244/2505] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:15 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:16.105504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1155410-f49e-4ee8-8097-70b579dd0962 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:16.116731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1155410-f49e-4ee8-8097-70b579dd0962 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:16.121824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0954fa-60cd-41c5-b57b-dc3dafbd5a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:16.122498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0954fa-60cd-41c5-b57b-dc3dafbd5a85 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.122799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0954fa-60cd-41c5-b57b-dc3dafbd5a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.123107 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0954fa-60cd-41c5-b57b-dc3dafbd5a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.123842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0954fa-60cd-41c5-b57b-dc3dafbd5a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:16.125467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0954fa-60cd-41c5-b57b-dc3dafbd5a85 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:16.140114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1262/2506] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:16.141448 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87183f19-6b73-476d-b1a5-9d3a14d040da admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:16.152738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87183f19-6b73-476d-b1a5-9d3a14d040da admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:16.157938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eb650-079e-4b03-b6c4-99caf877c5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:16.158999 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eb650-079e-4b03-b6c4-99caf877c5bf admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.159303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eb650-079e-4b03-b6c4-99caf877c5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.159601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eb650-079e-4b03-b6c4-99caf877c5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.160495 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731eb650-079e-4b03-b6c4-99caf877c5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:16.162416 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731eb650-079e-4b03-b6c4-99caf877c5bf admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:16.174706 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1245/2507] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:16.178675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eb650-079e-4b03-b6c4-99caf877c5bf admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:16.178846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0954fa-60cd-41c5-b57b-dc3dafbd5a85 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:16.180664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9d0954fa-60cd-41c5-b57b-dc3dafbd5a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:16.194429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eb650-079e-4b03-b6c4-99caf877c5bf admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:16.194824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0954fa-60cd-41c5-b57b-dc3dafbd5a85 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:16.200686 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e4da4-a924-4c46-b47d-4960b16f7f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:16.201168 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679724e-9844-4fff-b679-cf53dad5987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:16.201582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e4da4-a924-4c46-b47d-4960b16f7f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.201865 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e4da4-a924-4c46-b47d-4960b16f7f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.202147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e4da4-a924-4c46-b47d-4960b16f7f4c admin admin] PATH_INFO: `/v3/projects/75d0cbd0933348e2a5d7588e67743d29` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.202369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679724e-9844-4fff-b679-cf53dad5987a admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.202712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679724e-9844-4fff-b679-cf53dad5987a admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.203080 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679724e-9844-4fff-b679-cf53dad5987a admin admin] PATH_INFO: `/v3/projects/d992111cc24f4090ad7ec6156c9fe181/users/f1fcaded99d74daea71a885afdf0bfde/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.203632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e4da4-a924-4c46-b47d-4960b16f7f4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d0cbd0933348e2a5d7588e67743d29)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:16.205689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e4da4-a924-4c46-b47d-4960b16f7f4c admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:16.227730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679724e-9844-4fff-b679-cf53dad5987a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d992111cc24f4090ad7ec6156c9fe181, user_id=f1fcaded99d74daea71a885afdf0bfde, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:16.230850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679724e-9844-4fff-b679-cf53dad5987a admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:16.245663 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1246/2508] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:16 2022] PUT /identity/v3/projects/d992111cc24f4090ad7ec6156c9fe181/users/f1fcaded99d74daea71a885afdf0bfde/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:16.253064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:16.256105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05f506-9d36-48f8-a6b0-7bc470ea1906 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.256388 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05f506-9d36-48f8-a6b0-7bc470ea1906 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.256675 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05f506-9d36-48f8-a6b0-7bc470ea1906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.262814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:16.265370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-631e4da4-a924-4c46-b47d-4960b16f7f4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d0cbd0933348e2a5d7588e67743d29', 'request_id': 'req-631e4da4-a924-4c46-b47d-4960b16f7f4c'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:16.276237 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-631e4da4-a924-4c46-b47d-4960b16f7f4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d0cbd0933348e2a5d7588e67743d29', 'request_id': 'req-631e4da4-a924-4c46-b47d-4960b16f7f4c'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:16.283856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-631e4da4-a924-4c46-b47d-4960b16f7f4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d0cbd0933348e2a5d7588e67743d29', 'request_id': 'req-631e4da4-a924-4c46-b47d-4960b16f7f4c'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:16.293310 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-4e05f506-9d36-48f8-a6b0-7bc470ea1906 None None] MFA Rules not processed for user `f1fcaded99d74daea71a885afdf0bfde`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:16.294666 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-4e05f506-9d36-48f8-a6b0-7bc470ea1906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:16.295664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-631e4da4-a924-4c46-b47d-4960b16f7f4c admin admin] The token cache is being invalidate because project 75d0cbd0933348e2a5d7588e67743d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:16.295959 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-631e4da4-a924-4c46-b47d-4960b16f7f4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:16.296627 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-631e4da4-a924-4c46-b47d-4960b16f7f4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:16.298231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1263/2509] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:16 2022] DELETE /identity/v3/projects/75d0cbd0933348e2a5d7588e67743d29 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:16.303074 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748cd0c-c43c-4aab-aa07-ca2d6ac8e1f3 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.303430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748cd0c-c43c-4aab-aa07-ca2d6ac8e1f3 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.303706 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748cd0c-c43c-4aab-aa07-ca2d6ac8e1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.322083 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-7748cd0c-c43c-4aab-aa07-ca2d6ac8e1f3 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:16.324090 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-7748cd0c-c43c-4aab-aa07-ca2d6ac8e1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:16.371964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1247/2510] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:16.383413 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05f506-9d36-48f8-a6b0-7bc470ea1906 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:16.385069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-4e05f506-9d36-48f8-a6b0-7bc470ea1906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:16.396351 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1264/2511] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:16.398978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefecc3-88cd-43da-a66e-89dcf50283ee None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.399261 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefecc3-88cd-43da-a66e-89dcf50283ee None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.399697 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefecc3-88cd-43da-a66e-89dcf50283ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.420899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-eaefecc3-88cd-43da-a66e-89dcf50283ee None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:16.422141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-eaefecc3-88cd-43da-a66e-89dcf50283ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:16.430859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1265/2512] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:16.436034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefecc3-88cd-43da-a66e-89dcf50283ee None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:16.446075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefecc3-88cd-43da-a66e-89dcf50283ee None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:16.451876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20860a5e-8638-405f-993a-f03b2f64ca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:16.452557 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20860a5e-8638-405f-993a-f03b2f64ca8f admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.452838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20860a5e-8638-405f-993a-f03b2f64ca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.453147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20860a5e-8638-405f-993a-f03b2f64ca8f admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.454040 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20860a5e-8638-405f-993a-f03b2f64ca8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:16.454356 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20860a5e-8638-405f-993a-f03b2f64ca8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:16.456026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20860a5e-8638-405f-993a-f03b2f64ca8f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:16.470834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1266/2513] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:55:16.472762 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20860a5e-8638-405f-993a-f03b2f64ca8f admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:16.477237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05f506-9d36-48f8-a6b0-7bc470ea1906 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:16.482525 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20860a5e-8638-405f-993a-f03b2f64ca8f admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:16.483305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5465209-7c16-409e-b028-9939963da59f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:16.483965 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465209-7c16-409e-b028-9939963da59f service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.484345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465209-7c16-409e-b028-9939963da59f service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.484625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465209-7c16-409e-b028-9939963da59f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.487270 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2394ed2-6de7-431e-842e-e76bd352bc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:16.487908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2394ed2-6de7-431e-842e-e76bd352bc79 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.488189 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2394ed2-6de7-431e-842e-e76bd352bc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.488463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2394ed2-6de7-431e-842e-e76bd352bc79 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.489175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2394ed2-6de7-431e-842e-e76bd352bc79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:16.491114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2394ed2-6de7-431e-842e-e76bd352bc79 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:16.492777 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5465209-7c16-409e-b028-9939963da59f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:16.494359 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5465209-7c16-409e-b028-9939963da59f service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:16.504548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1248/2514] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:55:16.530824 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1267/2515] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:16 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:55:16.534351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5465209-7c16-409e-b028-9939963da59f service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:16.547428 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5465209-7c16-409e-b028-9939963da59f service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:16.613835 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330122d3-0fd1-45cc-80bb-906ff2e781f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:16.614681 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330122d3-0fd1-45cc-80bb-906ff2e781f6 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.615138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330122d3-0fd1-45cc-80bb-906ff2e781f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.615445 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330122d3-0fd1-45cc-80bb-906ff2e781f6 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.616441 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330122d3-0fd1-45cc-80bb-906ff2e781f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:16.619478 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330122d3-0fd1-45cc-80bb-906ff2e781f6 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:16.665435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1249/2516] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:16 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:16.666058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2394ed2-6de7-431e-842e-e76bd352bc79 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:16.677209 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2394ed2-6de7-431e-842e-e76bd352bc79 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:16.683037 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6fb6a-3fc8-49a7-97de-691c18b4a010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:16.683325 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6fb6a-3fc8-49a7-97de-691c18b4a010 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.683665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6fb6a-3fc8-49a7-97de-691c18b4a010 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.684007 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6fb6a-3fc8-49a7-97de-691c18b4a010 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.684817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6fb6a-3fc8-49a7-97de-691c18b4a010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:16.686600 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6fb6a-3fc8-49a7-97de-691c18b4a010 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:16.703115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1268/2517] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:16.704998 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330122d3-0fd1-45cc-80bb-906ff2e781f6 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:16.721879 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330122d3-0fd1-45cc-80bb-906ff2e781f6 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:16.733233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551c5be-5c88-419e-b450-23d9d46dbc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:16.734243 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551c5be-5c88-419e-b450-23d9d46dbc9d admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.734647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551c5be-5c88-419e-b450-23d9d46dbc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.735129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551c5be-5c88-419e-b450-23d9d46dbc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.736025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551c5be-5c88-419e-b450-23d9d46dbc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:16.738372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551c5be-5c88-419e-b450-23d9d46dbc9d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:16.739987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:16.755756 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1250/2518] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:16.757030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6fb6a-3fc8-49a7-97de-691c18b4a010 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:16.772234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6fb6a-3fc8-49a7-97de-691c18b4a010 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:16.777597 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863ade2-0650-4413-b4d2-546b8cad5db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:16.778621 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863ade2-0650-4413-b4d2-546b8cad5db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.779005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863ade2-0650-4413-b4d2-546b8cad5db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.779355 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863ade2-0650-4413-b4d2-546b8cad5db7 admin admin] PATH_INFO: `/v3/projects/10c6588e6834488ab8101acea61f6b60/users/219ab16ba6b34d92be3ad81993f08b07/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.796851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863ade2-0650-4413-b4d2-546b8cad5db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c6588e6834488ab8101acea61f6b60, user_id=219ab16ba6b34d92be3ad81993f08b07, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:16.799687 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863ade2-0650-4413-b4d2-546b8cad5db7 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:16.814028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1269/2519] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:16 2022] PUT /identity/v3/projects/10c6588e6834488ab8101acea61f6b60/users/219ab16ba6b34d92be3ad81993f08b07/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:16.826252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0056dfa-f97a-485b-b4ca-e2e5d465cf8c None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:16.826630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0056dfa-f97a-485b-b4ca-e2e5d465cf8c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:16.827004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0056dfa-f97a-485b-b4ca-e2e5d465cf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:16.869095 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-a0056dfa-f97a-485b-b4ca-e2e5d465cf8c None None] MFA Rules not processed for user `219ab16ba6b34d92be3ad81993f08b07`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:16.871996 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a0056dfa-f97a-485b-b4ca-e2e5d465cf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:16.951550 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1251/2520] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:16.955668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863ade2-0650-4413-b4d2-546b8cad5db7 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:17.005779 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:17.022268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863ade2-0650-4413-b4d2-546b8cad5db7 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:17.027385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf767e-6f14-4787-abfb-de5d962281fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:17.028057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf767e-6f14-4787-abfb-de5d962281fa admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:17.028357 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf767e-6f14-4787-abfb-de5d962281fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:17.028615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf767e-6f14-4787-abfb-de5d962281fa admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:17.029331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf767e-6f14-4787-abfb-de5d962281fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:17.031286 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf767e-6f14-4787-abfb-de5d962281fa admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:17.060642 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1270/2521] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:16 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:17.064730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0056dfa-f97a-485b-b4ca-e2e5d465cf8c None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:17.076500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0056dfa-f97a-485b-b4ca-e2e5d465cf8c None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:17.140224 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e28860-6d8c-43c7-a6ad-769a215f2552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:17.140915 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e28860-6d8c-43c7-a6ad-769a215f2552 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:17.141199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e28860-6d8c-43c7-a6ad-769a215f2552 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:17.141477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e28860-6d8c-43c7-a6ad-769a215f2552 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:17.142192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e28860-6d8c-43c7-a6ad-769a215f2552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:17.144171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e28860-6d8c-43c7-a6ad-769a215f2552 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:17.164607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1252/2522] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:17 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:17.168865 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf767e-6f14-4787-abfb-de5d962281fa admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:17.179390 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf767e-6f14-4787-abfb-de5d962281fa admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:17.184743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636b6a3-a06a-4159-917b-1d44913991aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:17.185407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b6a3-a06a-4159-917b-1d44913991aa admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:17.185733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b6a3-a06a-4159-917b-1d44913991aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:17.186047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b6a3-a06a-4159-917b-1d44913991aa admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:17.186885 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636b6a3-a06a-4159-917b-1d44913991aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:17.188910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636b6a3-a06a-4159-917b-1d44913991aa admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:17.201043 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1271/2523] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:17.205429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e28860-6d8c-43c7-a6ad-769a215f2552 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:17.216123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e28860-6d8c-43c7-a6ad-769a215f2552 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:17.221624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b91caf-08ef-49d9-b830-596224a44aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:17.222519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b91caf-08ef-49d9-b830-596224a44aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:17.222803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b91caf-08ef-49d9-b830-596224a44aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:17.223089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b91caf-08ef-49d9-b830-596224a44aa2 admin admin] PATH_INFO: `/v3/projects/06adfbafd422485aa6b08a7296dffa89/users/67166ca2b5b74e1c9a51d65848425afb/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:17.238989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b91caf-08ef-49d9-b830-596224a44aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06adfbafd422485aa6b08a7296dffa89, user_id=67166ca2b5b74e1c9a51d65848425afb, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:17.241748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b91caf-08ef-49d9-b830-596224a44aa2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:17.258343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1253/2524] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:17 2022] PUT /identity/v3/projects/06adfbafd422485aa6b08a7296dffa89/users/67166ca2b5b74e1c9a51d65848425afb/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:17.262855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636b6a3-a06a-4159-917b-1d44913991aa admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:17.273170 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636b6a3-a06a-4159-917b-1d44913991aa admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:17.340937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f5577-a517-4432-8fb1-148145d2987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:17.341518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f5577-a517-4432-8fb1-148145d2987f admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:17.341796 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f5577-a517-4432-8fb1-148145d2987f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:17.342069 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f5577-a517-4432-8fb1-148145d2987f admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:17.342813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f5577-a517-4432-8fb1-148145d2987f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:17.344437 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f5577-a517-4432-8fb1-148145d2987f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:17.357342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1272/2525] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:17.361819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b91caf-08ef-49d9-b830-596224a44aa2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:17.372746 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b91caf-08ef-49d9-b830-596224a44aa2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:17.377997 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ee6a8-63af-4c59-a765-88b9deec45c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:17.378921 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ee6a8-63af-4c59-a765-88b9deec45c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:17.379203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ee6a8-63af-4c59-a765-88b9deec45c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:17.379470 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ee6a8-63af-4c59-a765-88b9deec45c2 admin admin] PATH_INFO: `/v3/projects/06adfbafd422485aa6b08a7296dffa89/users/67166ca2b5b74e1c9a51d65848425afb/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:17.381600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ee6a8-63af-4c59-a765-88b9deec45c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06adfbafd422485aa6b08a7296dffa89, user_id=67166ca2b5b74e1c9a51d65848425afb, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:17.384365 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ee6a8-63af-4c59-a765-88b9deec45c2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:17.396861 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1254/2526] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:17 2022] PUT /identity/v3/projects/06adfbafd422485aa6b08a7296dffa89/users/67166ca2b5b74e1c9a51d65848425afb/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:17.408891 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015846f-6e65-4ae3-ba12-1529d55ab3cc None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:17.409153 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015846f-6e65-4ae3-ba12-1529d55ab3cc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:17.409462 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015846f-6e65-4ae3-ba12-1529d55ab3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:17.438525 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-7015846f-6e65-4ae3-ba12-1529d55ab3cc None None] MFA Rules not processed for user `67166ca2b5b74e1c9a51d65848425afb`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:17.439796 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-7015846f-6e65-4ae3-ba12-1529d55ab3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:17.514582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1273/2527] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:17 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:17.527261 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ee6a8-63af-4c59-a765-88b9deec45c2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:17.529235 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-f07ee6a8-63af-4c59-a765-88b9deec45c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:17.585727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:17.603489 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ee6a8-63af-4c59-a765-88b9deec45c2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:17.607873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbc7ae-c43e-4958-9332-bfca2b623bc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:17.608524 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbc7ae-c43e-4958-9332-bfca2b623bc5 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:17.608801 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbc7ae-c43e-4958-9332-bfca2b623bc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:17.609072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbc7ae-c43e-4958-9332-bfca2b623bc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:17.618506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbc7ae-c43e-4958-9332-bfca2b623bc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:17.619982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbc7ae-c43e-4958-9332-bfca2b623bc5 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:17.629837 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1255/2528] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:17 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:17.679202 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015846f-6e65-4ae3-ba12-1529d55ab3cc None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:17.689847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015846f-6e65-4ae3-ba12-1529d55ab3cc None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:17.693693 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21405fa7-5d15-4bed-bb3c-b91fcc1bfe7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:17.694510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405fa7-5d15-4bed-bb3c-b91fcc1bfe7f service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:17.694901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405fa7-5d15-4bed-bb3c-b91fcc1bfe7f service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:17.695182 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405fa7-5d15-4bed-bb3c-b91fcc1bfe7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:17.742328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:17.760560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21405fa7-5d15-4bed-bb3c-b91fcc1bfe7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:17.762271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21405fa7-5d15-4bed-bb3c-b91fcc1bfe7f service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:17.771378 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1274/2529] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:19.290028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbc7ae-c43e-4958-9332-bfca2b623bc5 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:19.291613 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-b3fbc7ae-c43e-4958-9332-bfca2b623bc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:19.373522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbc7ae-c43e-4958-9332-bfca2b623bc5 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:19.379392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2f03d-bd52-4fbf-9605-a3776faaa9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:19.380290 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2f03d-bd52-4fbf-9605-a3776faaa9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:19.380574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2f03d-bd52-4fbf-9605-a3776faaa9da admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:19.380850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2f03d-bd52-4fbf-9605-a3776faaa9da admin admin] PATH_INFO: `/v3/users/f1fcaded99d74daea71a885afdf0bfde` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:19.382327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2f03d-bd52-4fbf-9605-a3776faaa9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1fcaded99d74daea71a885afdf0bfde)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:19.384356 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2f03d-bd52-4fbf-9605-a3776faaa9da admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:19.441068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8df2f03d-bd52-4fbf-9605-a3776faaa9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1fcaded99d74daea71a885afdf0bfde'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:19.455108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8df2f03d-bd52-4fbf-9605-a3776faaa9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1fcaded99d74daea71a885afdf0bfde'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:19.462129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8df2f03d-bd52-4fbf-9605-a3776faaa9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1fcaded99d74daea71a885afdf0bfde'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:19.462940 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8df2f03d-bd52-4fbf-9605-a3776faaa9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1fcaded99d74daea71a885afdf0bfde'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:19.463568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8df2f03d-bd52-4fbf-9605-a3776faaa9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1fcaded99d74daea71a885afdf0bfde'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:19.480803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1256/2530] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:19 2022] DELETE /identity/v3/users/f1fcaded99d74daea71a885afdf0bfde => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:19.485469 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128cd17-a5ae-4307-9b63-7e8e2f3dba25 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:19.485954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128cd17-a5ae-4307-9b63-7e8e2f3dba25 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:19.486067 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128cd17-a5ae-4307-9b63-7e8e2f3dba25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:19.504186 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-3128cd17-a5ae-4307-9b63-7e8e2f3dba25 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:19.505399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3128cd17-a5ae-4307-9b63-7e8e2f3dba25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:19.580120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1275/2531] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:19.591254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2f03d-bd52-4fbf-9605-a3776faaa9da admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:19.592677 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8df2f03d-bd52-4fbf-9605-a3776faaa9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:19.655994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2f03d-bd52-4fbf-9605-a3776faaa9da admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:19.659881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2150f70-afe5-40d7-a424-9c78d882f95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:19.660545 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2150f70-afe5-40d7-a424-9c78d882f95b service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:19.660844 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2150f70-afe5-40d7-a424-9c78d882f95b service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:19.661120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2150f70-afe5-40d7-a424-9c78d882f95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:19.670260 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2150f70-afe5-40d7-a424-9c78d882f95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:19.671751 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2150f70-afe5-40d7-a424-9c78d882f95b service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:19.681165 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1257/2532] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:19.968507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128cd17-a5ae-4307-9b63-7e8e2f3dba25 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:19.970187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3128cd17-a5ae-4307-9b63-7e8e2f3dba25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:19.984134 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128cd17-a5ae-4307-9b63-7e8e2f3dba25 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:19.989733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4538d49-4242-4cd3-86de-0c362574f0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:19.990808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4538d49-4242-4cd3-86de-0c362574f0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:19.991146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4538d49-4242-4cd3-86de-0c362574f0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:19.991513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4538d49-4242-4cd3-86de-0c362574f0b0 admin admin] PATH_INFO: `/v3/projects/d992111cc24f4090ad7ec6156c9fe181` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:19.992813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4538d49-4242-4cd3-86de-0c362574f0b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d992111cc24f4090ad7ec6156c9fe181)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:19.994827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4538d49-4242-4cd3-86de-0c362574f0b0 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:20.063618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f4538d49-4242-4cd3-86de-0c362574f0b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd992111cc24f4090ad7ec6156c9fe181', 'request_id': 'req-f4538d49-4242-4cd3-86de-0c362574f0b0'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:20.074145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f4538d49-4242-4cd3-86de-0c362574f0b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd992111cc24f4090ad7ec6156c9fe181', 'request_id': 'req-f4538d49-4242-4cd3-86de-0c362574f0b0'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:20.082053 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f4538d49-4242-4cd3-86de-0c362574f0b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd992111cc24f4090ad7ec6156c9fe181', 'request_id': 'req-f4538d49-4242-4cd3-86de-0c362574f0b0'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:20.094003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f4538d49-4242-4cd3-86de-0c362574f0b0 admin admin] The token cache is being invalidate because project d992111cc24f4090ad7ec6156c9fe181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:20.094297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f4538d49-4242-4cd3-86de-0c362574f0b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:20.095063 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f4538d49-4242-4cd3-86de-0c362574f0b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:20.096985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1276/2533] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:19 2022] DELETE /identity/v3/projects/d992111cc24f4090ad7ec6156c9fe181 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:20.101868 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73a07-3d5c-4d14-b2f2-d842754e5a90 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:20.102155 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73a07-3d5c-4d14-b2f2-d842754e5a90 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:20.102449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73a07-3d5c-4d14-b2f2-d842754e5a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:20.109352 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:20.130623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-a8f73a07-3d5c-4d14-b2f2-d842754e5a90 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:20.131974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a8f73a07-3d5c-4d14-b2f2-d842754e5a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:20.204474 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1258/2534] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:20.213825 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791707a-52ac-4340-a40e-958f4e6a2712 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:20.214168 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791707a-52ac-4340-a40e-958f4e6a2712 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:20.214456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791707a-52ac-4340-a40e-958f4e6a2712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:20.235543 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-f791707a-52ac-4340-a40e-958f4e6a2712 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:20.236763 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f791707a-52ac-4340-a40e-958f4e6a2712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:20.245173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1277/2535] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:20.249816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f73a07-3d5c-4d14-b2f2-d842754e5a90 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:20.259960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f73a07-3d5c-4d14-b2f2-d842754e5a90 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:20.265798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf70c3-d522-462f-bb0f-b80aa07d83da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:20.266506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf70c3-d522-462f-bb0f-b80aa07d83da admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:20.266785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf70c3-d522-462f-bb0f-b80aa07d83da admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:20.267106 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf70c3-d522-462f-bb0f-b80aa07d83da admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:20.267868 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf70c3-d522-462f-bb0f-b80aa07d83da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:20.268187 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf70c3-d522-462f-bb0f-b80aa07d83da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:20.269829 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf70c3-d522-462f-bb0f-b80aa07d83da admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:20.283341 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1259/2536] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:55:20.288313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791707a-52ac-4340-a40e-958f4e6a2712 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:20.299591 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791707a-52ac-4340-a40e-958f4e6a2712 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:20.304940 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611bea50-b145-4626-b7d2-181e5b60c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:20.305593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bea50-b145-4626-b7d2-181e5b60c69d admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:20.305870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bea50-b145-4626-b7d2-181e5b60c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:20.306143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bea50-b145-4626-b7d2-181e5b60c69d admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:20.306873 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611bea50-b145-4626-b7d2-181e5b60c69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:20.308837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611bea50-b145-4626-b7d2-181e5b60c69d admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:20.338978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1278/2537] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:20 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:20.344022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf70c3-d522-462f-bb0f-b80aa07d83da admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:20.354987 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf70c3-d522-462f-bb0f-b80aa07d83da admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:20.415864 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d57909-57ed-40b7-8cdd-108cced9af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:20.416543 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d57909-57ed-40b7-8cdd-108cced9af9b admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:20.416850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d57909-57ed-40b7-8cdd-108cced9af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:20.417129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d57909-57ed-40b7-8cdd-108cced9af9b admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:20.417812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d57909-57ed-40b7-8cdd-108cced9af9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:20.419794 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d57909-57ed-40b7-8cdd-108cced9af9b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:20.440979 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1260/2538] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:20 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:20.445540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611bea50-b145-4626-b7d2-181e5b60c69d admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:20.457388 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611bea50-b145-4626-b7d2-181e5b60c69d admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:20.463369 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76469e-cfe4-4829-bb96-afbe75dba640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:20.464156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76469e-cfe4-4829-bb96-afbe75dba640 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:20.464449 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76469e-cfe4-4829-bb96-afbe75dba640 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:20.464736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76469e-cfe4-4829-bb96-afbe75dba640 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:20.465633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76469e-cfe4-4829-bb96-afbe75dba640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:20.467303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76469e-cfe4-4829-bb96-afbe75dba640 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:20.481362 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1279/2539] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:20.482681 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d57909-57ed-40b7-8cdd-108cced9af9b admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:20.493282 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d57909-57ed-40b7-8cdd-108cced9af9b admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:20.499456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70525c0f-37b0-4d50-9cda-88ded4333ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:20.500147 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70525c0f-37b0-4d50-9cda-88ded4333ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:20.500432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70525c0f-37b0-4d50-9cda-88ded4333ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:20.500708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70525c0f-37b0-4d50-9cda-88ded4333ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:20.501455 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70525c0f-37b0-4d50-9cda-88ded4333ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:20.503156 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70525c0f-37b0-4d50-9cda-88ded4333ee7 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:20.514207 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1261/2540] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:20.518789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76469e-cfe4-4829-bb96-afbe75dba640 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:20.529671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76469e-cfe4-4829-bb96-afbe75dba640 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:20.534379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d156f-1234-4c0c-b7b5-9f226329cfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:20.535311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d156f-1234-4c0c-b7b5-9f226329cfc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:20.535594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d156f-1234-4c0c-b7b5-9f226329cfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:20.535985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d156f-1234-4c0c-b7b5-9f226329cfc1 admin admin] PATH_INFO: `/v3/projects/9b2af22742024522945c337d9f73e1a6/users/4ca4ba09487946b4b697bbea6e50c453/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:20.552252 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d156f-1234-4c0c-b7b5-9f226329cfc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2af22742024522945c337d9f73e1a6, user_id=4ca4ba09487946b4b697bbea6e50c453, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:20.554963 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d156f-1234-4c0c-b7b5-9f226329cfc1 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:20.566122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:20.574720 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1280/2541] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:20 2022] PUT /identity/v3/projects/9b2af22742024522945c337d9f73e1a6/users/4ca4ba09487946b4b697bbea6e50c453/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:20.585633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62465b9-11e5-4b51-a0ef-d26dd86c6486 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:20.586001 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62465b9-11e5-4b51-a0ef-d26dd86c6486 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:20.586391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62465b9-11e5-4b51-a0ef-d26dd86c6486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:20.615503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e62465b9-11e5-4b51-a0ef-d26dd86c6486 None None] MFA Rules not processed for user `4ca4ba09487946b4b697bbea6e50c453`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:20.616726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e62465b9-11e5-4b51-a0ef-d26dd86c6486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:20.683604 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:20.689978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1262/2542] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:20.694727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d156f-1234-4c0c-b7b5-9f226329cfc1 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:20.774392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d156f-1234-4c0c-b7b5-9f226329cfc1 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:20.780200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b62ccc-3c2b-48b1-9e8a-9e7a168df96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:20.780754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b62ccc-3c2b-48b1-9e8a-9e7a168df96d admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:20.781034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b62ccc-3c2b-48b1-9e8a-9e7a168df96d admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:20.781303 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b62ccc-3c2b-48b1-9e8a-9e7a168df96d admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:20.782000 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b62ccc-3c2b-48b1-9e8a-9e7a168df96d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:20.783985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b62ccc-3c2b-48b1-9e8a-9e7a168df96d admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:20.819646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1281/2543] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:20 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:20.823313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62465b9-11e5-4b51-a0ef-d26dd86c6486 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:20.839901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62465b9-11e5-4b51-a0ef-d26dd86c6486 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:20.919646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed0ecd-1de7-45cc-821f-52c200eae316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:20.920991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed0ecd-1de7-45cc-821f-52c200eae316 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:20.921276 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed0ecd-1de7-45cc-821f-52c200eae316 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:20.921555 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed0ecd-1de7-45cc-821f-52c200eae316 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:20.922307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed0ecd-1de7-45cc-821f-52c200eae316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:20.924266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed0ecd-1de7-45cc-821f-52c200eae316 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:20.950612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1263/2544] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:20 2022] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:20.951485 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b62ccc-3c2b-48b1-9e8a-9e7a168df96d admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:20.962183 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b62ccc-3c2b-48b1-9e8a-9e7a168df96d admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:20.973026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95227635-6b68-431f-a4c3-0b6befb2ca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:20.973727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95227635-6b68-431f-a4c3-0b6befb2ca1d admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:20.974009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95227635-6b68-431f-a4c3-0b6befb2ca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:20.974281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95227635-6b68-431f-a4c3-0b6befb2ca1d admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:20.975066 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95227635-6b68-431f-a4c3-0b6befb2ca1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:20.976811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95227635-6b68-431f-a4c3-0b6befb2ca1d admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:20.988344 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1282/2545] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:20.992465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed0ecd-1de7-45cc-821f-52c200eae316 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:21.002577 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed0ecd-1de7-45cc-821f-52c200eae316 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:21.007182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382581b-8c3e-4691-ac98-d9e4e4961a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:21.008072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382581b-8c3e-4691-ac98-d9e4e4961a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:21.008352 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382581b-8c3e-4691-ac98-d9e4e4961a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:21.008722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382581b-8c3e-4691-ac98-d9e4e4961a4b admin admin] PATH_INFO: `/v3/projects/77e45843b04948d7ba9c274cdf34d751/users/74d288216a784b7daa3be296bda10d56/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:21.030200 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382581b-8c3e-4691-ac98-d9e4e4961a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e45843b04948d7ba9c274cdf34d751, user_id=74d288216a784b7daa3be296bda10d56, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:21.033062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382581b-8c3e-4691-ac98-d9e4e4961a4b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:21.049046 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1264/2546] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:20 2022] PUT /identity/v3/projects/77e45843b04948d7ba9c274cdf34d751/users/74d288216a784b7daa3be296bda10d56/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:21.053126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95227635-6b68-431f-a4c3-0b6befb2ca1d admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:21.063170 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95227635-6b68-431f-a4c3-0b6befb2ca1d admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:21.127608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523e75a-588f-4c6a-bce5-f4fe29c4bdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:21.128305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523e75a-588f-4c6a-bce5-f4fe29c4bdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:21.128583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523e75a-588f-4c6a-bce5-f4fe29c4bdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:21.128870 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523e75a-588f-4c6a-bce5-f4fe29c4bdf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:21.129614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523e75a-588f-4c6a-bce5-f4fe29c4bdf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:21.131299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523e75a-588f-4c6a-bce5-f4fe29c4bdf4 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:21.145483 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1283/2547] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:21.146700 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382581b-8c3e-4691-ac98-d9e4e4961a4b admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:21.157622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382581b-8c3e-4691-ac98-d9e4e4961a4b admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:21.162427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f3ab4-e07e-4618-80ec-fa9ac7121af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:21.163351 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f3ab4-e07e-4618-80ec-fa9ac7121af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:21.163636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f3ab4-e07e-4618-80ec-fa9ac7121af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:21.163895 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f3ab4-e07e-4618-80ec-fa9ac7121af1 admin admin] PATH_INFO: `/v3/projects/77e45843b04948d7ba9c274cdf34d751/users/74d288216a784b7daa3be296bda10d56/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:21.166334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f3ab4-e07e-4618-80ec-fa9ac7121af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e45843b04948d7ba9c274cdf34d751, user_id=74d288216a784b7daa3be296bda10d56, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:21.169717 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f3ab4-e07e-4618-80ec-fa9ac7121af1 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:21.181485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1265/2548] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:21 2022] PUT /identity/v3/projects/77e45843b04948d7ba9c274cdf34d751/users/74d288216a784b7daa3be296bda10d56/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:21.192185 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47c268-b3bf-43b8-a7ec-274e02bc6e1c None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:21.192501 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47c268-b3bf-43b8-a7ec-274e02bc6e1c None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:21.192783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47c268-b3bf-43b8-a7ec-274e02bc6e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:21.204022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f3ab4-e07e-4618-80ec-fa9ac7121af1 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:21.205785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-4c0f3ab4-e07e-4618-80ec-fa9ac7121af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:21.236225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-5e47c268-b3bf-43b8-a7ec-274e02bc6e1c None None] MFA Rules not processed for user `74d288216a784b7daa3be296bda10d56`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:21.237549 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5e47c268-b3bf-43b8-a7ec-274e02bc6e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:21.282655 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f3ab4-e07e-4618-80ec-fa9ac7121af1 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:21.288117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864510b-17ae-49dc-b603-3c315105e56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:21.289174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864510b-17ae-49dc-b603-3c315105e56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:21.289768 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864510b-17ae-49dc-b603-3c315105e56d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:21.290050 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864510b-17ae-49dc-b603-3c315105e56d admin admin] PATH_INFO: `/v3/users/219ab16ba6b34d92be3ad81993f08b07` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:21.291412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864510b-17ae-49dc-b603-3c315105e56d admin admin] RBAC: Authorizing `identity:delete_user(user_id=219ab16ba6b34d92be3ad81993f08b07)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:21.293408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864510b-17ae-49dc-b603-3c315105e56d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:21.303981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:21.318906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1284/2549] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:21.332464 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47c268-b3bf-43b8-a7ec-274e02bc6e1c None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:21.334346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5e47c268-b3bf-43b8-a7ec-274e02bc6e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:21.355017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d864510b-17ae-49dc-b603-3c315105e56d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219ab16ba6b34d92be3ad81993f08b07'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:21.359485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:21.368988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d864510b-17ae-49dc-b603-3c315105e56d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219ab16ba6b34d92be3ad81993f08b07'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:21.379312 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d864510b-17ae-49dc-b603-3c315105e56d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219ab16ba6b34d92be3ad81993f08b07'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:21.380463 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d864510b-17ae-49dc-b603-3c315105e56d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219ab16ba6b34d92be3ad81993f08b07'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:21.381123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d864510b-17ae-49dc-b603-3c315105e56d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219ab16ba6b34d92be3ad81993f08b07'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:21.395309 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1266/2550] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:21 2022] DELETE /identity/v3/users/219ab16ba6b34d92be3ad81993f08b07 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:21.402831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683f873-e67d-4701-9a0e-17cdd8604788 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:21.403275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683f873-e67d-4701-9a0e-17cdd8604788 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:21.403557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683f873-e67d-4701-9a0e-17cdd8604788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:21.410065 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47c268-b3bf-43b8-a7ec-274e02bc6e1c None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:21.422237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-d683f873-e67d-4701-9a0e-17cdd8604788 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:21.423598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d683f873-e67d-4701-9a0e-17cdd8604788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:21.467408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489ce3a-bdd8-4fcd-856b-ac26128390ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:21.468062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489ce3a-bdd8-4fcd-856b-ac26128390ac service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:21.468342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489ce3a-bdd8-4fcd-856b-ac26128390ac service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:21.468614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489ce3a-bdd8-4fcd-856b-ac26128390ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:21.470414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8489ce3a-bdd8-4fcd-856b-ac26128390ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:21.498284 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1267/2551] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:21.514739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683f873-e67d-4701-9a0e-17cdd8604788 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:21.516787 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d683f873-e67d-4701-9a0e-17cdd8604788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:21.540931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489ce3a-bdd8-4fcd-856b-ac26128390ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:21.542642 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489ce3a-bdd8-4fcd-856b-ac26128390ac service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:21.555153 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1285/2552] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:21.588705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683f873-e67d-4701-9a0e-17cdd8604788 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:21.594169 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c124e-31a2-4d31-ab46-7bf9783290df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:21.595368 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c124e-31a2-4d31-ab46-7bf9783290df service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:21.595703 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c124e-31a2-4d31-ab46-7bf9783290df service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:21.596120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c124e-31a2-4d31-ab46-7bf9783290df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:21.609071 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c124e-31a2-4d31-ab46-7bf9783290df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:21.610536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c124e-31a2-4d31-ab46-7bf9783290df service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:21.625244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1268/2553] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:21.645748 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489ce3a-bdd8-4fcd-856b-ac26128390ac service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:21.647229 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8489ce3a-bdd8-4fcd-856b-ac26128390ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:21.659016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489ce3a-bdd8-4fcd-856b-ac26128390ac service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:21.663054 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888a52-0374-4331-b92e-d3cab96d4e9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:21.663708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888a52-0374-4331-b92e-d3cab96d4e9e service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:21.663988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888a52-0374-4331-b92e-d3cab96d4e9e service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:21.664265 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888a52-0374-4331-b92e-d3cab96d4e9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:21.666141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b0888a52-0374-4331-b92e-d3cab96d4e9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:21.739959 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888a52-0374-4331-b92e-d3cab96d4e9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:21.741443 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888a52-0374-4331-b92e-d3cab96d4e9e service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:21.747551 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:21.754268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1286/2554] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:21.955174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c124e-31a2-4d31-ab46-7bf9783290df service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:21.956608 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-c14c124e-31a2-4d31-ab46-7bf9783290df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:21.974066 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c124e-31a2-4d31-ab46-7bf9783290df service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:21.979334 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:21.980270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:21.980706 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:21.980986 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] PATH_INFO: `/v3/projects/10c6588e6834488ab8101acea61f6b60` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:21.982350 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c6588e6834488ab8101acea61f6b60)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:21.984302 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:22.038651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c6588e6834488ab8101acea61f6b60', 'request_id': 'req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.048143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c6588e6834488ab8101acea61f6b60', 'request_id': 'req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.053865 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c6588e6834488ab8101acea61f6b60', 'request_id': 'req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.055992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:22.067623 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] The token cache is being invalidate because project 10c6588e6834488ab8101acea61f6b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:22.067977 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.068913 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.070644 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1269/2555] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:21 2022] DELETE /identity/v3/projects/10c6588e6834488ab8101acea61f6b60 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:22.075475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888a52-0374-4331-b92e-d3cab96d4e9e service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:22.087017 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888a52-0374-4331-b92e-d3cab96d4e9e service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:22.150735 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b33737-0c26-4edf-a1db-f3cfd6bdf831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:22.151663 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b33737-0c26-4edf-a1db-f3cfd6bdf831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:22.152087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b33737-0c26-4edf-a1db-f3cfd6bdf831 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:22.152332 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b33737-0c26-4edf-a1db-f3cfd6bdf831 admin admin] PATH_INFO: `/v3/users/67166ca2b5b74e1c9a51d65848425afb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:22.153634 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b33737-0c26-4edf-a1db-f3cfd6bdf831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67166ca2b5b74e1c9a51d65848425afb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:22.155585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b33737-0c26-4edf-a1db-f3cfd6bdf831 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:22.209451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-24b33737-0c26-4edf-a1db-f3cfd6bdf831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67166ca2b5b74e1c9a51d65848425afb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.221331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-24b33737-0c26-4edf-a1db-f3cfd6bdf831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67166ca2b5b74e1c9a51d65848425afb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.222014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-24b33737-0c26-4edf-a1db-f3cfd6bdf831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67166ca2b5b74e1c9a51d65848425afb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.229160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-24b33737-0c26-4edf-a1db-f3cfd6bdf831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67166ca2b5b74e1c9a51d65848425afb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.229895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-24b33737-0c26-4edf-a1db-f3cfd6bdf831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67166ca2b5b74e1c9a51d65848425afb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.246795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1287/2556] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:22 2022] DELETE /identity/v3/users/67166ca2b5b74e1c9a51d65848425afb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:22.531621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:22.533148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:22.548959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2a975-5ce5-4a01-b626-5c2ac13fdece admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:22.613636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff13c5-aa5c-4cff-af8f-350516689074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:22.614510 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff13c5-aa5c-4cff-af8f-350516689074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:22.614797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff13c5-aa5c-4cff-af8f-350516689074 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:22.615095 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff13c5-aa5c-4cff-af8f-350516689074 admin admin] PATH_INFO: `/v3/projects/06adfbafd422485aa6b08a7296dffa89` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:22.616346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff13c5-aa5c-4cff-af8f-350516689074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06adfbafd422485aa6b08a7296dffa89)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:22.618541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff13c5-aa5c-4cff-af8f-350516689074 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:22.670485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-07ff13c5-aa5c-4cff-af8f-350516689074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06adfbafd422485aa6b08a7296dffa89', 'request_id': 'req-07ff13c5-aa5c-4cff-af8f-350516689074'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.679978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-07ff13c5-aa5c-4cff-af8f-350516689074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06adfbafd422485aa6b08a7296dffa89', 'request_id': 'req-07ff13c5-aa5c-4cff-af8f-350516689074'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.686988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-07ff13c5-aa5c-4cff-af8f-350516689074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06adfbafd422485aa6b08a7296dffa89', 'request_id': 'req-07ff13c5-aa5c-4cff-af8f-350516689074'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.701105 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-07ff13c5-aa5c-4cff-af8f-350516689074 admin admin] The token cache is being invalidate because project 06adfbafd422485aa6b08a7296dffa89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:22.701392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-07ff13c5-aa5c-4cff-af8f-350516689074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.702062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-07ff13c5-aa5c-4cff-af8f-350516689074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:22.703876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1270/2557] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:22 2022] DELETE /identity/v3/projects/06adfbafd422485aa6b08a7296dffa89 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:22.709092 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7eae-2b99-4061-b1c1-e7cf9183e85d None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:22.709532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7eae-2b99-4061-b1c1-e7cf9183e85d None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:22.709680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7eae-2b99-4061-b1c1-e7cf9183e85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:22.731314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-deee7eae-2b99-4061-b1c1-e7cf9183e85d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:22.732661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-deee7eae-2b99-4061-b1c1-e7cf9183e85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:22.802642 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1288/2558] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:22.811838 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f0d32-b2e7-4835-a965-3982c948e919 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:22.812145 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f0d32-b2e7-4835-a965-3982c948e919 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:22.812482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f0d32-b2e7-4835-a965-3982c948e919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:22.831775 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-b19f0d32-b2e7-4835-a965-3982c948e919 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:22.833002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-b19f0d32-b2e7-4835-a965-3982c948e919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:22.842002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1271/2559] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:22.847204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7eae-2b99-4061-b1c1-e7cf9183e85d None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:22.858472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7eae-2b99-4061-b1c1-e7cf9183e85d None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:22.863246 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864ef0f-211e-4660-bfa4-c9fbf55bec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:22.863919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864ef0f-211e-4660-bfa4-c9fbf55bec7c admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:22.864202 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864ef0f-211e-4660-bfa4-c9fbf55bec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:22.864479 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864ef0f-211e-4660-bfa4-c9fbf55bec7c admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:22.865214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864ef0f-211e-4660-bfa4-c9fbf55bec7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:22.865521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864ef0f-211e-4660-bfa4-c9fbf55bec7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:22.867159 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864ef0f-211e-4660-bfa4-c9fbf55bec7c admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:22.880618 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1289/2560] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:55:22.886001 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f0d32-b2e7-4835-a965-3982c948e919 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:22.896400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f0d32-b2e7-4835-a965-3982c948e919 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:22.901958 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a8ced-2c4a-4f3f-b550-5f7962ef5267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:22.903005 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a8ced-2c4a-4f3f-b550-5f7962ef5267 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:22.903294 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a8ced-2c4a-4f3f-b550-5f7962ef5267 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:22.903571 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a8ced-2c4a-4f3f-b550-5f7962ef5267 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:22.904317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a8ced-2c4a-4f3f-b550-5f7962ef5267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:22.906388 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a8ced-2c4a-4f3f-b550-5f7962ef5267 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:22.945016 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1272/2561] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:22 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:22.950407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864ef0f-211e-4660-bfa4-c9fbf55bec7c admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:22.973139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864ef0f-211e-4660-bfa4-c9fbf55bec7c admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:22.977293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:23.056764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be72011-adb9-4faa-8703-2d8aa77e2849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:23.057750 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be72011-adb9-4faa-8703-2d8aa77e2849 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:23.058866 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be72011-adb9-4faa-8703-2d8aa77e2849 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:23.059385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be72011-adb9-4faa-8703-2d8aa77e2849 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:23.060123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be72011-adb9-4faa-8703-2d8aa77e2849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:23.062107 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be72011-adb9-4faa-8703-2d8aa77e2849 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:23.086176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1290/2562] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:22 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:23.091062 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a8ced-2c4a-4f3f-b550-5f7962ef5267 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:23.102395 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a8ced-2c4a-4f3f-b550-5f7962ef5267 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:23.108198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272415d8-3dd3-47fd-8aca-e9cfe636abde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:23.109074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272415d8-3dd3-47fd-8aca-e9cfe636abde admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:23.109458 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272415d8-3dd3-47fd-8aca-e9cfe636abde admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:23.109816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272415d8-3dd3-47fd-8aca-e9cfe636abde admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:23.110629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272415d8-3dd3-47fd-8aca-e9cfe636abde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:23.112468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272415d8-3dd3-47fd-8aca-e9cfe636abde admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:23.124045 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1273/2563] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:23.128400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be72011-adb9-4faa-8703-2d8aa77e2849 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:23.139259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be72011-adb9-4faa-8703-2d8aa77e2849 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:23.144218 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635e1b0-8fc7-41bb-9506-46b3feb78f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:23.144897 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635e1b0-8fc7-41bb-9506-46b3feb78f58 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:23.145181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635e1b0-8fc7-41bb-9506-46b3feb78f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:23.145479 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635e1b0-8fc7-41bb-9506-46b3feb78f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:23.146194 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635e1b0-8fc7-41bb-9506-46b3feb78f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:23.148109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635e1b0-8fc7-41bb-9506-46b3feb78f58 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:23.160268 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1291/2564] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:23.164762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272415d8-3dd3-47fd-8aca-e9cfe636abde admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:23.175964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272415d8-3dd3-47fd-8aca-e9cfe636abde admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:23.181568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a1aa7-01de-4a76-9362-294ef285ed01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:23.182633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a1aa7-01de-4a76-9362-294ef285ed01 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:23.183213 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a1aa7-01de-4a76-9362-294ef285ed01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:23.183698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a1aa7-01de-4a76-9362-294ef285ed01 admin admin] PATH_INFO: `/v3/projects/c7fae35215d541eab6fa0cb69747701f/users/f332661109ac4716b0cecce0aebbc6b8/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:23.204479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a1aa7-01de-4a76-9362-294ef285ed01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fae35215d541eab6fa0cb69747701f, user_id=f332661109ac4716b0cecce0aebbc6b8, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:23.207833 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a1aa7-01de-4a76-9362-294ef285ed01 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:23.227989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1274/2565] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:23 2022] PUT /identity/v3/projects/c7fae35215d541eab6fa0cb69747701f/users/f332661109ac4716b0cecce0aebbc6b8/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:23.239677 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39361a2b-7840-4b7e-9675-78b357c89ba6 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:23.240038 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39361a2b-7840-4b7e-9675-78b357c89ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:23.240468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39361a2b-7840-4b7e-9675-78b357c89ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:23.275457 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-39361a2b-7840-4b7e-9675-78b357c89ba6 None None] MFA Rules not processed for user `f332661109ac4716b0cecce0aebbc6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:23.277176 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-39361a2b-7840-4b7e-9675-78b357c89ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:23.349904 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1292/2566] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:23.355206 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a1aa7-01de-4a76-9362-294ef285ed01 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:23.383527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:23.427139 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a1aa7-01de-4a76-9362-294ef285ed01 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:23.435866 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459b791-96dd-4f09-9ad3-e7233bcf85a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:23.436544 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459b791-96dd-4f09-9ad3-e7233bcf85a2 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:23.436824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459b791-96dd-4f09-9ad3-e7233bcf85a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:23.437096 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459b791-96dd-4f09-9ad3-e7233bcf85a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:23.437784 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459b791-96dd-4f09-9ad3-e7233bcf85a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:23.439762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459b791-96dd-4f09-9ad3-e7233bcf85a2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:23.470661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1275/2567] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:23 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:23.474796 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39361a2b-7840-4b7e-9675-78b357c89ba6 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:23.486899 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39361a2b-7840-4b7e-9675-78b357c89ba6 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:23.558045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248183b-f333-4267-b21e-f8cb88f0b750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:23.558840 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248183b-f333-4267-b21e-f8cb88f0b750 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:23.559186 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248183b-f333-4267-b21e-f8cb88f0b750 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:23.559579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248183b-f333-4267-b21e-f8cb88f0b750 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:23.560473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248183b-f333-4267-b21e-f8cb88f0b750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:23.562633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248183b-f333-4267-b21e-f8cb88f0b750 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:23.593304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1293/2568] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:23 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:55:23.597467 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459b791-96dd-4f09-9ad3-e7233bcf85a2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:23.609718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459b791-96dd-4f09-9ad3-e7233bcf85a2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:23.619055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4eced8-cad8-42bd-9b22-bc287428aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:23.619739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4eced8-cad8-42bd-9b22-bc287428aa90 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:23.620023 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4eced8-cad8-42bd-9b22-bc287428aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:23.620511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4eced8-cad8-42bd-9b22-bc287428aa90 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:23.621243 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4eced8-cad8-42bd-9b22-bc287428aa90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:23.623093 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4eced8-cad8-42bd-9b22-bc287428aa90 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:23.634977 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1276/2569] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:23.639315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248183b-f333-4267-b21e-f8cb88f0b750 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:23.645966 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:23.649898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248183b-f333-4267-b21e-f8cb88f0b750 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:23.656096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5df5b-8603-494b-968e-d420d5c91091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:23.656981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5df5b-8603-494b-968e-d420d5c91091 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:23.657262 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5df5b-8603-494b-968e-d420d5c91091 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:23.657536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5df5b-8603-494b-968e-d420d5c91091 admin admin] PATH_INFO: `/v3/projects/d08258e208854f0e9525ba526943e5bb/users/26177e6c1bf640e2918cfa421e24b989/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:23.673060 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5df5b-8603-494b-968e-d420d5c91091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08258e208854f0e9525ba526943e5bb, user_id=26177e6c1bf640e2918cfa421e24b989, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:23.675770 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5df5b-8603-494b-968e-d420d5c91091 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:23.691008 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1294/2570] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:23 2022] PUT /identity/v3/projects/d08258e208854f0e9525ba526943e5bb/users/26177e6c1bf640e2918cfa421e24b989/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:23.695576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4eced8-cad8-42bd-9b22-bc287428aa90 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:23.707480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4eced8-cad8-42bd-9b22-bc287428aa90 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:23.765726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46966963-21ab-4834-acc8-f42187b28394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:23.766444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46966963-21ab-4834-acc8-f42187b28394 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:23.766786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46966963-21ab-4834-acc8-f42187b28394 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:23.767141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46966963-21ab-4834-acc8-f42187b28394 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:23.767930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46966963-21ab-4834-acc8-f42187b28394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:23.769599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46966963-21ab-4834-acc8-f42187b28394 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:23.780201 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1277/2571] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:23.784835 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5df5b-8603-494b-968e-d420d5c91091 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:23.795191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5df5b-8603-494b-968e-d420d5c91091 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:23.800190 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1fed9-3672-43c3-88e4-02f23090626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:23.801257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1fed9-3672-43c3-88e4-02f23090626c admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:23.801632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1fed9-3672-43c3-88e4-02f23090626c admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:23.802110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1fed9-3672-43c3-88e4-02f23090626c admin admin] PATH_INFO: `/v3/projects/d08258e208854f0e9525ba526943e5bb/users/26177e6c1bf640e2918cfa421e24b989/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:23.804390 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1fed9-3672-43c3-88e4-02f23090626c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08258e208854f0e9525ba526943e5bb, user_id=26177e6c1bf640e2918cfa421e24b989, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:23.807508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1fed9-3672-43c3-88e4-02f23090626c admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:23.818821 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1295/2572] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:23 2022] PUT /identity/v3/projects/d08258e208854f0e9525ba526943e5bb/users/26177e6c1bf640e2918cfa421e24b989/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:23.831642 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755107b-4ba7-4484-bd8e-0d420f817545 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:23.831932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755107b-4ba7-4484-bd8e-0d420f817545 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:23.832216 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755107b-4ba7-4484-bd8e-0d420f817545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:23.861757 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-0755107b-4ba7-4484-bd8e-0d420f817545 None None] MFA Rules not processed for user `26177e6c1bf640e2918cfa421e24b989`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:23.862998 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-0755107b-4ba7-4484-bd8e-0d420f817545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:23.939009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1278/2573] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:23.951591 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1fed9-3672-43c3-88e4-02f23090626c admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:23.953466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-adc1fed9-3672-43c3-88e4-02f23090626c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:24.011819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1fed9-3672-43c3-88e4-02f23090626c admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:24.015930 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc024ff-08f9-40ee-84d0-14ceab6f78e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:24.016576 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc024ff-08f9-40ee-84d0-14ceab6f78e1 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:24.016859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc024ff-08f9-40ee-84d0-14ceab6f78e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:24.017133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc024ff-08f9-40ee-84d0-14ceab6f78e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:24.076699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc024ff-08f9-40ee-84d0-14ceab6f78e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:24.078120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc024ff-08f9-40ee-84d0-14ceab6f78e1 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:24.087382 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1296/2574] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:25.457592 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755107b-4ba7-4484-bd8e-0d420f817545 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:25.467671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755107b-4ba7-4484-bd8e-0d420f817545 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:25.472163 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436f21b-88e3-4b11-8a45-166fe1e911ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:25.472812 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f21b-88e3-4b11-8a45-166fe1e911ab service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:25.473141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f21b-88e3-4b11-8a45-166fe1e911ab service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:25.473403 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f21b-88e3-4b11-8a45-166fe1e911ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:25.483788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436f21b-88e3-4b11-8a45-166fe1e911ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:25.485228 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436f21b-88e3-4b11-8a45-166fe1e911ab service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:25.495960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1279/2575] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:28.990892 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc024ff-08f9-40ee-84d0-14ceab6f78e1 service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:28.993271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-fcc024ff-08f9-40ee-84d0-14ceab6f78e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:29.060646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc024ff-08f9-40ee-84d0-14ceab6f78e1 service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:29.065296 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548308d-cd85-4d84-bf30-4eb2e529aa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:29.066323 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548308d-cd85-4d84-bf30-4eb2e529aa88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:29.066629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548308d-cd85-4d84-bf30-4eb2e529aa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:29.067132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548308d-cd85-4d84-bf30-4eb2e529aa88 admin admin] PATH_INFO: `/v3/users/4ca4ba09487946b4b697bbea6e50c453` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:29.068584 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548308d-cd85-4d84-bf30-4eb2e529aa88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca4ba09487946b4b697bbea6e50c453)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:29.071070 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548308d-cd85-4d84-bf30-4eb2e529aa88 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:29.095172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:29.122370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-8548308d-cd85-4d84-bf30-4eb2e529aa88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca4ba09487946b4b697bbea6e50c453'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.134519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-8548308d-cd85-4d84-bf30-4eb2e529aa88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca4ba09487946b4b697bbea6e50c453'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.135250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-8548308d-cd85-4d84-bf30-4eb2e529aa88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca4ba09487946b4b697bbea6e50c453'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.142305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-8548308d-cd85-4d84-bf30-4eb2e529aa88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca4ba09487946b4b697bbea6e50c453'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.142981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-8548308d-cd85-4d84-bf30-4eb2e529aa88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca4ba09487946b4b697bbea6e50c453'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.158423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1297/2576] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:28 2022] DELETE /identity/v3/users/4ca4ba09487946b4b697bbea6e50c453 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:29.163356 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0172-b6ab-4a87-82bd-2c01ca1794fb None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:29.163809 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0172-b6ab-4a87-82bd-2c01ca1794fb None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:29.163905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0172-b6ab-4a87-82bd-2c01ca1794fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:29.170674 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:29.182826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-83ff0172-b6ab-4a87-82bd-2c01ca1794fb None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:29.184069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-83ff0172-b6ab-4a87-82bd-2c01ca1794fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:29.246013 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1280/2577] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:29.256129 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548308d-cd85-4d84-bf30-4eb2e529aa88 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:29.257691 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8548308d-cd85-4d84-bf30-4eb2e529aa88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:29.317498 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548308d-cd85-4d84-bf30-4eb2e529aa88 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:29.321839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab336fbf-cfff-43ca-b76c-fd70e1e5f306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:29.322895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab336fbf-cfff-43ca-b76c-fd70e1e5f306 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:29.323235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab336fbf-cfff-43ca-b76c-fd70e1e5f306 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:29.323513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab336fbf-cfff-43ca-b76c-fd70e1e5f306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:29.333753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab336fbf-cfff-43ca-b76c-fd70e1e5f306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:29.335228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab336fbf-cfff-43ca-b76c-fd70e1e5f306 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:29.345067 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1298/2578] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:29.488501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff0172-b6ab-4a87-82bd-2c01ca1794fb None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:29.490620 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-83ff0172-b6ab-4a87-82bd-2c01ca1794fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:29.517196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff0172-b6ab-4a87-82bd-2c01ca1794fb None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:29.523901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824ee5-9ca0-4bea-8d6d-231cb2a08480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:29.525372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824ee5-9ca0-4bea-8d6d-231cb2a08480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:29.525826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824ee5-9ca0-4bea-8d6d-231cb2a08480 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:29.526098 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824ee5-9ca0-4bea-8d6d-231cb2a08480 admin admin] PATH_INFO: `/v3/users/f332661109ac4716b0cecce0aebbc6b8` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:29.527391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62824ee5-9ca0-4bea-8d6d-231cb2a08480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f332661109ac4716b0cecce0aebbc6b8)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:29.529356 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62824ee5-9ca0-4bea-8d6d-231cb2a08480 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:29.600136 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-62824ee5-9ca0-4bea-8d6d-231cb2a08480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f332661109ac4716b0cecce0aebbc6b8'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.616357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-62824ee5-9ca0-4bea-8d6d-231cb2a08480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f332661109ac4716b0cecce0aebbc6b8'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.624293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-62824ee5-9ca0-4bea-8d6d-231cb2a08480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f332661109ac4716b0cecce0aebbc6b8'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.625124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-62824ee5-9ca0-4bea-8d6d-231cb2a08480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f332661109ac4716b0cecce0aebbc6b8'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.625753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-62824ee5-9ca0-4bea-8d6d-231cb2a08480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f332661109ac4716b0cecce0aebbc6b8'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.645367 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1281/2579] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:29 2022] DELETE /identity/v3/users/f332661109ac4716b0cecce0aebbc6b8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:29.650203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c279c1-50a9-4b66-be3e-784885e92b7b None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:29.650467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c279c1-50a9-4b66-be3e-784885e92b7b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:29.650858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c279c1-50a9-4b66-be3e-784885e92b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:29.660191 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824ee5-9ca0-4bea-8d6d-231cb2a08480 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:29.661848 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-62824ee5-9ca0-4bea-8d6d-231cb2a08480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:29.669996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-22c279c1-50a9-4b66-be3e-784885e92b7b None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:29.671714 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-22c279c1-50a9-4b66-be3e-784885e92b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:29.753712 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1299/2580] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:29.766632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c279c1-50a9-4b66-be3e-784885e92b7b None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:29.768205 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-22c279c1-50a9-4b66-be3e-784885e92b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:29.770265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824ee5-9ca0-4bea-8d6d-231cb2a08480 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:29.774940 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:29.775819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:29.776131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:29.776622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] PATH_INFO: `/v3/projects/9b2af22742024522945c337d9f73e1a6` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:29.777705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2af22742024522945c337d9f73e1a6)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:29.780383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:29.806157 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:29.817770 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:29.832626 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c279c1-50a9-4b66-be3e-784885e92b7b None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:29.841718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2af22742024522945c337d9f73e1a6', 'request_id': 'req-43f9f7c1-9826-4b17-b274-ce110d78c128'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.855167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2af22742024522945c337d9f73e1a6', 'request_id': 'req-43f9f7c1-9826-4b17-b274-ce110d78c128'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.862296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2af22742024522945c337d9f73e1a6', 'request_id': 'req-43f9f7c1-9826-4b17-b274-ce110d78c128'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.888127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] The token cache is being invalidate because project 9b2af22742024522945c337d9f73e1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:29.889246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.890009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:29.893029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1282/2581] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:29 2022] DELETE /identity/v3/projects/9b2af22742024522945c337d9f73e1a6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:29.897206 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:29.898751 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:29.908789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f092837-46cd-49db-9680-cbc68f2a037b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:29.909629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f092837-46cd-49db-9680-cbc68f2a037b service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:29.910220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f092837-46cd-49db-9680-cbc68f2a037b service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:29.910667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f092837-46cd-49db-9680-cbc68f2a037b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:29.912926 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8f092837-46cd-49db-9680-cbc68f2a037b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:29.977141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9f7c1-9826-4b17-b274-ce110d78c128 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:29.981705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab7e67-1442-4606-9905-4f058c90c004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:29.982800 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab7e67-1442-4606-9905-4f058c90c004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:29.982945 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab7e67-1442-4606-9905-4f058c90c004 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:29.983188 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab7e67-1442-4606-9905-4f058c90c004 admin admin] PATH_INFO: `/v3/users/74d288216a784b7daa3be296bda10d56` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:29.984389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab7e67-1442-4606-9905-4f058c90c004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d288216a784b7daa3be296bda10d56)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:29.985053 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f092837-46cd-49db-9680-cbc68f2a037b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:29.986361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab7e67-1442-4606-9905-4f058c90c004 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:29.986495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f092837-46cd-49db-9680-cbc68f2a037b service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:29.996137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1300/2582] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:30.038908 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-91ab7e67-1442-4606-9905-4f058c90c004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d288216a784b7daa3be296bda10d56'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.058692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-91ab7e67-1442-4606-9905-4f058c90c004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d288216a784b7daa3be296bda10d56'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.069764 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-91ab7e67-1442-4606-9905-4f058c90c004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d288216a784b7daa3be296bda10d56'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.070510 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-91ab7e67-1442-4606-9905-4f058c90c004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d288216a784b7daa3be296bda10d56'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.071293 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-91ab7e67-1442-4606-9905-4f058c90c004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d288216a784b7daa3be296bda10d56'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.087240 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1283/2583] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:29 2022] DELETE /identity/v3/users/74d288216a784b7daa3be296bda10d56 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:30.295009 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f092837-46cd-49db-9680-cbc68f2a037b service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:30.296843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8f092837-46cd-49db-9680-cbc68f2a037b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:30.316202 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f092837-46cd-49db-9680-cbc68f2a037b service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:30.387737 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab7e67-1442-4606-9905-4f058c90c004 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:30.389554 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-91ab7e67-1442-4606-9905-4f058c90c004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:30.395357 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:30.396249 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:30.396537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:30.396811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] PATH_INFO: `/v3/projects/c7fae35215d541eab6fa0cb69747701f` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:30.398017 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7fae35215d541eab6fa0cb69747701f)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:30.399973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:30.408539 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab7e67-1442-4606-9905-4f058c90c004 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:30.413490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d7271-b3ec-40c6-b356-36e34acb3384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:30.414372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d7271-b3ec-40c6-b356-36e34acb3384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:30.414652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d7271-b3ec-40c6-b356-36e34acb3384 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:30.414957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d7271-b3ec-40c6-b356-36e34acb3384 admin admin] PATH_INFO: `/v3/projects/77e45843b04948d7ba9c274cdf34d751` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:30.416698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d7271-b3ec-40c6-b356-36e34acb3384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77e45843b04948d7ba9c274cdf34d751)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:30.418095 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d7271-b3ec-40c6-b356-36e34acb3384 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:30.443338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:30.451602 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7fae35215d541eab6fa0cb69747701f', 'request_id': 'req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.454676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:30.460532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7fae35215d541eab6fa0cb69747701f', 'request_id': 'req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.468676 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7fae35215d541eab6fa0cb69747701f', 'request_id': 'req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.472551 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-715d7271-b3ec-40c6-b356-36e34acb3384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77e45843b04948d7ba9c274cdf34d751', 'request_id': 'req-715d7271-b3ec-40c6-b356-36e34acb3384'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.481137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] The token cache is being invalidate because project c7fae35215d541eab6fa0cb69747701f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:30.481432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.482126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.483250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-715d7271-b3ec-40c6-b356-36e34acb3384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77e45843b04948d7ba9c274cdf34d751', 'request_id': 'req-715d7271-b3ec-40c6-b356-36e34acb3384'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.484273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1301/2584] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:30 2022] DELETE /identity/v3/projects/c7fae35215d541eab6fa0cb69747701f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:30.488335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:30.489723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:30.490795 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-715d7271-b3ec-40c6-b356-36e34acb3384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77e45843b04948d7ba9c274cdf34d751', 'request_id': 'req-715d7271-b3ec-40c6-b356-36e34acb3384'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.503086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-715d7271-b3ec-40c6-b356-36e34acb3384 admin admin] The token cache is being invalidate because project 77e45843b04948d7ba9c274cdf34d751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:30.503453 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-715d7271-b3ec-40c6-b356-36e34acb3384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.504116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-715d7271-b3ec-40c6-b356-36e34acb3384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.505670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1284/2585] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:30 2022] DELETE /identity/v3/projects/77e45843b04948d7ba9c274cdf34d751 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:30.510613 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc78a-cc4f-44b8-89af-ff2314e1788a None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:30.510925 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc78a-cc4f-44b8-89af-ff2314e1788a None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:30.511219 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc78a-cc4f-44b8-89af-ff2314e1788a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:30.528827 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-c4bbc78a-cc4f-44b8-89af-ff2314e1788a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:30.530023 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-c4bbc78a-cc4f-44b8-89af-ff2314e1788a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:30.554211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8238ab-e2ae-4fdf-9042-ea602b8d6b98 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:30.591218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1285/2586] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:30.600481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e0bbb-77f8-4b58-8111-b2d49772ac35 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:30.600734 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e0bbb-77f8-4b58-8111-b2d49772ac35 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:30.601009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e0bbb-77f8-4b58-8111-b2d49772ac35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:30.615302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f89845-1448-42c0-8c52-3d4f5ca90603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:30.616196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f89845-1448-42c0-8c52-3d4f5ca90603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:30.616476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f89845-1448-42c0-8c52-3d4f5ca90603 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:30.616747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f89845-1448-42c0-8c52-3d4f5ca90603 admin admin] PATH_INFO: `/v3/users/26177e6c1bf640e2918cfa421e24b989` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:30.617974 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f89845-1448-42c0-8c52-3d4f5ca90603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26177e6c1bf640e2918cfa421e24b989)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:30.619585 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-7f5e0bbb-77f8-4b58-8111-b2d49772ac35 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:30.619932 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f89845-1448-42c0-8c52-3d4f5ca90603 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:30.620777 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7f5e0bbb-77f8-4b58-8111-b2d49772ac35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:30.628607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1286/2587] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:30.632673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e0bbb-77f8-4b58-8111-b2d49772ac35 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:30.641539 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e0bbb-77f8-4b58-8111-b2d49772ac35 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:30.646643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848a3f7-b079-46e7-a9d4-21aecda410f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:30.647232 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848a3f7-b079-46e7-a9d4-21aecda410f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:30.647515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848a3f7-b079-46e7-a9d4-21aecda410f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:30.647789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848a3f7-b079-46e7-a9d4-21aecda410f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:30.648549 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848a3f7-b079-46e7-a9d4-21aecda410f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:30.648858 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848a3f7-b079-46e7-a9d4-21aecda410f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:30.650541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848a3f7-b079-46e7-a9d4-21aecda410f9 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:30.666533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1287/2588] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:55:30.667511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848a3f7-b079-46e7-a9d4-21aecda410f9 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:30.669443 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d6f89845-1448-42c0-8c52-3d4f5ca90603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26177e6c1bf640e2918cfa421e24b989'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.677410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848a3f7-b079-46e7-a9d4-21aecda410f9 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:30.682170 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2794367-70be-4cd2-88fa-0080ae4572b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:30.682839 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794367-70be-4cd2-88fa-0080ae4572b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:30.683125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794367-70be-4cd2-88fa-0080ae4572b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:30.683313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d6f89845-1448-42c0-8c52-3d4f5ca90603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26177e6c1bf640e2918cfa421e24b989'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.683411 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794367-70be-4cd2-88fa-0080ae4572b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:30.684011 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d6f89845-1448-42c0-8c52-3d4f5ca90603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26177e6c1bf640e2918cfa421e24b989'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.684115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2794367-70be-4cd2-88fa-0080ae4572b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:30.685960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2794367-70be-4cd2-88fa-0080ae4572b8 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:30.691667 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d6f89845-1448-42c0-8c52-3d4f5ca90603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26177e6c1bf640e2918cfa421e24b989'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.692316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-d6f89845-1448-42c0-8c52-3d4f5ca90603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26177e6c1bf640e2918cfa421e24b989'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:30.709389 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1302/2589] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:30 2022] DELETE /identity/v3/users/26177e6c1bf640e2918cfa421e24b989 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:30.715336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1288/2590] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:30 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:30.719585 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f89845-1448-42c0-8c52-3d4f5ca90603 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:30.721117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d6f89845-1448-42c0-8c52-3d4f5ca90603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:30.730666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:30.794651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f89845-1448-42c0-8c52-3d4f5ca90603 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:30.852984 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd60794-0e21-44b8-9c7f-390d309ed67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:30.853677 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd60794-0e21-44b8-9c7f-390d309ed67a admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:30.853960 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd60794-0e21-44b8-9c7f-390d309ed67a admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:30.854234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd60794-0e21-44b8-9c7f-390d309ed67a admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:30.854977 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd60794-0e21-44b8-9c7f-390d309ed67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:30.856946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd60794-0e21-44b8-9c7f-390d309ed67a admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:30.886121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1303/2591] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:30 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:55:30.890541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2794367-70be-4cd2-88fa-0080ae4572b8 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:30.902073 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2794367-70be-4cd2-88fa-0080ae4572b8 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:30.907198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13a89d-365c-482d-8bcf-f63b2acf00f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:30.907923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13a89d-365c-482d-8bcf-f63b2acf00f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:30.908267 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13a89d-365c-482d-8bcf-f63b2acf00f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:30.908600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13a89d-365c-482d-8bcf-f63b2acf00f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:30.909424 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13a89d-365c-482d-8bcf-f63b2acf00f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:30.911148 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13a89d-365c-482d-8bcf-f63b2acf00f2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:30.928165 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1289/2592] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:30.929428 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd60794-0e21-44b8-9c7f-390d309ed67a admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:30.942702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd60794-0e21-44b8-9c7f-390d309ed67a admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:30.948152 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bba1d4-1b63-4442-9e6e-1e9d50507224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:30.948383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bba1d4-1b63-4442-9e6e-1e9d50507224 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:30.948665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bba1d4-1b63-4442-9e6e-1e9d50507224 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:30.948939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bba1d4-1b63-4442-9e6e-1e9d50507224 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:30.949677 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bba1d4-1b63-4442-9e6e-1e9d50507224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:30.951383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bba1d4-1b63-4442-9e6e-1e9d50507224 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:30.962945 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1304/2593] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:30.968133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13a89d-365c-482d-8bcf-f63b2acf00f2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:30.979820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13a89d-365c-482d-8bcf-f63b2acf00f2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:30.991926 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051ceeb-7577-4e07-bf08-b6ab70d6bbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:30.992848 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051ceeb-7577-4e07-bf08-b6ab70d6bbe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:30.993186 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051ceeb-7577-4e07-bf08-b6ab70d6bbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:30.993411 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051ceeb-7577-4e07-bf08-b6ab70d6bbe6 admin admin] PATH_INFO: `/v3/projects/4fa594c2046346999e1dd3ed1150a45e/users/00f4ea495e014da38a222d223a865ba2/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.014193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051ceeb-7577-4e07-bf08-b6ab70d6bbe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa594c2046346999e1dd3ed1150a45e, user_id=00f4ea495e014da38a222d223a865ba2, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.015277 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bba1d4-1b63-4442-9e6e-1e9d50507224 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.015736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051ceeb-7577-4e07-bf08-b6ab70d6bbe6 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.017056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d2bba1d4-1b63-4442-9e6e-1e9d50507224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:31.035102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1290/2594] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:30 2022] PUT /identity/v3/projects/4fa594c2046346999e1dd3ed1150a45e/users/00f4ea495e014da38a222d223a865ba2/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:31.046044 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9215f-60c6-4d57-bf27-79f9f4c41b12 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.046345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9215f-60c6-4d57-bf27-79f9f4c41b12 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.046594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9215f-60c6-4d57-bf27-79f9f4c41b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.051226 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bba1d4-1b63-4442-9e6e-1e9d50507224 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.078924 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-f6a9215f-60c6-4d57-bf27-79f9f4c41b12 None None] MFA Rules not processed for user `00f4ea495e014da38a222d223a865ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:31.080361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-f6a9215f-60c6-4d57-bf27-79f9f4c41b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:31.101056 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:31.118449 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.119362 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.119646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.119924 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] PATH_INFO: `/v3/projects/d08258e208854f0e9525ba526943e5bb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.121150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d08258e208854f0e9525ba526943e5bb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.123122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.151046 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1291/2595] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:31.151876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9215f-60c6-4d57-bf27-79f9f4c41b12 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.162991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9215f-60c6-4d57-bf27-79f9f4c41b12 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.166755 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:31.178887 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd08258e208854f0e9525ba526943e5bb', 'request_id': 'req-6899ef2c-10ab-41ad-94b6-d9003313cc05'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:31.187874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd08258e208854f0e9525ba526943e5bb', 'request_id': 'req-6899ef2c-10ab-41ad-94b6-d9003313cc05'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:31.195743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd08258e208854f0e9525ba526943e5bb', 'request_id': 'req-6899ef2c-10ab-41ad-94b6-d9003313cc05'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:31.214827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] The token cache is being invalidate because project d08258e208854f0e9525ba526943e5bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:31.215175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:31.217254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:31.219005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1305/2596] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:31 2022] DELETE /identity/v3/projects/d08258e208854f0e9525ba526943e5bb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:31.222871 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.228391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:31.239503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815137b-2669-4d05-8baa-233506abfb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.240313 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815137b-2669-4d05-8baa-233506abfb00 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.240668 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815137b-2669-4d05-8baa-233506abfb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.241039 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815137b-2669-4d05-8baa-233506abfb00 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.241818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815137b-2669-4d05-8baa-233506abfb00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.244152 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815137b-2669-4d05-8baa-233506abfb00 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.252998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ef2c-10ab-41ad-94b6-d9003313cc05 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.259902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8624ed-dd0d-49b6-bcb3-7bf1c15c1287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.260947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8624ed-dd0d-49b6-bcb3-7bf1c15c1287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.261263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8624ed-dd0d-49b6-bcb3-7bf1c15c1287 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.261654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8624ed-dd0d-49b6-bcb3-7bf1c15c1287 admin admin] PATH_INFO: `/v3/users/b7cc504771b944009a42915445058ebd` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.263182 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8624ed-dd0d-49b6-bcb3-7bf1c15c1287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7cc504771b944009a42915445058ebd)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.265146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8624ed-dd0d-49b6-bcb3-7bf1c15c1287 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.279117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1292/2597] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:31 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:31.280498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9343e0-919a-436b-a4b8-6f58c84a0b51 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.280841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9343e0-919a-436b-a4b8-6f58c84a0b51 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.281799 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9343e0-919a-436b-a4b8-6f58c84a0b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.302653 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-9e9343e0-919a-436b-a4b8-6f58c84a0b51 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:31.303907 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9e9343e0-919a-436b-a4b8-6f58c84a0b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:31.317014 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3a8624ed-dd0d-49b6-bcb3-7bf1c15c1287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7cc504771b944009a42915445058ebd'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:31.330543 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3a8624ed-dd0d-49b6-bcb3-7bf1c15c1287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7cc504771b944009a42915445058ebd'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:31.331422 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3a8624ed-dd0d-49b6-bcb3-7bf1c15c1287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7cc504771b944009a42915445058ebd'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:31.340359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3a8624ed-dd0d-49b6-bcb3-7bf1c15c1287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7cc504771b944009a42915445058ebd'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:31.342073 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3a8624ed-dd0d-49b6-bcb3-7bf1c15c1287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7cc504771b944009a42915445058ebd'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:31.358034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1306/2598] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:31 2022] DELETE /identity/v3/users/b7cc504771b944009a42915445058ebd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:31.361360 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8624ed-dd0d-49b6-bcb3-7bf1c15c1287 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.361360 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3a8624ed-dd0d-49b6-bcb3-7bf1c15c1287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:31.369657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1293/2599] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:31.371004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87360208-140b-470d-8664-0651cf345ad2 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.371947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87360208-140b-470d-8664-0651cf345ad2 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.371947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87360208-140b-470d-8664-0651cf345ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.391574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-87360208-140b-470d-8664-0651cf345ad2 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:31.392876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-87360208-140b-470d-8664-0651cf345ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:31.432248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8624ed-dd0d-49b6-bcb3-7bf1c15c1287 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.438633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcfe57-bb93-4de1-b39a-9e49c00df9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.439661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:31.439788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcfe57-bb93-4de1-b39a-9e49c00df9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.440475 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcfe57-bb93-4de1-b39a-9e49c00df9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.440594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcfe57-bb93-4de1-b39a-9e49c00df9b2 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.441461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcfe57-bb93-4de1-b39a-9e49c00df9b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.444845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcfe57-bb93-4de1-b39a-9e49c00df9b2 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.459138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1294/2600] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:31.460469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48b053-ea53-44ef-a725-d5f32c11991a None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.460715 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48b053-ea53-44ef-a725-d5f32c11991a None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.461007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48b053-ea53-44ef-a725-d5f32c11991a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.473277 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1307/2601] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:31 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:31.475059 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcfe57-bb93-4de1-b39a-9e49c00df9b2 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.477531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-00dcfe57-bb93-4de1-b39a-9e49c00df9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:31.485665 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-8a48b053-ea53-44ef-a725-d5f32c11991a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:31.487418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8a48b053-ea53-44ef-a725-d5f32c11991a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:31.498427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1295/2602] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:31.500300 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48b053-ea53-44ef-a725-d5f32c11991a None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.515237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48b053-ea53-44ef-a725-d5f32c11991a None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.515727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:DELETE=15,keystone:SELECT=80,keystone:INSERT=5 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:31.521739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619102fa-ee04-4687-825b-bd9d918cfc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.522632 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619102fa-ee04-4687-825b-bd9d918cfc01 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.523017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619102fa-ee04-4687-825b-bd9d918cfc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.523475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619102fa-ee04-4687-825b-bd9d918cfc01 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.524934 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619102fa-ee04-4687-825b-bd9d918cfc01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.527329 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619102fa-ee04-4687-825b-bd9d918cfc01 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.542722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1296/2603] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:31.542722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619102fa-ee04-4687-825b-bd9d918cfc01 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.552533 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619102fa-ee04-4687-825b-bd9d918cfc01 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.552723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcfe57-bb93-4de1-b39a-9e49c00df9b2 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.556630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3053e4d-636b-4ca6-ab5e-78de0ed671d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.557281 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3053e4d-636b-4ca6-ab5e-78de0ed671d2 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.557549 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1c1d7-6227-44f2-98bf-2b30eafcad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.557680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3053e4d-636b-4ca6-ab5e-78de0ed671d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.557819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3053e4d-636b-4ca6-ab5e-78de0ed671d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.558212 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1c1d7-6227-44f2-98bf-2b30eafcad16 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.558497 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1c1d7-6227-44f2-98bf-2b30eafcad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.558786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1c1d7-6227-44f2-98bf-2b30eafcad16 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.559568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1c1d7-6227-44f2-98bf-2b30eafcad16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:31.559846 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1c1d7-6227-44f2-98bf-2b30eafcad16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.561529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1c1d7-6227-44f2-98bf-2b30eafcad16 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.567139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3053e4d-636b-4ca6-ab5e-78de0ed671d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.568555 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3053e4d-636b-4ca6-ab5e-78de0ed671d2 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.574708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1297/2604] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:55:31.575593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1c1d7-6227-44f2-98bf-2b30eafcad16 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.578874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1308/2605] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:31.580219 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3053e4d-636b-4ca6-ab5e-78de0ed671d2 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.586310 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1c1d7-6227-44f2-98bf-2b30eafcad16 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.589838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3053e4d-636b-4ca6-ab5e-78de0ed671d2 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.591642 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b12d55-387e-4db8-bc32-514874c7c6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.592608 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b12d55-387e-4db8-bc32-514874c7c6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.593074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b12d55-387e-4db8-bc32-514874c7c6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.593507 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b12d55-387e-4db8-bc32-514874c7c6a7 admin admin] PATH_INFO: `/v3/projects/f2ce6068f0cc4f87a1be5966e87bfedb/users/111f00473c324e1788a904af3c1deb06/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.594539 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba351f-9d3b-4104-a11a-1cd2a495d3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.595326 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba351f-9d3b-4104-a11a-1cd2a495d3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.595487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba351f-9d3b-4104-a11a-1cd2a495d3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.595760 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba351f-9d3b-4104-a11a-1cd2a495d3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.596487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba351f-9d3b-4104-a11a-1cd2a495d3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.598907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba351f-9d3b-4104-a11a-1cd2a495d3e5 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.610876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b12d55-387e-4db8-bc32-514874c7c6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ce6068f0cc4f87a1be5966e87bfedb, user_id=111f00473c324e1788a904af3c1deb06, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.613662 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b12d55-387e-4db8-bc32-514874c7c6a7 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.633335 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1298/2606] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:31 2022] PUT /identity/v3/projects/f2ce6068f0cc4f87a1be5966e87bfedb/users/111f00473c324e1788a904af3c1deb06/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:31.634200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1309/2607] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:31 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:31.638481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b12d55-387e-4db8-bc32-514874c7c6a7 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.638885 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba351f-9d3b-4104-a11a-1cd2a495d3e5 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.714244 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba351f-9d3b-4104-a11a-1cd2a495d3e5 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.714976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b12d55-387e-4db8-bc32-514874c7c6a7 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.719477 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf255984-f0f8-4f3f-916b-8421cb14f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.720255 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf255984-f0f8-4f3f-916b-8421cb14f9ab admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.720555 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b523333-e2a7-4321-b2c2-c2f9056c1298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.720671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf255984-f0f8-4f3f-916b-8421cb14f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.720998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf255984-f0f8-4f3f-916b-8421cb14f9ab admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.721392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b523333-e2a7-4321-b2c2-c2f9056c1298 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.721738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b523333-e2a7-4321-b2c2-c2f9056c1298 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.722088 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b523333-e2a7-4321-b2c2-c2f9056c1298 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.722679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf255984-f0f8-4f3f-916b-8421cb14f9ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.722966 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b523333-e2a7-4321-b2c2-c2f9056c1298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.724635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b523333-e2a7-4321-b2c2-c2f9056c1298 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.725056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf255984-f0f8-4f3f-916b-8421cb14f9ab admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.741371 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1299/2608] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:31.744305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b523333-e2a7-4321-b2c2-c2f9056c1298 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.757556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b523333-e2a7-4321-b2c2-c2f9056c1298 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.759317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1310/2609] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:31 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:31.763113 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf255984-f0f8-4f3f-916b-8421cb14f9ab admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.765189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5e0cd-0bd2-4eda-a73f-23039d45c366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.766195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5e0cd-0bd2-4eda-a73f-23039d45c366 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.766476 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5e0cd-0bd2-4eda-a73f-23039d45c366 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.766780 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5e0cd-0bd2-4eda-a73f-23039d45c366 admin admin] PATH_INFO: `/v3/projects/f2ce6068f0cc4f87a1be5966e87bfedb/users/111f00473c324e1788a904af3c1deb06/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.768771 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5e0cd-0bd2-4eda-a73f-23039d45c366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ce6068f0cc4f87a1be5966e87bfedb, user_id=111f00473c324e1788a904af3c1deb06, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.771514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5e0cd-0bd2-4eda-a73f-23039d45c366 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.776556 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf255984-f0f8-4f3f-916b-8421cb14f9ab admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.782676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1300/2610] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:31 2022] PUT /identity/v3/projects/f2ce6068f0cc4f87a1be5966e87bfedb/users/111f00473c324e1788a904af3c1deb06/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:31.793720 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160fabc-a8c2-4b65-bbf7-22ec4a79a093 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.794199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160fabc-a8c2-4b65-bbf7-22ec4a79a093 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.794363 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160fabc-a8c2-4b65-bbf7-22ec4a79a093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.821891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-d160fabc-a8c2-4b65-bbf7-22ec4a79a093 None None] MFA Rules not processed for user `111f00473c324e1788a904af3c1deb06`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:31.823634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d160fabc-a8c2-4b65-bbf7-22ec4a79a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:31.840078 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b99f6-0ab5-4192-8399-91f3feed33af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.840851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b99f6-0ab5-4192-8399-91f3feed33af admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.841212 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b99f6-0ab5-4192-8399-91f3feed33af admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.841494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b99f6-0ab5-4192-8399-91f3feed33af admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.842346 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b99f6-0ab5-4192-8399-91f3feed33af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.844385 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b99f6-0ab5-4192-8399-91f3feed33af admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.856495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1311/2611] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:31.860907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b99f6-0ab5-4192-8399-91f3feed33af admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.872201 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b99f6-0ab5-4192-8399-91f3feed33af admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.879052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031acda-a695-47dc-9902-e8905686966e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.879052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031acda-a695-47dc-9902-e8905686966e admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.879599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031acda-a695-47dc-9902-e8905686966e admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.880083 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031acda-a695-47dc-9902-e8905686966e admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.883685 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031acda-a695-47dc-9902-e8905686966e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.883685 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031acda-a695-47dc-9902-e8905686966e admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.895558 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1312/2612] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:31.896369 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031acda-a695-47dc-9902-e8905686966e admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.898109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3031acda-a695-47dc-9902-e8905686966e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:31.912650 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031acda-a695-47dc-9902-e8905686966e admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.919067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1301/2613] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:31.919839 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160fabc-a8c2-4b65-bbf7-22ec4a79a093 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.923201 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.924124 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.924404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.925490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:31.925968 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c admin admin] PATH_INFO: `/v3/projects/eaf6f90bfc7144459630cf11c578905a` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.927805 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaf6f90bfc7144459630cf11c578905a)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.930563 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.931445 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160fabc-a8c2-4b65-bbf7-22ec4a79a093 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:31.937150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bfa5c-8a40-441f-9720-f3c43b4ff85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:31.938339 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bfa5c-8a40-441f-9720-f3c43b4ff85c admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:31.938629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bfa5c-8a40-441f-9720-f3c43b4ff85c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:31.938962 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bfa5c-8a40-441f-9720-f3c43b4ff85c admin admin] PATH_INFO: `/v3/projects/77ab5d9773e448bdbf71586f230cf820/users/359fe975e5b144f990b2a3313b7cc860/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:31.949583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:31.955055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bfa5c-8a40-441f-9720-f3c43b4ff85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ab5d9773e448bdbf71586f230cf820, user_id=359fe975e5b144f990b2a3313b7cc860, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:31.957738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bfa5c-8a40-441f-9720-f3c43b4ff85c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:31.974175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1302/2614] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:31 2022] PUT /identity/v3/projects/77ab5d9773e448bdbf71586f230cf820/users/359fe975e5b144f990b2a3313b7cc860/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:31.975035 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bfa5c-8a40-441f-9720-f3c43b4ff85c admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:31.976646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-184bfa5c-8a40-441f-9720-f3c43b4ff85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:31.989122 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf6f90bfc7144459630cf11c578905a', 'request_id': 'req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:31.998313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf6f90bfc7144459630cf11c578905a', 'request_id': 'req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:32.006456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf6f90bfc7144459630cf11c578905a', 'request_id': 'req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:32.017409 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c admin admin] The token cache is being invalidate because project eaf6f90bfc7144459630cf11c578905a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:32.018015 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:32.018340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-22f23337-7fd5-4c69-8bb0-6e1df5abc99c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:32.019955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1313/2615] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:31 2022] DELETE /identity/v3/projects/eaf6f90bfc7144459630cf11c578905a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:32.021182 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc08e16-1839-4ea2-8846-b5fdc6872b22 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:32.021706 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc08e16-1839-4ea2-8846-b5fdc6872b22 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:32.021990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc08e16-1839-4ea2-8846-b5fdc6872b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:32.046464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bfa5c-8a40-441f-9720-f3c43b4ff85c admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:32.060010 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-8fc08e16-1839-4ea2-8846-b5fdc6872b22 None None] MFA Rules not processed for user `359fe975e5b144f990b2a3313b7cc860`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:32.061439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8fc08e16-1839-4ea2-8846-b5fdc6872b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:32.111141 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b730fd2-ceea-432a-86c3-a6c6903e809f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:32.111806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b730fd2-ceea-432a-86c3-a6c6903e809f service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:32.112109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b730fd2-ceea-432a-86c3-a6c6903e809f service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:32.112551 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b730fd2-ceea-432a-86c3-a6c6903e809f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:32.114562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9b730fd2-ceea-432a-86c3-a6c6903e809f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:32.134090 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1314/2616] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:32.138481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc08e16-1839-4ea2-8846-b5fdc6872b22 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:32.139926 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-8fc08e16-1839-4ea2-8846-b5fdc6872b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:32.191742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b730fd2-ceea-432a-86c3-a6c6903e809f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:32.193226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b730fd2-ceea-432a-86c3-a6c6903e809f service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:32.204686 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1303/2617] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:32.222471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc08e16-1839-4ea2-8846-b5fdc6872b22 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:32.228410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c40747-5fb0-413c-97e9-2b8f74bc3526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:32.229236 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40747-5fb0-413c-97e9-2b8f74bc3526 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:32.229530 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40747-5fb0-413c-97e9-2b8f74bc3526 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:32.229797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40747-5fb0-413c-97e9-2b8f74bc3526 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:32.230787 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c40747-5fb0-413c-97e9-2b8f74bc3526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:32.233041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c40747-5fb0-413c-97e9-2b8f74bc3526 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:32.267169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1315/2618] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:32 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:55:32.270818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b730fd2-ceea-432a-86c3-a6c6903e809f service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:32.283815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b730fd2-ceea-432a-86c3-a6c6903e809f service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:32.333209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:32.354360 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebf68d-b053-4afa-851b-ab8099cf37c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:32.355108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebf68d-b053-4afa-851b-ab8099cf37c3 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:32.355373 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebf68d-b053-4afa-851b-ab8099cf37c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:32.355648 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebf68d-b053-4afa-851b-ab8099cf37c3 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:32.356345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebf68d-b053-4afa-851b-ab8099cf37c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:32.358299 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebf68d-b053-4afa-851b-ab8099cf37c3 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:32.381183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1304/2619] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:32 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:32.385522 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c40747-5fb0-413c-97e9-2b8f74bc3526 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:32.398000 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c40747-5fb0-413c-97e9-2b8f74bc3526 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:32.404545 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99dceb-b8e3-429a-a9c0-4e7d1536d2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:32.405361 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99dceb-b8e3-429a-a9c0-4e7d1536d2ca admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:32.405680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99dceb-b8e3-429a-a9c0-4e7d1536d2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:32.406005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99dceb-b8e3-429a-a9c0-4e7d1536d2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:32.406833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99dceb-b8e3-429a-a9c0-4e7d1536d2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:32.408609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99dceb-b8e3-429a-a9c0-4e7d1536d2ca admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:32.425773 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1316/2620] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:32.429824 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebf68d-b053-4afa-851b-ab8099cf37c3 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:32.440705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebf68d-b053-4afa-851b-ab8099cf37c3 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:32.445954 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74631f-92ef-4d20-b053-1cd1dbfd6dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:32.446862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74631f-92ef-4d20-b053-1cd1dbfd6dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:32.447555 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74631f-92ef-4d20-b053-1cd1dbfd6dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:32.447893 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74631f-92ef-4d20-b053-1cd1dbfd6dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:32.448692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74631f-92ef-4d20-b053-1cd1dbfd6dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:32.450382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74631f-92ef-4d20-b053-1cd1dbfd6dd4 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:32.462488 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1305/2621] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:32.466910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99dceb-b8e3-429a-a9c0-4e7d1536d2ca admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:32.480226 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99dceb-b8e3-429a-a9c0-4e7d1536d2ca admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:32.486335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acbc60-71c5-495c-bc31-9e1d0083bb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:32.487290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acbc60-71c5-495c-bc31-9e1d0083bb8e admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:32.487569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acbc60-71c5-495c-bc31-9e1d0083bb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:32.487842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acbc60-71c5-495c-bc31-9e1d0083bb8e admin admin] PATH_INFO: `/v3/projects/f675b96e3da94e33b18d9f249c4507af/users/ea7b310bc8dc4d68ba4498894c9b89e4/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:32.490931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:32.510568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acbc60-71c5-495c-bc31-9e1d0083bb8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f675b96e3da94e33b18d9f249c4507af, user_id=ea7b310bc8dc4d68ba4498894c9b89e4, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:32.513347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acbc60-71c5-495c-bc31-9e1d0083bb8e admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:32.537060 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1317/2622] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:32 2022] PUT /identity/v3/projects/f675b96e3da94e33b18d9f249c4507af/users/ea7b310bc8dc4d68ba4498894c9b89e4/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:32.548787 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3548d5f-bcd2-4595-b754-cff989ee5e5d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:32.549125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3548d5f-bcd2-4595-b754-cff989ee5e5d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:32.549427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3548d5f-bcd2-4595-b754-cff989ee5e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:32.579198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-a3548d5f-bcd2-4595-b754-cff989ee5e5d None None] MFA Rules not processed for user `ea7b310bc8dc4d68ba4498894c9b89e4`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:32.580516 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a3548d5f-bcd2-4595-b754-cff989ee5e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:32.653770 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1306/2623] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:32.658920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acbc60-71c5-495c-bc31-9e1d0083bb8e admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:32.665164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3548d5f-bcd2-4595-b754-cff989ee5e5d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:32.666593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a3548d5f-bcd2-4595-b754-cff989ee5e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:32.733117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acbc60-71c5-495c-bc31-9e1d0083bb8e admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:32.738738 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f10715-6bc2-4ec5-8179-615de199db49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:32.739693 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f10715-6bc2-4ec5-8179-615de199db49 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:32.739855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f10715-6bc2-4ec5-8179-615de199db49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:32.740132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f10715-6bc2-4ec5-8179-615de199db49 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:32.740837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f10715-6bc2-4ec5-8179-615de199db49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:32.742781 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f10715-6bc2-4ec5-8179-615de199db49 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:32.746316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3548d5f-bcd2-4595-b754-cff989ee5e5d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:32.752492 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69e9dd-0287-4bd1-bc1a-1ef9c8af384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:32.753392 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e9dd-0287-4bd1-bc1a-1ef9c8af384a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:32.753703 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e9dd-0287-4bd1-bc1a-1ef9c8af384a admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:32.753978 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e9dd-0287-4bd1-bc1a-1ef9c8af384a admin admin] PATH_INFO: `/v3/users/00f4ea495e014da38a222d223a865ba2` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:32.755258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69e9dd-0287-4bd1-bc1a-1ef9c8af384a admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f4ea495e014da38a222d223a865ba2)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:32.757209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69e9dd-0287-4bd1-bc1a-1ef9c8af384a admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:32.775962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1318/2624] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:32 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:32.776285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f10715-6bc2-4ec5-8179-615de199db49 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:32.777868 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-94f10715-6bc2-4ec5-8179-615de199db49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:32.811316 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0d69e9dd-0287-4bd1-bc1a-1ef9c8af384a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f4ea495e014da38a222d223a865ba2'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:32.817711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:32.828663 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0d69e9dd-0287-4bd1-bc1a-1ef9c8af384a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f4ea495e014da38a222d223a865ba2'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:32.836529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0d69e9dd-0287-4bd1-bc1a-1ef9c8af384a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f4ea495e014da38a222d223a865ba2'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:32.837276 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0d69e9dd-0287-4bd1-bc1a-1ef9c8af384a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f4ea495e014da38a222d223a865ba2'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:32.837897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0d69e9dd-0287-4bd1-bc1a-1ef9c8af384a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f4ea495e014da38a222d223a865ba2'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:32.848329 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f10715-6bc2-4ec5-8179-615de199db49 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:32.853721 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82c1d9-acc1-441c-ba33-559ff9d03fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:32.854193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1307/2625] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:32 2022] DELETE /identity/v3/users/00f4ea495e014da38a222d223a865ba2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:32.855068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69e9dd-0287-4bd1-bc1a-1ef9c8af384a admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:32.855511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82c1d9-acc1-441c-ba33-559ff9d03fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:32.855820 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82c1d9-acc1-441c-ba33-559ff9d03fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:32.856107 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82c1d9-acc1-441c-ba33-559ff9d03fe9 admin admin] PATH_INFO: `/v3/users/37588e9c54d3466395a63544120b9254` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:32.856520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-0d69e9dd-0287-4bd1-bc1a-1ef9c8af384a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:32.857644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82c1d9-acc1-441c-ba33-559ff9d03fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37588e9c54d3466395a63544120b9254)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:32.859682 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82c1d9-acc1-441c-ba33-559ff9d03fe9 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:32.911136 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-bf82c1d9-acc1-441c-ba33-559ff9d03fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37588e9c54d3466395a63544120b9254'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:32.921428 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69e9dd-0287-4bd1-bc1a-1ef9c8af384a admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:32.923625 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-bf82c1d9-acc1-441c-ba33-559ff9d03fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37588e9c54d3466395a63544120b9254'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:32.924307 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-bf82c1d9-acc1-441c-ba33-559ff9d03fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37588e9c54d3466395a63544120b9254'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:32.926465 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27e36b-4048-467a-adac-28552cb8f4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:32.927171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27e36b-4048-467a-adac-28552cb8f4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:32.927452 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27e36b-4048-467a-adac-28552cb8f4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:32.927721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27e36b-4048-467a-adac-28552cb8f4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:32.928407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27e36b-4048-467a-adac-28552cb8f4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:32.928865 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:32.930610 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27e36b-4048-467a-adac-28552cb8f4e0 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:32.931941 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-bf82c1d9-acc1-441c-ba33-559ff9d03fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37588e9c54d3466395a63544120b9254'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:32.933361 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-bf82c1d9-acc1-441c-ba33-559ff9d03fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37588e9c54d3466395a63544120b9254'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:32.951342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1319/2626] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:32 2022] DELETE /identity/v3/users/37588e9c54d3466395a63544120b9254 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:32.952630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39003f-486d-4091-bb53-40d6175d625f None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:32.956651 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39003f-486d-4091-bb53-40d6175d625f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:32.956789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1308/2627] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:32 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:32.956892 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39003f-486d-4091-bb53-40d6175d625f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:32.956982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575a139-f757-49cc-bd2b-fb386bad9ed2 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:32.956982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575a139-f757-49cc-bd2b-fb386bad9ed2 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:32.956982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575a139-f757-49cc-bd2b-fb386bad9ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:32.970323 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-0a39003f-486d-4091-bb53-40d6175d625f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:32.971549 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0a39003f-486d-4091-bb53-40d6175d625f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:32.974405 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-e575a139-f757-49cc-bd2b-fb386bad9ed2 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:32.975635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e575a139-f757-49cc-bd2b-fb386bad9ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:33.031970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1320/2628] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:33.032628 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39003f-486d-4091-bb53-40d6175d625f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:33.033732 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-0a39003f-486d-4091-bb53-40d6175d625f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:33.036116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1309/2629] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:33.042931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575a139-f757-49cc-bd2b-fb386bad9ed2 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:33.044318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e575a139-f757-49cc-bd2b-fb386bad9ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:33.045597 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39003f-486d-4091-bb53-40d6175d625f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:33.050684 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16f9af-0597-4c9f-9704-9a5e7fb64d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:33.051497 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16f9af-0597-4c9f-9704-9a5e7fb64d90 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:33.051855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16f9af-0597-4c9f-9704-9a5e7fb64d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:33.052207 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16f9af-0597-4c9f-9704-9a5e7fb64d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:33.053028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16f9af-0597-4c9f-9704-9a5e7fb64d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:33.054659 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16f9af-0597-4c9f-9704-9a5e7fb64d90 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:33.065729 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1321/2630] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:33.066553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16f9af-0597-4c9f-9704-9a5e7fb64d90 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:33.068233 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-4c16f9af-0597-4c9f-9704-9a5e7fb64d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:33.105120 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575a139-f757-49cc-bd2b-fb386bad9ed2 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:33.109303 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece52d3-7aa7-491a-a7ef-ebce4d7cfd65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:33.110044 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece52d3-7aa7-491a-a7ef-ebce4d7cfd65 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:33.110643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece52d3-7aa7-491a-a7ef-ebce4d7cfd65 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:33.110643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece52d3-7aa7-491a-a7ef-ebce4d7cfd65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:33.119995 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece52d3-7aa7-491a-a7ef-ebce4d7cfd65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:33.121486 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece52d3-7aa7-491a-a7ef-ebce4d7cfd65 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:33.125754 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16f9af-0597-4c9f-9704-9a5e7fb64d90 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:33.129890 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489155d-e569-4c9b-96e5-e89905f0021f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:33.130544 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489155d-e569-4c9b-96e5-e89905f0021f service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:33.130858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489155d-e569-4c9b-96e5-e89905f0021f service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:33.131296 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489155d-e569-4c9b-96e5-e89905f0021f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:33.132318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1310/2631] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:33.133096 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece52d3-7aa7-491a-a7ef-ebce4d7cfd65 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:33.138745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:33.141344 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489155d-e569-4c9b-96e5-e89905f0021f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:33.143409 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489155d-e569-4c9b-96e5-e89905f0021f service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:33.144908 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece52d3-7aa7-491a-a7ef-ebce4d7cfd65 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:33.152725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0f97a-4691-4513-a124-a69a8071edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:33.154008 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0f97a-4691-4513-a124-a69a8071edb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:33.154343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0f97a-4691-4513-a124-a69a8071edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:33.154594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1322/2632] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:33.155364 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0f97a-4691-4513-a124-a69a8071edb1 admin admin] PATH_INFO: `/v3/projects/a1fcddd7b1be4a1f9a1c069034ad56ec/users/6e92fe0d06d54d72a550f6dab42c577b/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:33.174369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0f97a-4691-4513-a124-a69a8071edb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fcddd7b1be4a1f9a1c069034ad56ec, user_id=6e92fe0d06d54d72a550f6dab42c577b, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:33.177152 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0f97a-4691-4513-a124-a69a8071edb1 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:33.195985 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1311/2633] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:33 2022] PUT /identity/v3/projects/a1fcddd7b1be4a1f9a1c069034ad56ec/users/6e92fe0d06d54d72a550f6dab42c577b/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:33.200476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489155d-e569-4c9b-96e5-e89905f0021f service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:33.210665 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489155d-e569-4c9b-96e5-e89905f0021f service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:33.284661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c205b-45a0-45a5-921d-1e480a7f43d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:33.285244 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c205b-45a0-45a5-921d-1e480a7f43d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:33.285554 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c205b-45a0-45a5-921d-1e480a7f43d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:33.285831 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c205b-45a0-45a5-921d-1e480a7f43d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:33.286569 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c205b-45a0-45a5-921d-1e480a7f43d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:33.288293 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c205b-45a0-45a5-921d-1e480a7f43d5 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:33.299029 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1323/2634] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:33.303070 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0f97a-4691-4513-a124-a69a8071edb1 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:33.319175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0f97a-4691-4513-a124-a69a8071edb1 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:33.325377 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1617a89-de85-4915-8092-9d4913692554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:33.327211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1617a89-de85-4915-8092-9d4913692554 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:33.327211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1617a89-de85-4915-8092-9d4913692554 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:33.327436 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1617a89-de85-4915-8092-9d4913692554 admin admin] PATH_INFO: `/v3/projects/a1fcddd7b1be4a1f9a1c069034ad56ec/users/6e92fe0d06d54d72a550f6dab42c577b/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:33.329674 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1617a89-de85-4915-8092-9d4913692554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fcddd7b1be4a1f9a1c069034ad56ec, user_id=6e92fe0d06d54d72a550f6dab42c577b, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:33.332652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1617a89-de85-4915-8092-9d4913692554 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:33.347866 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1312/2635] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:33 2022] PUT /identity/v3/projects/a1fcddd7b1be4a1f9a1c069034ad56ec/users/6e92fe0d06d54d72a550f6dab42c577b/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:33.416986 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb158ffa-7259-46f4-9fd0-86064cc70eae None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:33.418148 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb158ffa-7259-46f4-9fd0-86064cc70eae None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:33.418148 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb158ffa-7259-46f4-9fd0-86064cc70eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:33.450209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1617a89-de85-4915-8092-9d4913692554 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:33.452068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a1617a89-de85-4915-8092-9d4913692554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:33.455794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-cb158ffa-7259-46f4-9fd0-86064cc70eae None None] MFA Rules not processed for user `6e92fe0d06d54d72a550f6dab42c577b`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:33.460356 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-cb158ffa-7259-46f4-9fd0-86064cc70eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:33.465187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:33.532916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1617a89-de85-4915-8092-9d4913692554 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:33.537466 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:33.538276 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:33.538559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:33.538859 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] PATH_INFO: `/v3/projects/4fa594c2046346999e1dd3ed1150a45e` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:33.540305 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa594c2046346999e1dd3ed1150a45e)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:33.542234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:33.557926 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1324/2636] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:33.562262 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb158ffa-7259-46f4-9fd0-86064cc70eae None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:33.562262 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-cb158ffa-7259-46f4-9fd0-86064cc70eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:33.579869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb158ffa-7259-46f4-9fd0-86064cc70eae None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:33.594175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa594c2046346999e1dd3ed1150a45e', 'request_id': 'req-552bd69c-37b6-417a-ab16-e30fa28fcf95'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.605483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa594c2046346999e1dd3ed1150a45e', 'request_id': 'req-552bd69c-37b6-417a-ab16-e30fa28fcf95'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.611759 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa594c2046346999e1dd3ed1150a45e', 'request_id': 'req-552bd69c-37b6-417a-ab16-e30fa28fcf95'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.625319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] The token cache is being invalidate because project 4fa594c2046346999e1dd3ed1150a45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:33.625753 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.626387 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.628180 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1313/2637] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:33 2022] DELETE /identity/v3/projects/4fa594c2046346999e1dd3ed1150a45e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:33.628736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:33.631230 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:33.636612 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:33.637496 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:33.637775 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:33.638057 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] PATH_INFO: `/v3/projects/da57111ee8d84d6f9f04ef49579a2776` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:33.639295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] RBAC: Authorizing `identity:delete_project(project_id=da57111ee8d84d6f9f04ef49579a2776)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:33.641467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:33.688591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bd69c-37b6-417a-ab16-e30fa28fcf95 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:33.691997 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da57111ee8d84d6f9f04ef49579a2776', 'request_id': 'req-1ed20532-6e40-4648-abe4-776af4e0117e'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.697961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:33.702476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da57111ee8d84d6f9f04ef49579a2776', 'request_id': 'req-1ed20532-6e40-4648-abe4-776af4e0117e'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.710494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da57111ee8d84d6f9f04ef49579a2776', 'request_id': 'req-1ed20532-6e40-4648-abe4-776af4e0117e'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.722284 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] The token cache is being invalidate because project da57111ee8d84d6f9f04ef49579a2776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:33.722573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.723501 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.725084 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1325/2638] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:33 2022] DELETE /identity/v3/projects/da57111ee8d84d6f9f04ef49579a2776 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:33.726051 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:33.727359 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:33.744690 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6c116-878d-4dc2-8653-62f55905cd96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:33.745348 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6c116-878d-4dc2-8653-62f55905cd96 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:33.745628 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6c116-878d-4dc2-8653-62f55905cd96 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:33.745903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6c116-878d-4dc2-8653-62f55905cd96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:33.747762 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-61f6c116-878d-4dc2-8653-62f55905cd96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:33.763423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:33.796033 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed20532-6e40-4648-abe4-776af4e0117e admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:33.800955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef89d0-b568-443b-9cef-409758e9ce23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:33.801846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef89d0-b568-443b-9cef-409758e9ce23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:33.802119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef89d0-b568-443b-9cef-409758e9ce23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:33.802365 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef89d0-b568-443b-9cef-409758e9ce23 admin admin] PATH_INFO: `/v3/users/111f00473c324e1788a904af3c1deb06` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:33.803722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef89d0-b568-443b-9cef-409758e9ce23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=111f00473c324e1788a904af3c1deb06)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:33.805724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef89d0-b568-443b-9cef-409758e9ce23 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:33.807619 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6c116-878d-4dc2-8653-62f55905cd96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:33.809104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6c116-878d-4dc2-8653-62f55905cd96 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:33.817977 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1314/2639] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:33.818789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6c116-878d-4dc2-8653-62f55905cd96 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:33.820085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-61f6c116-878d-4dc2-8653-62f55905cd96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:33.834559 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6c116-878d-4dc2-8653-62f55905cd96 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:33.840021 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f82e2-cad0-48d9-a9e7-22742de3147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:33.840972 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f82e2-cad0-48d9-a9e7-22742de3147e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:33.841327 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f82e2-cad0-48d9-a9e7-22742de3147e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:33.841589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f82e2-cad0-48d9-a9e7-22742de3147e admin admin] PATH_INFO: `/v3/users/c872bd1bb568486fb42f8c3a322e3adf` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:33.843726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f82e2-cad0-48d9-a9e7-22742de3147e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c872bd1bb568486fb42f8c3a322e3adf)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:33.849067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f82e2-cad0-48d9-a9e7-22742de3147e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:33.870178 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c1ef89d0-b568-443b-9cef-409758e9ce23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111f00473c324e1788a904af3c1deb06'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.884947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c1ef89d0-b568-443b-9cef-409758e9ce23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111f00473c324e1788a904af3c1deb06'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.885798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c1ef89d0-b568-443b-9cef-409758e9ce23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111f00473c324e1788a904af3c1deb06'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.894215 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c1ef89d0-b568-443b-9cef-409758e9ce23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111f00473c324e1788a904af3c1deb06'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.894963 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c1ef89d0-b568-443b-9cef-409758e9ce23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111f00473c324e1788a904af3c1deb06'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.906777 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-7b9f82e2-cad0-48d9-a9e7-22742de3147e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c872bd1bb568486fb42f8c3a322e3adf'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.911620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1326/2640] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:33 2022] DELETE /identity/v3/users/111f00473c324e1788a904af3c1deb06 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:33.923734 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-7b9f82e2-cad0-48d9-a9e7-22742de3147e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c872bd1bb568486fb42f8c3a322e3adf'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.934640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-7b9f82e2-cad0-48d9-a9e7-22742de3147e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c872bd1bb568486fb42f8c3a322e3adf'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.935537 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-7b9f82e2-cad0-48d9-a9e7-22742de3147e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c872bd1bb568486fb42f8c3a322e3adf'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.936250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-7b9f82e2-cad0-48d9-a9e7-22742de3147e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c872bd1bb568486fb42f8c3a322e3adf'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:33.954171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1315/2641] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:33 2022] DELETE /identity/v3/users/c872bd1bb568486fb42f8c3a322e3adf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:34.320756 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef89d0-b568-443b-9cef-409758e9ce23 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:34.322606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c1ef89d0-b568-443b-9cef-409758e9ce23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:34.327071 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f82e2-cad0-48d9-a9e7-22742de3147e admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:34.328973 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7b9f82e2-cad0-48d9-a9e7-22742de3147e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:34.390637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:34.398698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef89d0-b568-443b-9cef-409758e9ce23 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:34.416590 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f82e2-cad0-48d9-a9e7-22742de3147e admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:34.422323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:34.423591 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.423993 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.424256 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5 admin admin] PATH_INFO: `/v3/projects/6fd26b6f51db41789947a2036720ba0d` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.425602 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd26b6f51db41789947a2036720ba0d)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:34.427685 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:34.452137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:34.459377 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e44bd-c33e-46fe-9d88-5f779554e16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:34.460441 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e44bd-c33e-46fe-9d88-5f779554e16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.460883 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e44bd-c33e-46fe-9d88-5f779554e16f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.461513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e44bd-c33e-46fe-9d88-5f779554e16f admin admin] PATH_INFO: `/v3/projects/f2ce6068f0cc4f87a1be5966e87bfedb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.462855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e44bd-c33e-46fe-9d88-5f779554e16f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ce6068f0cc4f87a1be5966e87bfedb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:34.465339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e44bd-c33e-46fe-9d88-5f779554e16f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:34.478217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd26b6f51db41789947a2036720ba0d', 'request_id': 'req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:34.487631 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd26b6f51db41789947a2036720ba0d', 'request_id': 'req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:34.493628 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd26b6f51db41789947a2036720ba0d', 'request_id': 'req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:34.505145 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5 admin admin] The token cache is being invalidate because project 6fd26b6f51db41789947a2036720ba0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:34.505438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:34.506101 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2ca0073d-ba7e-4a1c-ba77-6b7925f6cdc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:34.507938 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1316/2642] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:34 2022] DELETE /identity/v3/projects/6fd26b6f51db41789947a2036720ba0d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:34.512646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb41c2c-ed89-4a87-918f-c26374fa4fbd None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.512931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb41c2c-ed89-4a87-918f-c26374fa4fbd None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.513133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f09e44bd-c33e-46fe-9d88-5f779554e16f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ce6068f0cc4f87a1be5966e87bfedb', 'request_id': 'req-f09e44bd-c33e-46fe-9d88-5f779554e16f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:34.513241 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb41c2c-ed89-4a87-918f-c26374fa4fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.521527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f09e44bd-c33e-46fe-9d88-5f779554e16f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ce6068f0cc4f87a1be5966e87bfedb', 'request_id': 'req-f09e44bd-c33e-46fe-9d88-5f779554e16f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:34.527867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f09e44bd-c33e-46fe-9d88-5f779554e16f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ce6068f0cc4f87a1be5966e87bfedb', 'request_id': 'req-f09e44bd-c33e-46fe-9d88-5f779554e16f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:34.531176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-0bb41c2c-ed89-4a87-918f-c26374fa4fbd None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:34.532445 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-0bb41c2c-ed89-4a87-918f-c26374fa4fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:34.538445 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f09e44bd-c33e-46fe-9d88-5f779554e16f admin admin] The token cache is being invalidate because project f2ce6068f0cc4f87a1be5966e87bfedb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:34.538737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f09e44bd-c33e-46fe-9d88-5f779554e16f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:34.539400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-f09e44bd-c33e-46fe-9d88-5f779554e16f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:34.540967 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1327/2643] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:34 2022] DELETE /identity/v3/projects/f2ce6068f0cc4f87a1be5966e87bfedb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:34.546177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb32a41-6b72-4525-a167-fd31f8013877 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.546479 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb32a41-6b72-4525-a167-fd31f8013877 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.546743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb32a41-6b72-4525-a167-fd31f8013877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.566860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-9eb32a41-6b72-4525-a167-fd31f8013877 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:34.567975 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9eb32a41-6b72-4525-a167-fd31f8013877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:34.591641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1317/2644] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:34.600774 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa745a-b022-4c53-8dde-dd8b84bd6107 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.601090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa745a-b022-4c53-8dde-dd8b84bd6107 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.601370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa745a-b022-4c53-8dde-dd8b84bd6107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.619523 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-2daa745a-b022-4c53-8dde-dd8b84bd6107 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:34.620719 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2daa745a-b022-4c53-8dde-dd8b84bd6107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:34.629107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1318/2645] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:34.630147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1328/2646] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:34.633255 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa745a-b022-4c53-8dde-dd8b84bd6107 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:34.637605 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5449045-5b56-4b73-ad5e-d8c13cef2487 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.637900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5449045-5b56-4b73-ad5e-d8c13cef2487 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.638180 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5449045-5b56-4b73-ad5e-d8c13cef2487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.642519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa745a-b022-4c53-8dde-dd8b84bd6107 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:34.647184 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bcdf0-13bf-4a74-ac6e-8050ba6e57ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:34.647834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bcdf0-13bf-4a74-ac6e-8050ba6e57ea admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.648117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bcdf0-13bf-4a74-ac6e-8050ba6e57ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.648389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bcdf0-13bf-4a74-ac6e-8050ba6e57ea admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.649109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bcdf0-13bf-4a74-ac6e-8050ba6e57ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:34.649417 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bcdf0-13bf-4a74-ac6e-8050ba6e57ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:34.651054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bcdf0-13bf-4a74-ac6e-8050ba6e57ea admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:34.656408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-d5449045-5b56-4b73-ad5e-d8c13cef2487 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:34.657680 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d5449045-5b56-4b73-ad5e-d8c13cef2487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:34.666556 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1319/2647] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:55:34.666708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1329/2648] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:34.667721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bcdf0-13bf-4a74-ac6e-8050ba6e57ea admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:34.670337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5449045-5b56-4b73-ad5e-d8c13cef2487 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:34.678583 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bcdf0-13bf-4a74-ac6e-8050ba6e57ea admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:34.680217 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5449045-5b56-4b73-ad5e-d8c13cef2487 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:34.683745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171c999-e76d-4361-89b7-ea9eb8dd4646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:34.684395 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171c999-e76d-4361-89b7-ea9eb8dd4646 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.684676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171c999-e76d-4361-89b7-ea9eb8dd4646 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.684949 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171c999-e76d-4361-89b7-ea9eb8dd4646 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.685186 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d86be-eb72-416b-aa68-70371479d772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:34.685636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171c999-e76d-4361-89b7-ea9eb8dd4646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:34.685834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d86be-eb72-416b-aa68-70371479d772 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.686118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d86be-eb72-416b-aa68-70371479d772 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.686394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d86be-eb72-416b-aa68-70371479d772 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.687177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d86be-eb72-416b-aa68-70371479d772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:34.687472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d86be-eb72-416b-aa68-70371479d772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:34.687711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171c999-e76d-4361-89b7-ea9eb8dd4646 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:34.689386 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d86be-eb72-416b-aa68-70371479d772 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:34.702113 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1330/2649] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 03:55:34.706714 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d86be-eb72-416b-aa68-70371479d772 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:34.717102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d86be-eb72-416b-aa68-70371479d772 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:34.718789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1320/2650] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:34 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:34.723539 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171c999-e76d-4361-89b7-ea9eb8dd4646 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:34.754060 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:34.775409 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c336c1-3b62-422e-abf2-8db3cce32f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:34.776083 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c336c1-3b62-422e-abf2-8db3cce32f1e admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.776366 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c336c1-3b62-422e-abf2-8db3cce32f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.776646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c336c1-3b62-422e-abf2-8db3cce32f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.777342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c336c1-3b62-422e-abf2-8db3cce32f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:34.779328 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c336c1-3b62-422e-abf2-8db3cce32f1e admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:34.786029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171c999-e76d-4361-89b7-ea9eb8dd4646 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:34.790714 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fe23b-1667-4e1f-966f-fd0b9f9fa26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:34.791411 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fe23b-1667-4e1f-966f-fd0b9f9fa26b admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.791693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fe23b-1667-4e1f-966f-fd0b9f9fa26b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.791970 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fe23b-1667-4e1f-966f-fd0b9f9fa26b admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.792659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fe23b-1667-4e1f-966f-fd0b9f9fa26b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:34.792953 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:34.794597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fe23b-1667-4e1f-966f-fd0b9f9fa26b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:34.812479 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1331/2651] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:34 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:34.813596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c336c1-3b62-422e-abf2-8db3cce32f1e admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:34.818916 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1321/2652] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:34 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:34.819811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fe23b-1667-4e1f-966f-fd0b9f9fa26b admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:34.830453 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fe23b-1667-4e1f-966f-fd0b9f9fa26b admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:34.875125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c336c1-3b62-422e-abf2-8db3cce32f1e admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:34.881187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d43c0-c0e8-45ce-b970-9e6b561287ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:34.882031 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d43c0-c0e8-45ce-b970-9e6b561287ec admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.882196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d43c0-c0e8-45ce-b970-9e6b561287ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.882407 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d43c0-c0e8-45ce-b970-9e6b561287ec admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.883152 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d43c0-c0e8-45ce-b970-9e6b561287ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:34.885113 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d43c0-c0e8-45ce-b970-9e6b561287ec admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:34.891294 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a7d2c-7bb8-4d60-81cb-1718787908f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:34.891966 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a7d2c-7bb8-4d60-81cb-1718787908f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.892246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a7d2c-7bb8-4d60-81cb-1718787908f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.892523 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a7d2c-7bb8-4d60-81cb-1718787908f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.893259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a7d2c-7bb8-4d60-81cb-1718787908f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:34.894891 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a7d2c-7bb8-4d60-81cb-1718787908f7 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:34.908758 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1322/2653] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:34.912797 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1332/2654] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:34 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:34.912953 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a7d2c-7bb8-4d60-81cb-1718787908f7 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:34.913746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d43c0-c0e8-45ce-b970-9e6b561287ec admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:34.920928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a7d2c-7bb8-4d60-81cb-1718787908f7 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:34.923537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d43c0-c0e8-45ce-b970-9e6b561287ec admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:34.926198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef657b-a8d2-41c6-b900-8f0abac5f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:34.927038 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef657b-a8d2-41c6-b900-8f0abac5f453 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.927322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef657b-a8d2-41c6-b900-8f0abac5f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.927594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef657b-a8d2-41c6-b900-8f0abac5f453 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.928147 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b179b5-912d-4ae3-b784-c876c406008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:34.928323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef657b-a8d2-41c6-b900-8f0abac5f453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:34.928798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b179b5-912d-4ae3-b784-c876c406008d admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.929084 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b179b5-912d-4ae3-b784-c876c406008d admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.929360 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b179b5-912d-4ae3-b784-c876c406008d admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.929923 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef657b-a8d2-41c6-b900-8f0abac5f453 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:34.930091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b179b5-912d-4ae3-b784-c876c406008d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:34.931711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b179b5-912d-4ae3-b784-c876c406008d admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:34.940430 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1323/2655] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:34.944732 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef657b-a8d2-41c6-b900-8f0abac5f453 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:34.944903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1333/2656] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:34.948947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b179b5-912d-4ae3-b784-c876c406008d admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:34.955089 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef657b-a8d2-41c6-b900-8f0abac5f453 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:34.959202 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b179b5-912d-4ae3-b784-c876c406008d admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:34.959695 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7491dc-5039-4273-8dcb-a17f8c4a0c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:34.960574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7491dc-5039-4273-8dcb-a17f8c4a0c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.960857 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7491dc-5039-4273-8dcb-a17f8c4a0c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.961136 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7491dc-5039-4273-8dcb-a17f8c4a0c51 admin admin] PATH_INFO: `/v3/projects/1ff52f32e0484ab299b2af50fb63d672/users/f51bf5ed2d1d4959987b64e48f36f1d0/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.963903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77860d16-e58e-44e0-bb6f-a18ec65e00b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:34.964539 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860d16-e58e-44e0-bb6f-a18ec65e00b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:34.964817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860d16-e58e-44e0-bb6f-a18ec65e00b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:34.965148 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860d16-e58e-44e0-bb6f-a18ec65e00b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:34.965841 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77860d16-e58e-44e0-bb6f-a18ec65e00b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:34.967438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77860d16-e58e-44e0-bb6f-a18ec65e00b7 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:34.976499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7491dc-5039-4273-8dcb-a17f8c4a0c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff52f32e0484ab299b2af50fb63d672, user_id=f51bf5ed2d1d4959987b64e48f36f1d0, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:34.979228 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7491dc-5039-4273-8dcb-a17f8c4a0c51 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:34.980292 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1334/2657] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:34.984621 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77860d16-e58e-44e0-bb6f-a18ec65e00b7 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:34.995393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1324/2658] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:34 2022] PUT /identity/v3/projects/1ff52f32e0484ab299b2af50fb63d672/users/f51bf5ed2d1d4959987b64e48f36f1d0/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:34.998561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77860d16-e58e-44e0-bb6f-a18ec65e00b7 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.005865 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ade3-0947-4dcd-b332-05321532d6c2 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.006308 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ade3-0947-4dcd-b332-05321532d6c2 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.006588 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ade3-0947-4dcd-b332-05321532d6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.032410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-a286ade3-0947-4dcd-b332-05321532d6c2 None None] MFA Rules not processed for user `f51bf5ed2d1d4959987b64e48f36f1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:35.033637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a286ade3-0947-4dcd-b332-05321532d6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:35.068058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847cd76-67dc-4f22-ae37-836e432c77fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.069590 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847cd76-67dc-4f22-ae37-836e432c77fc admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.070004 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847cd76-67dc-4f22-ae37-836e432c77fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.070456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847cd76-67dc-4f22-ae37-836e432c77fc admin admin] PATH_INFO: `/v3/projects/7120b5f399c640d8be53b6119d1b73f9/users/0ff7fcd1de1c469da31e9bdedeb43af9/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.086247 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847cd76-67dc-4f22-ae37-836e432c77fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7120b5f399c640d8be53b6119d1b73f9, user_id=0ff7fcd1de1c469da31e9bdedeb43af9, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:35.088937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847cd76-67dc-4f22-ae37-836e432c77fc admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:35.104299 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1335/2659] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:34 2022] PUT /identity/v3/projects/7120b5f399c640d8be53b6119d1b73f9/users/0ff7fcd1de1c469da31e9bdedeb43af9/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:35.109918 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1325/2660] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:35.114296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286ade3-0947-4dcd-b332-05321532d6c2 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:35.114735 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba180140-2316-4e64-895c-291c20f98e86 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.115084 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba180140-2316-4e64-895c-291c20f98e86 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.115360 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba180140-2316-4e64-895c-291c20f98e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.125621 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286ade3-0947-4dcd-b332-05321532d6c2 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.130288 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:35.143528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-ba180140-2316-4e64-895c-291c20f98e86 None None] MFA Rules not processed for user `0ff7fcd1de1c469da31e9bdedeb43af9`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:35.144845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ba180140-2316-4e64-895c-291c20f98e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:35.184042 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:35.192859 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca243a8-e78b-46d7-8a34-617239f07fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.193542 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca243a8-e78b-46d7-8a34-617239f07fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.193826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca243a8-e78b-46d7-8a34-617239f07fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.194331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca243a8-e78b-46d7-8a34-617239f07fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.194925 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca243a8-e78b-46d7-8a34-617239f07fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:35.197236 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca243a8-e78b-46d7-8a34-617239f07fa1 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:35.229939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1336/2661] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:35.234922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba180140-2316-4e64-895c-291c20f98e86 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:35.239308 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1326/2662] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:35 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:35.240110 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca243a8-e78b-46d7-8a34-617239f07fa1 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:35.247509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba180140-2316-4e64-895c-291c20f98e86 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.310393 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca243a8-e78b-46d7-8a34-617239f07fa1 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.315963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100d863-fc07-467d-8a93-b2436350f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.316697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100d863-fc07-467d-8a93-b2436350f40c admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.316982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100d863-fc07-467d-8a93-b2436350f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.317257 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100d863-fc07-467d-8a93-b2436350f40c admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.317950 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100d863-fc07-467d-8a93-b2436350f40c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:35.319999 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100d863-fc07-467d-8a93-b2436350f40c admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:35.321329 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3e1d2-346d-41ce-a0b0-ddd6d32295ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.322444 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e1d2-346d-41ce-a0b0-ddd6d32295ca admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.322859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e1d2-346d-41ce-a0b0-ddd6d32295ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.323228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e1d2-346d-41ce-a0b0-ddd6d32295ca admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.324006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3e1d2-346d-41ce-a0b0-ddd6d32295ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:35.326052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3e1d2-346d-41ce-a0b0-ddd6d32295ca admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:35.345291 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1327/2663] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:35 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:55:35.349138 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100d863-fc07-467d-8a93-b2436350f40c admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:35.359389 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1337/2664] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:35 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:55:35.360468 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100d863-fc07-467d-8a93-b2436350f40c admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.363685 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3e1d2-346d-41ce-a0b0-ddd6d32295ca admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:35.424575 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232b601-5036-4f24-bb36-33667c300805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.425250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232b601-5036-4f24-bb36-33667c300805 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.425537 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232b601-5036-4f24-bb36-33667c300805 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.425814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232b601-5036-4f24-bb36-33667c300805 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.426547 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232b601-5036-4f24-bb36-33667c300805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:35.427177 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3e1d2-346d-41ce-a0b0-ddd6d32295ca admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.428220 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232b601-5036-4f24-bb36-33667c300805 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:35.431858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c4761-028a-4666-9239-bca8675ec620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.432529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c4761-028a-4666-9239-bca8675ec620 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.432819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c4761-028a-4666-9239-bca8675ec620 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.433098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c4761-028a-4666-9239-bca8675ec620 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.433791 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c4761-028a-4666-9239-bca8675ec620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:35.435750 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c4761-028a-4666-9239-bca8675ec620 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:35.438368 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1328/2665] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:35.440011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232b601-5036-4f24-bb36-33667c300805 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:35.441843 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-3232b601-5036-4f24-bb36-33667c300805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:35.463061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1338/2666] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:35 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:55:35.463061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c4761-028a-4666-9239-bca8675ec620 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:35.467871 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:35.471234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c4761-028a-4666-9239-bca8675ec620 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.476718 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd1894-f745-47d0-a199-8938b8697981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.477604 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd1894-f745-47d0-a199-8938b8697981 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.477880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd1894-f745-47d0-a199-8938b8697981 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.478150 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd1894-f745-47d0-a199-8938b8697981 admin admin] PATH_INFO: `/v3/projects/e568c72b4b154cc1978f23e825bd40f5/users/31521f260c094411b6683eb5fcd313ba/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.493153 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd1894-f745-47d0-a199-8938b8697981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e568c72b4b154cc1978f23e825bd40f5, user_id=31521f260c094411b6683eb5fcd313ba, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:35.495951 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd1894-f745-47d0-a199-8938b8697981 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:35.504754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232b601-5036-4f24-bb36-33667c300805 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.510191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1339/2667] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:35 2022] PUT /identity/v3/projects/e568c72b4b154cc1978f23e825bd40f5/users/31521f260c094411b6683eb5fcd313ba/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:35.511210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd1894-f745-47d0-a199-8938b8697981 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:35.537432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:35.554030 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b4291-2c56-4b73-bf6a-6f33852c5bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.554692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b4291-2c56-4b73-bf6a-6f33852c5bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.555051 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b4291-2c56-4b73-bf6a-6f33852c5bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.555338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b4291-2c56-4b73-bf6a-6f33852c5bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.557343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-9c6b4291-2c56-4b73-bf6a-6f33852c5bb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:35.573732 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd1894-f745-47d0-a199-8938b8697981 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.579554 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be636540-784f-4b1a-a502-92d2ee934108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.580228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636540-784f-4b1a-a502-92d2ee934108 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.580510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636540-784f-4b1a-a502-92d2ee934108 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.580784 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636540-784f-4b1a-a502-92d2ee934108 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.581512 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be636540-784f-4b1a-a502-92d2ee934108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:35.583529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be636540-784f-4b1a-a502-92d2ee934108 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:35.597032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1340/2668] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:35.597032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be636540-784f-4b1a-a502-92d2ee934108 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:35.605532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be636540-784f-4b1a-a502-92d2ee934108 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.610596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad984e5-84bc-4743-b2fc-98f456df5c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.611283 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad984e5-84bc-4743-b2fc-98f456df5c7f admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.611566 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad984e5-84bc-4743-b2fc-98f456df5c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.611842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad984e5-84bc-4743-b2fc-98f456df5c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.612743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad984e5-84bc-4743-b2fc-98f456df5c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:35.614335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad984e5-84bc-4743-b2fc-98f456df5c7f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:35.617455 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b4291-2c56-4b73-bf6a-6f33852c5bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:35.618982 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b4291-2c56-4b73-bf6a-6f33852c5bb8 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:35.624352 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1341/2669] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:35.625271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad984e5-84bc-4743-b2fc-98f456df5c7f admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:35.628217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1329/2670] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:35.629002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b4291-2c56-4b73-bf6a-6f33852c5bb8 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:35.637357 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad984e5-84bc-4743-b2fc-98f456df5c7f admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.639491 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b4291-2c56-4b73-bf6a-6f33852c5bb8 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.642189 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c6860-96f6-4246-b640-95b3c2a88318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.643110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c6860-96f6-4246-b640-95b3c2a88318 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.643394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c6860-96f6-4246-b640-95b3c2a88318 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.643668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c6860-96f6-4246-b640-95b3c2a88318 admin admin] PATH_INFO: `/v3/projects/1978c94740e848e8b85f9d4d7f73cb76/users/6a264055582f4a30a5e2065e75f42819/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.644535 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e667948-2205-4127-8ada-3c0969f885ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.645458 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e667948-2205-4127-8ada-3c0969f885ee admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.645696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e667948-2205-4127-8ada-3c0969f885ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.646132 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e667948-2205-4127-8ada-3c0969f885ee admin admin] PATH_INFO: `/v3/projects/e568c72b4b154cc1978f23e825bd40f5/users/31521f260c094411b6683eb5fcd313ba/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.649087 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e667948-2205-4127-8ada-3c0969f885ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e568c72b4b154cc1978f23e825bd40f5, user_id=31521f260c094411b6683eb5fcd313ba, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:35.651797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e667948-2205-4127-8ada-3c0969f885ee admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:35.661061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c6860-96f6-4246-b640-95b3c2a88318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1978c94740e848e8b85f9d4d7f73cb76, user_id=6a264055582f4a30a5e2065e75f42819, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:35.663281 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1330/2671] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:35 2022] PUT /identity/v3/projects/e568c72b4b154cc1978f23e825bd40f5/users/31521f260c094411b6683eb5fcd313ba/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:35.664123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c6860-96f6-4246-b640-95b3c2a88318 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:35.674480 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fe27d-03ab-4518-8953-1118d35b7a74 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.674819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fe27d-03ab-4518-8953-1118d35b7a74 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.675075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fe27d-03ab-4518-8953-1118d35b7a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.681153 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1342/2672] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:35 2022] PUT /identity/v3/projects/1978c94740e848e8b85f9d4d7f73cb76/users/6a264055582f4a30a5e2065e75f42819/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:35.685075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c6860-96f6-4246-b640-95b3c2a88318 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:35.711451 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-7c2fe27d-03ab-4518-8953-1118d35b7a74 None None] MFA Rules not processed for user `31521f260c094411b6683eb5fcd313ba`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:35.712674 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7c2fe27d-03ab-4518-8953-1118d35b7a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:35.762392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c6860-96f6-4246-b640-95b3c2a88318 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.767958 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbde161-ec32-40d2-9149-94d68baa33cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.768918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbde161-ec32-40d2-9149-94d68baa33cb admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.769206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbde161-ec32-40d2-9149-94d68baa33cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.769503 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbde161-ec32-40d2-9149-94d68baa33cb admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.770371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbde161-ec32-40d2-9149-94d68baa33cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:35.772041 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbde161-ec32-40d2-9149-94d68baa33cb admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:35.783155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1343/2673] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:35.789393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbde161-ec32-40d2-9149-94d68baa33cb admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:35.795250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1331/2674] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:35.802193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbde161-ec32-40d2-9149-94d68baa33cb admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.807610 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fe27d-03ab-4518-8953-1118d35b7a74 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:35.808273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce76703-06b8-4635-9046-b471ceab798d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.809014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-7c2fe27d-03ab-4518-8953-1118d35b7a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:35.811920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce76703-06b8-4635-9046-b471ceab798d admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.812214 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce76703-06b8-4635-9046-b471ceab798d admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.812495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce76703-06b8-4635-9046-b471ceab798d admin admin] PATH_INFO: `/v3/projects/1978c94740e848e8b85f9d4d7f73cb76/users/6a264055582f4a30a5e2065e75f42819/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.814446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:35.816229 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce76703-06b8-4635-9046-b471ceab798d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1978c94740e848e8b85f9d4d7f73cb76, user_id=6a264055582f4a30a5e2065e75f42819, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:35.819172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce76703-06b8-4635-9046-b471ceab798d admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:35.831162 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1344/2675] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:35 2022] PUT /identity/v3/projects/1978c94740e848e8b85f9d4d7f73cb76/users/6a264055582f4a30a5e2065e75f42819/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:35.842725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335bc0d-0cd3-486a-813a-c57cb4262728 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.842725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335bc0d-0cd3-486a-813a-c57cb4262728 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.843023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335bc0d-0cd3-486a-813a-c57cb4262728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.871633 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6335bc0d-0cd3-486a-813a-c57cb4262728 None None] MFA Rules not processed for user `6a264055582f4a30a5e2065e75f42819`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:35.872964 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6335bc0d-0cd3-486a-813a-c57cb4262728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:35.884889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fe27d-03ab-4518-8953-1118d35b7a74 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:35.943094 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6222c-2e07-42cc-a3cc-53a889464c70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:35.944845 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6222c-2e07-42cc-a3cc-53a889464c70 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:35.945110 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6222c-2e07-42cc-a3cc-53a889464c70 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:35.945384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6222c-2e07-42cc-a3cc-53a889464c70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:35.951931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:35.964222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1345/2676] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:36.014165 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6222c-2e07-42cc-a3cc-53a889464c70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:36.015858 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6222c-2e07-42cc-a3cc-53a889464c70 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:36.026017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1332/2677] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:55:36.068723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335bc0d-0cd3-486a-813a-c57cb4262728 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:36.079085 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335bc0d-0cd3-486a-813a-c57cb4262728 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:36.083304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318eed0a-ddcd-48c9-87fc-3c92b986fd8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:36.084027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318eed0a-ddcd-48c9-87fc-3c92b986fd8b service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:36.084317 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318eed0a-ddcd-48c9-87fc-3c92b986fd8b service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:36.084596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318eed0a-ddcd-48c9-87fc-3c92b986fd8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:36.094334 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318eed0a-ddcd-48c9-87fc-3c92b986fd8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:36.095917 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318eed0a-ddcd-48c9-87fc-3c92b986fd8b service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:36.111463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1346/2678] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:36.151903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6222c-2e07-42cc-a3cc-53a889464c70 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:36.160956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6222c-2e07-42cc-a3cc-53a889464c70 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:36.164582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621341ef-5913-486a-85d3-6ad7c2733362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:36.165226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621341ef-5913-486a-85d3-6ad7c2733362 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:36.165505 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621341ef-5913-486a-85d3-6ad7c2733362 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:36.165777 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621341ef-5913-486a-85d3-6ad7c2733362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:36.241380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621341ef-5913-486a-85d3-6ad7c2733362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:36.244304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621341ef-5913-486a-85d3-6ad7c2733362 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:36.254814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1333/2679] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:36.281803 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318eed0a-ddcd-48c9-87fc-3c92b986fd8b service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:36.290617 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318eed0a-ddcd-48c9-87fc-3c92b986fd8b service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:36.294304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff49ee-1892-4a23-aba3-8f02a54b7699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:36.294978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff49ee-1892-4a23-aba3-8f02a54b7699 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:36.295260 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff49ee-1892-4a23-aba3-8f02a54b7699 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:36.295534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff49ee-1892-4a23-aba3-8f02a54b7699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:36.297342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-48ff49ee-1892-4a23-aba3-8f02a54b7699 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:36.362877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff49ee-1892-4a23-aba3-8f02a54b7699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:36.364340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff49ee-1892-4a23-aba3-8f02a54b7699 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:36.374627 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1347/2680] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:36.387622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621341ef-5913-486a-85d3-6ad7c2733362 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:36.400250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:36.469317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621341ef-5913-486a-85d3-6ad7c2733362 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:36.473932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177e1b8-40cc-4d79-a9d4-5fa8dfd42cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:36.474846 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177e1b8-40cc-4d79-a9d4-5fa8dfd42cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:36.475229 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177e1b8-40cc-4d79-a9d4-5fa8dfd42cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:36.475502 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177e1b8-40cc-4d79-a9d4-5fa8dfd42cd0 admin admin] PATH_INFO: `/v3/users/0ff7fcd1de1c469da31e9bdedeb43af9` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:36.476692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177e1b8-40cc-4d79-a9d4-5fa8dfd42cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff7fcd1de1c469da31e9bdedeb43af9)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:36.478612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177e1b8-40cc-4d79-a9d4-5fa8dfd42cd0 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:36.530814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b177e1b8-40cc-4d79-a9d4-5fa8dfd42cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff7fcd1de1c469da31e9bdedeb43af9'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:36.542592 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b177e1b8-40cc-4d79-a9d4-5fa8dfd42cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff7fcd1de1c469da31e9bdedeb43af9'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:36.549683 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b177e1b8-40cc-4d79-a9d4-5fa8dfd42cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff7fcd1de1c469da31e9bdedeb43af9'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:36.550349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b177e1b8-40cc-4d79-a9d4-5fa8dfd42cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff7fcd1de1c469da31e9bdedeb43af9'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:36.550969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-b177e1b8-40cc-4d79-a9d4-5fa8dfd42cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff7fcd1de1c469da31e9bdedeb43af9'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:36.565490 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1334/2681] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:36 2022] DELETE /identity/v3/users/0ff7fcd1de1c469da31e9bdedeb43af9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:36.570120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a7b7c-99d9-4180-aa64-2b21c4897c5f None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:36.570406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a7b7c-99d9-4180-aa64-2b21c4897c5f None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:36.570679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a7b7c-99d9-4180-aa64-2b21c4897c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:36.589068 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-1c7a7b7c-99d9-4180-aa64-2b21c4897c5f None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:36.590472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1c7a7b7c-99d9-4180-aa64-2b21c4897c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:36.652902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1348/2682] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:36.663013 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177e1b8-40cc-4d79-a9d4-5fa8dfd42cd0 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:36.664597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-b177e1b8-40cc-4d79-a9d4-5fa8dfd42cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:36.725385 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177e1b8-40cc-4d79-a9d4-5fa8dfd42cd0 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:36.729852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451af2c-ecfd-4abd-8729-25873246b2e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:36.730507 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451af2c-ecfd-4abd-8729-25873246b2e3 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:36.730803 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451af2c-ecfd-4abd-8729-25873246b2e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:36.731083 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451af2c-ecfd-4abd-8729-25873246b2e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:36.740517 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451af2c-ecfd-4abd-8729-25873246b2e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:36.741975 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451af2c-ecfd-4abd-8729-25873246b2e3 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:36.751854 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1335/2683] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:37.025727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a7b7c-99d9-4180-aa64-2b21c4897c5f None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:37.027598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1c7a7b7c-99d9-4180-aa64-2b21c4897c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:37.041061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a7b7c-99d9-4180-aa64-2b21c4897c5f None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:37.046089 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:37.047030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:37.047508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:37.047898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] PATH_INFO: `/v3/projects/7120b5f399c640d8be53b6119d1b73f9` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:37.049556 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7120b5f399c640d8be53b6119d1b73f9)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:37.051769 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:37.104574 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7120b5f399c640d8be53b6119d1b73f9', 'request_id': 'req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.113235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7120b5f399c640d8be53b6119d1b73f9', 'request_id': 'req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.119583 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7120b5f399c640d8be53b6119d1b73f9', 'request_id': 'req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.126259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:37.131670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] The token cache is being invalidate because project 7120b5f399c640d8be53b6119d1b73f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:37.131968 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.133010 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.134867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1349/2684] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:37 2022] DELETE /identity/v3/projects/7120b5f399c640d8be53b6119d1b73f9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:37.139394 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451af2c-ecfd-4abd-8729-25873246b2e3 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:37.149806 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451af2c-ecfd-4abd-8729-25873246b2e3 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:37.177144 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:37.210841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb98a31-55a4-4d1e-b1f6-4078fa45b0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:37.211644 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb98a31-55a4-4d1e-b1f6-4078fa45b0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:37.211921 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb98a31-55a4-4d1e-b1f6-4078fa45b0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:37.212319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb98a31-55a4-4d1e-b1f6-4078fa45b0ed admin admin] PATH_INFO: `/v3/users/6a264055582f4a30a5e2065e75f42819` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:37.213553 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb98a31-55a4-4d1e-b1f6-4078fa45b0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a264055582f4a30a5e2065e75f42819)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:37.215511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb98a31-55a4-4d1e-b1f6-4078fa45b0ed admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:37.270816 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8eb98a31-55a4-4d1e-b1f6-4078fa45b0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a264055582f4a30a5e2065e75f42819'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.283112 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8eb98a31-55a4-4d1e-b1f6-4078fa45b0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a264055582f4a30a5e2065e75f42819'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.290692 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8eb98a31-55a4-4d1e-b1f6-4078fa45b0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a264055582f4a30a5e2065e75f42819'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.291454 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8eb98a31-55a4-4d1e-b1f6-4078fa45b0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a264055582f4a30a5e2065e75f42819'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.292118 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8eb98a31-55a4-4d1e-b1f6-4078fa45b0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a264055582f4a30a5e2065e75f42819'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.308464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1336/2685] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:37 2022] DELETE /identity/v3/users/6a264055582f4a30a5e2065e75f42819 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:37.595436 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:37.597012 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:37.616024 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c703ac-d0b4-43c9-ae5e-69d0d10faffb admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:37.690022 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ee35b-971d-40a7-a3fd-2f118197a15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:37.690938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ee35b-971d-40a7-a3fd-2f118197a15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:37.691209 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ee35b-971d-40a7-a3fd-2f118197a15d admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:37.691486 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ee35b-971d-40a7-a3fd-2f118197a15d admin admin] PATH_INFO: `/v3/projects/1978c94740e848e8b85f9d4d7f73cb76` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:37.692689 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ee35b-971d-40a7-a3fd-2f118197a15d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1978c94740e848e8b85f9d4d7f73cb76)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:37.694785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ee35b-971d-40a7-a3fd-2f118197a15d admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:37.762535 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1b8ee35b-971d-40a7-a3fd-2f118197a15d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1978c94740e848e8b85f9d4d7f73cb76', 'request_id': 'req-1b8ee35b-971d-40a7-a3fd-2f118197a15d'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.774226 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1b8ee35b-971d-40a7-a3fd-2f118197a15d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1978c94740e848e8b85f9d4d7f73cb76', 'request_id': 'req-1b8ee35b-971d-40a7-a3fd-2f118197a15d'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.784493 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1b8ee35b-971d-40a7-a3fd-2f118197a15d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1978c94740e848e8b85f9d4d7f73cb76', 'request_id': 'req-1b8ee35b-971d-40a7-a3fd-2f118197a15d'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.804920 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1b8ee35b-971d-40a7-a3fd-2f118197a15d admin admin] The token cache is being invalidate because project 1978c94740e848e8b85f9d4d7f73cb76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:37.805413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1b8ee35b-971d-40a7-a3fd-2f118197a15d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.808095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1b8ee35b-971d-40a7-a3fd-2f118197a15d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:37.810088 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1350/2686] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:37 2022] DELETE /identity/v3/projects/1978c94740e848e8b85f9d4d7f73cb76 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:37.814951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87c83b-546a-41e2-9f79-c91b996c8bf4 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:37.815984 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87c83b-546a-41e2-9f79-c91b996c8bf4 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:37.816265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87c83b-546a-41e2-9f79-c91b996c8bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:37.837651 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-0e87c83b-546a-41e2-9f79-c91b996c8bf4 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:37.838977 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-0e87c83b-546a-41e2-9f79-c91b996c8bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:37.918423 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1337/2687] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:37.926783 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f33522-b53f-419d-9011-a75f7455d47b None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:37.927221 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f33522-b53f-419d-9011-a75f7455d47b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:37.927561 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f33522-b53f-419d-9011-a75f7455d47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:37.945800 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-78f33522-b53f-419d-9011-a75f7455d47b None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:37.947468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-78f33522-b53f-419d-9011-a75f7455d47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:37.956427 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1351/2688] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:37.961272 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87c83b-546a-41e2-9f79-c91b996c8bf4 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:37.972540 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87c83b-546a-41e2-9f79-c91b996c8bf4 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:37.977391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982b7e4-10b2-466f-bb09-d81fce3b8646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:37.977992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982b7e4-10b2-466f-bb09-d81fce3b8646 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:37.978356 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982b7e4-10b2-466f-bb09-d81fce3b8646 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:37.978704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982b7e4-10b2-466f-bb09-d81fce3b8646 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:37.979540 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982b7e4-10b2-466f-bb09-d81fce3b8646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:37.979889 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982b7e4-10b2-466f-bb09-d81fce3b8646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:37.981612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982b7e4-10b2-466f-bb09-d81fce3b8646 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:37.997677 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1338/2689] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:55:38.001953 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f33522-b53f-419d-9011-a75f7455d47b None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:38.011305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f33522-b53f-419d-9011-a75f7455d47b None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:38.016538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd9e9b-5c82-43c2-bbc2-260e65d6cb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:38.017216 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd9e9b-5c82-43c2-bbc2-260e65d6cb81 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:38.017497 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd9e9b-5c82-43c2-bbc2-260e65d6cb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:38.017771 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd9e9b-5c82-43c2-bbc2-260e65d6cb81 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:38.018455 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd9e9b-5c82-43c2-bbc2-260e65d6cb81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:38.020406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd9e9b-5c82-43c2-bbc2-260e65d6cb81 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:38.049484 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1352/2690] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:38 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:38.053971 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982b7e4-10b2-466f-bb09-d81fce3b8646 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:38.064379 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982b7e4-10b2-466f-bb09-d81fce3b8646 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:38.097390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:38.126438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ce9fc-c0e8-4419-9696-df018af523ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:38.127152 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ce9fc-c0e8-4419-9696-df018af523ad admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:38.127450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ce9fc-c0e8-4419-9696-df018af523ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:38.127790 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ce9fc-c0e8-4419-9696-df018af523ad admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:38.128485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ce9fc-c0e8-4419-9696-df018af523ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:38.130423 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ce9fc-c0e8-4419-9696-df018af523ad admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:38.155461 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1339/2691] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:38 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:38.159490 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd9e9b-5c82-43c2-bbc2-260e65d6cb81 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:38.171403 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd9e9b-5c82-43c2-bbc2-260e65d6cb81 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:38.176657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da87cd-be4a-44a3-89f4-794813fe2fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:38.177324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da87cd-be4a-44a3-89f4-794813fe2fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:38.177609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da87cd-be4a-44a3-89f4-794813fe2fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:38.177886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da87cd-be4a-44a3-89f4-794813fe2fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:38.178630 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da87cd-be4a-44a3-89f4-794813fe2fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:38.180318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da87cd-be4a-44a3-89f4-794813fe2fa8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:38.191614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1353/2692] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:38.195818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ce9fc-c0e8-4419-9696-df018af523ad admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:38.207024 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ce9fc-c0e8-4419-9696-df018af523ad admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:38.212909 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487f382-df36-4411-87c5-d712fcaa1060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:38.213565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487f382-df36-4411-87c5-d712fcaa1060 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:38.213876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487f382-df36-4411-87c5-d712fcaa1060 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:38.214140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487f382-df36-4411-87c5-d712fcaa1060 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:38.214901 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487f382-df36-4411-87c5-d712fcaa1060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:38.216526 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487f382-df36-4411-87c5-d712fcaa1060 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:38.228204 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1340/2693] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:38.232520 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da87cd-be4a-44a3-89f4-794813fe2fa8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:38.245111 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da87cd-be4a-44a3-89f4-794813fe2fa8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:38.250110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a47d63-ee3d-4fc6-9f3f-68f9c9eebd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:38.251112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a47d63-ee3d-4fc6-9f3f-68f9c9eebd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:38.251533 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a47d63-ee3d-4fc6-9f3f-68f9c9eebd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:38.251903 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a47d63-ee3d-4fc6-9f3f-68f9c9eebd5b admin admin] PATH_INFO: `/v3/projects/b0d4093fc09643f9abb129cc1e2a2a68/users/a18b9e77840c4d4cb18fc0b16c20b0a5/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:38.267313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a47d63-ee3d-4fc6-9f3f-68f9c9eebd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d4093fc09643f9abb129cc1e2a2a68, user_id=a18b9e77840c4d4cb18fc0b16c20b0a5, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:38.270851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a47d63-ee3d-4fc6-9f3f-68f9c9eebd5b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:38.285877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1354/2694] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:38 2022] PUT /identity/v3/projects/b0d4093fc09643f9abb129cc1e2a2a68/users/a18b9e77840c4d4cb18fc0b16c20b0a5/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:38.296450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29559153-ae97-4457-b046-2e87baff7885 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:38.296740 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29559153-ae97-4457-b046-2e87baff7885 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:38.297090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29559153-ae97-4457-b046-2e87baff7885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:38.326366 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-29559153-ae97-4457-b046-2e87baff7885 None None] MFA Rules not processed for user `a18b9e77840c4d4cb18fc0b16c20b0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:38.327615 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-29559153-ae97-4457-b046-2e87baff7885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:38.392419 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1341/2695] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:38.404055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a47d63-ee3d-4fc6-9f3f-68f9c9eebd5b admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:38.405953 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-f0a47d63-ee3d-4fc6-9f3f-68f9c9eebd5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:38.436072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:38.467724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a47d63-ee3d-4fc6-9f3f-68f9c9eebd5b admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:38.471774 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5711cf-6b07-4421-b225-538954f4e564 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450fda3236cc4d1ba3189b6b66f65686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:38.472420 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5711cf-6b07-4421-b225-538954f4e564 service glance] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:38.472698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5711cf-6b07-4421-b225-538954f4e564 service glance] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:38.472941 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5711cf-6b07-4421-b225-538954f4e564 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:38.481646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5711cf-6b07-4421-b225-538954f4e564 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:38.483047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5711cf-6b07-4421-b225-538954f4e564 service glance] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:38.492123 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1355/2696] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:55:40.372959 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29559153-ae97-4457-b046-2e87baff7885 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:40.375308 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-29559153-ae97-4457-b046-2e87baff7885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:40.450562 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29559153-ae97-4457-b046-2e87baff7885 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:40.456143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a4176-d822-48b7-bc50-847213045761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:40.457035 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4176-d822-48b7-bc50-847213045761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:40.457311 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4176-d822-48b7-bc50-847213045761 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:40.457589 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4176-d822-48b7-bc50-847213045761 admin admin] PATH_INFO: `/v3/users/359fe975e5b144f990b2a3313b7cc860` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:40.458873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a4176-d822-48b7-bc50-847213045761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=359fe975e5b144f990b2a3313b7cc860)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:40.460862 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a4176-d822-48b7-bc50-847213045761 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:40.509912 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:40.511894 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-229a4176-d822-48b7-bc50-847213045761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359fe975e5b144f990b2a3313b7cc860'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:40.526133 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-229a4176-d822-48b7-bc50-847213045761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359fe975e5b144f990b2a3313b7cc860'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:40.533009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-229a4176-d822-48b7-bc50-847213045761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359fe975e5b144f990b2a3313b7cc860'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:40.533737 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-229a4176-d822-48b7-bc50-847213045761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359fe975e5b144f990b2a3313b7cc860'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:40.534341 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-229a4176-d822-48b7-bc50-847213045761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359fe975e5b144f990b2a3313b7cc860'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:40.549652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1342/2697] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:40 2022] DELETE /identity/v3/users/359fe975e5b144f990b2a3313b7cc860 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:40.554807 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c86bf-350f-443e-b4b4-7a978468d570 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:40.555327 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c86bf-350f-443e-b4b4-7a978468d570 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:40.555491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c86bf-350f-443e-b4b4-7a978468d570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:40.575322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-300c86bf-350f-443e-b4b4-7a978468d570 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:40.576532 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-300c86bf-350f-443e-b4b4-7a978468d570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:40.639114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1356/2698] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:40.650358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a4176-d822-48b7-bc50-847213045761 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:40.651870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-229a4176-d822-48b7-bc50-847213045761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:40.735852 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a4176-d822-48b7-bc50-847213045761 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:40.739332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46791bf4-a21d-4da3-b74f-8699444bd950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:40.739983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46791bf4-a21d-4da3-b74f-8699444bd950 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:40.740324 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46791bf4-a21d-4da3-b74f-8699444bd950 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:40.740601 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46791bf4-a21d-4da3-b74f-8699444bd950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:40.751149 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46791bf4-a21d-4da3-b74f-8699444bd950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:40.753263 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46791bf4-a21d-4da3-b74f-8699444bd950 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:40.766949 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1343/2699] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:41.067935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c86bf-350f-443e-b4b4-7a978468d570 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:41.069610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-300c86bf-350f-443e-b4b4-7a978468d570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:41.094028 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c86bf-350f-443e-b4b4-7a978468d570 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:41.099125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:41.100004 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:41.100318 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:41.100533 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] PATH_INFO: `/v3/projects/77ab5d9773e448bdbf71586f230cf820` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:41.102202 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ab5d9773e448bdbf71586f230cf820)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:41.104705 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:41.157438 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ab5d9773e448bdbf71586f230cf820', 'request_id': 'req-a39a090c-ebf2-4fbb-a39c-49408148b47f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:41.165575 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ab5d9773e448bdbf71586f230cf820', 'request_id': 'req-a39a090c-ebf2-4fbb-a39c-49408148b47f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:41.173832 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ab5d9773e448bdbf71586f230cf820', 'request_id': 'req-a39a090c-ebf2-4fbb-a39c-49408148b47f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:41.188379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] The token cache is being invalidate because project 77ab5d9773e448bdbf71586f230cf820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:41.188666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:41.189398 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:41.191661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1357/2700] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:41 2022] DELETE /identity/v3/projects/77ab5d9773e448bdbf71586f230cf820 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:41.196067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46791bf4-a21d-4da3-b74f-8699444bd950 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:41.207840 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46791bf4-a21d-4da3-b74f-8699444bd950 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:41.268147 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88631a-26a8-442f-bd78-d11b2e5e9c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:41.269035 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88631a-26a8-442f-bd78-d11b2e5e9c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:41.269320 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88631a-26a8-442f-bd78-d11b2e5e9c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:41.269597 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88631a-26a8-442f-bd78-d11b2e5e9c8d admin admin] PATH_INFO: `/v3/users/ea7b310bc8dc4d68ba4498894c9b89e4` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:41.270804 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88631a-26a8-442f-bd78-d11b2e5e9c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7b310bc8dc4d68ba4498894c9b89e4)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:41.272754 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88631a-26a8-442f-bd78-d11b2e5e9c8d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:41.326798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cb88631a-26a8-442f-bd78-d11b2e5e9c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7b310bc8dc4d68ba4498894c9b89e4'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:41.339577 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cb88631a-26a8-442f-bd78-d11b2e5e9c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7b310bc8dc4d68ba4498894c9b89e4'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:41.341628 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:41.347981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cb88631a-26a8-442f-bd78-d11b2e5e9c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7b310bc8dc4d68ba4498894c9b89e4'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:41.348758 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cb88631a-26a8-442f-bd78-d11b2e5e9c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7b310bc8dc4d68ba4498894c9b89e4'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:41.349640 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-cb88631a-26a8-442f-bd78-d11b2e5e9c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7b310bc8dc4d68ba4498894c9b89e4'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:41.366865 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1344/2701] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:41 2022] DELETE /identity/v3/users/ea7b310bc8dc4d68ba4498894c9b89e4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:41.911073 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:41.912565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:41.926749 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a090c-ebf2-4fbb-a39c-49408148b47f admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:41.978991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:41.991375 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:41.992297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:41.992577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:41.992860 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] PATH_INFO: `/v3/projects/f675b96e3da94e33b18d9f249c4507af` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:41.995253 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f675b96e3da94e33b18d9f249c4507af)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:41.998427 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:42.056614 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f675b96e3da94e33b18d9f249c4507af', 'request_id': 'req-496acc19-2474-483b-87fe-720d4cc63ad6'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.078859 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f675b96e3da94e33b18d9f249c4507af', 'request_id': 'req-496acc19-2474-483b-87fe-720d4cc63ad6'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.091724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f675b96e3da94e33b18d9f249c4507af', 'request_id': 'req-496acc19-2474-483b-87fe-720d4cc63ad6'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.106954 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] The token cache is being invalidate because project f675b96e3da94e33b18d9f249c4507af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:42.107232 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.107979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.109626 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1358/2702] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:41 2022] DELETE /identity/v3/projects/f675b96e3da94e33b18d9f249c4507af => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:42.113968 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88631a-26a8-442f-bd78-d11b2e5e9c8d admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:42.115552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cb88631a-26a8-442f-bd78-d11b2e5e9c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:42.130780 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88631a-26a8-442f-bd78-d11b2e5e9c8d admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:42.201628 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52efed-dce3-4a2a-a47e-c2c068a489bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:42.202981 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52efed-dce3-4a2a-a47e-c2c068a489bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:42.203473 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52efed-dce3-4a2a-a47e-c2c068a489bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:42.204072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52efed-dce3-4a2a-a47e-c2c068a489bf admin admin] PATH_INFO: `/v3/users/6e92fe0d06d54d72a550f6dab42c577b` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:42.205920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52efed-dce3-4a2a-a47e-c2c068a489bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e92fe0d06d54d72a550f6dab42c577b)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:42.211086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52efed-dce3-4a2a-a47e-c2c068a489bf admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:42.264749 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9c52efed-dce3-4a2a-a47e-c2c068a489bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e92fe0d06d54d72a550f6dab42c577b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.283725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9c52efed-dce3-4a2a-a47e-c2c068a489bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e92fe0d06d54d72a550f6dab42c577b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.291933 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9c52efed-dce3-4a2a-a47e-c2c068a489bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e92fe0d06d54d72a550f6dab42c577b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.292748 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9c52efed-dce3-4a2a-a47e-c2c068a489bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e92fe0d06d54d72a550f6dab42c577b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.293485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-9c52efed-dce3-4a2a-a47e-c2c068a489bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e92fe0d06d54d72a550f6dab42c577b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.308778 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1345/2703] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:42 2022] DELETE /identity/v3/users/6e92fe0d06d54d72a550f6dab42c577b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:42.605722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:42.607290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:42.621716 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496acc19-2474-483b-87fe-720d4cc63ad6 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:42.690206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:42.691137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:42.691420 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:42.691708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0 admin admin] PATH_INFO: `/v3/projects/a1fcddd7b1be4a1f9a1c069034ad56ec` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:42.692909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1fcddd7b1be4a1f9a1c069034ad56ec)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:42.695397 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:42.746773 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1fcddd7b1be4a1f9a1c069034ad56ec', 'request_id': 'req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.756188 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1fcddd7b1be4a1f9a1c069034ad56ec', 'request_id': 'req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.762811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1fcddd7b1be4a1f9a1c069034ad56ec', 'request_id': 'req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.773640 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0 admin admin] The token cache is being invalidate because project a1fcddd7b1be4a1f9a1c069034ad56ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:42.773925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.774612 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-cc32e1c9-f5fc-4786-9a77-6c98c6822aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:42.776253 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1359/2704] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:42 2022] DELETE /identity/v3/projects/a1fcddd7b1be4a1f9a1c069034ad56ec => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:42.784053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8d89a-0f1d-497f-9215-12563f4aa30c None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:42.784345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8d89a-0f1d-497f-9215-12563f4aa30c None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:42.784620 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8d89a-0f1d-497f-9215-12563f4aa30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:42.803763 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-99c8d89a-0f1d-497f-9215-12563f4aa30c None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:42.804999 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-99c8d89a-0f1d-497f-9215-12563f4aa30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:42.873286 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1346/2705] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:42.881322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6a647-2ce7-43ca-a481-a3ad15ae012b None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:42.881572 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6a647-2ce7-43ca-a481-a3ad15ae012b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:42.881880 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6a647-2ce7-43ca-a481-a3ad15ae012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:42.900770 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-ddb6a647-2ce7-43ca-a481-a3ad15ae012b None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:42.901962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ddb6a647-2ce7-43ca-a481-a3ad15ae012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:42.911884 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1360/2706] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:42.916271 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8d89a-0f1d-497f-9215-12563f4aa30c None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:42.922606 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:42.927061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8d89a-0f1d-497f-9215-12563f4aa30c None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:42.934202 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9327569-3c68-4321-b3c6-83ff6096d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:42.934905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9327569-3c68-4321-b3c6-83ff6096d036 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:42.935183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9327569-3c68-4321-b3c6-83ff6096d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:42.935454 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9327569-3c68-4321-b3c6-83ff6096d036 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:42.936199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9327569-3c68-4321-b3c6-83ff6096d036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:42.936514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9327569-3c68-4321-b3c6-83ff6096d036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:42.938630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9327569-3c68-4321-b3c6-83ff6096d036 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:42.953338 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1347/2707] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:55:42.959753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6a647-2ce7-43ca-a481-a3ad15ae012b None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:42.965792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:42.970429 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6a647-2ce7-43ca-a481-a3ad15ae012b None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:42.977831 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7106fca-90ca-48ce-b8ff-98b4c7a496a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:42.978723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7106fca-90ca-48ce-b8ff-98b4c7a496a9 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:42.979358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7106fca-90ca-48ce-b8ff-98b4c7a496a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:42.979644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7106fca-90ca-48ce-b8ff-98b4c7a496a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:42.980394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7106fca-90ca-48ce-b8ff-98b4c7a496a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:42.983198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7106fca-90ca-48ce-b8ff-98b4c7a496a9 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:43.016827 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1361/2708] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:42 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:43.021097 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9327569-3c68-4321-b3c6-83ff6096d036 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:43.031795 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9327569-3c68-4321-b3c6-83ff6096d036 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:43.092849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ba14d-e708-491e-a542-f79c3da773c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:43.093529 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba14d-e708-491e-a542-f79c3da773c2 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:43.093811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba14d-e708-491e-a542-f79c3da773c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:43.094537 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba14d-e708-491e-a542-f79c3da773c2 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:43.095299 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ba14d-e708-491e-a542-f79c3da773c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:43.097237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ba14d-e708-491e-a542-f79c3da773c2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:43.122793 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1348/2709] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:43 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:43.127857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7106fca-90ca-48ce-b8ff-98b4c7a496a9 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:43.139978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7106fca-90ca-48ce-b8ff-98b4c7a496a9 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:43.145534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9daf9-15ed-44a1-9ffd-ca6f398235a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:43.146206 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9daf9-15ed-44a1-9ffd-ca6f398235a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:43.146487 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9daf9-15ed-44a1-9ffd-ca6f398235a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:43.146789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9daf9-15ed-44a1-9ffd-ca6f398235a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:43.147534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9daf9-15ed-44a1-9ffd-ca6f398235a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:43.149155 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9daf9-15ed-44a1-9ffd-ca6f398235a8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:43.161757 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1362/2710] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:43.166757 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ba14d-e708-491e-a542-f79c3da773c2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:43.178123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ba14d-e708-491e-a542-f79c3da773c2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:43.183961 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33f9e1-2d9a-4aa1-b905-8101c621f3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:43.184715 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33f9e1-2d9a-4aa1-b905-8101c621f3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:43.185001 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33f9e1-2d9a-4aa1-b905-8101c621f3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:43.185447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33f9e1-2d9a-4aa1-b905-8101c621f3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:43.186318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33f9e1-2d9a-4aa1-b905-8101c621f3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:43.188186 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33f9e1-2d9a-4aa1-b905-8101c621f3d2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:43.200129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1349/2711] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:43.204819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9daf9-15ed-44a1-9ffd-ca6f398235a8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:43.215655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9daf9-15ed-44a1-9ffd-ca6f398235a8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:43.222491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64be837-8476-4781-b20c-c464f9a290dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:43.223433 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64be837-8476-4781-b20c-c464f9a290dd admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:43.223715 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64be837-8476-4781-b20c-c464f9a290dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:43.223990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64be837-8476-4781-b20c-c464f9a290dd admin admin] PATH_INFO: `/v3/projects/dc633b7c5e2d46398b45072916889108/users/7c62bca58a284f8caf62c4755bbf740f/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:43.243466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64be837-8476-4781-b20c-c464f9a290dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc633b7c5e2d46398b45072916889108, user_id=7c62bca58a284f8caf62c4755bbf740f, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:43.246158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64be837-8476-4781-b20c-c464f9a290dd admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:43.264736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1363/2712] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:43 2022] PUT /identity/v3/projects/dc633b7c5e2d46398b45072916889108/users/7c62bca58a284f8caf62c4755bbf740f/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:43.276457 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179f842-b59a-4533-8155-ea3ee6455ca1 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:43.276797 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179f842-b59a-4533-8155-ea3ee6455ca1 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:43.277075 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179f842-b59a-4533-8155-ea3ee6455ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:43.307400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-0179f842-b59a-4533-8155-ea3ee6455ca1 None None] MFA Rules not processed for user `7c62bca58a284f8caf62c4755bbf740f`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:43.308629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-0179f842-b59a-4533-8155-ea3ee6455ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:43.384358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1350/2713] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:43.396702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64be837-8476-4781-b20c-c464f9a290dd admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:43.398702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c64be837-8476-4781-b20c-c464f9a290dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:43.469704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64be837-8476-4781-b20c-c464f9a290dd admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:43.473940 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6e02d-0146-48c6-852a-64059569d475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:43.474660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e02d-0146-48c6-852a-64059569d475 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:43.474973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e02d-0146-48c6-852a-64059569d475 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:43.475231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e02d-0146-48c6-852a-64059569d475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:43.484652 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6e02d-0146-48c6-852a-64059569d475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:43.486915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6e02d-0146-48c6-852a-64059569d475 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:43.496491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1364/2714] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:43.542956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179f842-b59a-4533-8155-ea3ee6455ca1 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:43.545265 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-0179f842-b59a-4533-8155-ea3ee6455ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:43.616006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179f842-b59a-4533-8155-ea3ee6455ca1 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:43.620815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c36f3-13f3-48a5-960c-5ff374c4f2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:43.621718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c36f3-13f3-48a5-960c-5ff374c4f2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:43.622000 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c36f3-13f3-48a5-960c-5ff374c4f2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:43.622279 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c36f3-13f3-48a5-960c-5ff374c4f2e4 admin admin] PATH_INFO: `/v3/users/f51bf5ed2d1d4959987b64e48f36f1d0` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:43.623536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c36f3-13f3-48a5-960c-5ff374c4f2e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51bf5ed2d1d4959987b64e48f36f1d0)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:43.626214 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c36f3-13f3-48a5-960c-5ff374c4f2e4 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:43.628003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:43.680022 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-136c36f3-13f3-48a5-960c-5ff374c4f2e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51bf5ed2d1d4959987b64e48f36f1d0'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:43.692208 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-136c36f3-13f3-48a5-960c-5ff374c4f2e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51bf5ed2d1d4959987b64e48f36f1d0'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:43.700573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-136c36f3-13f3-48a5-960c-5ff374c4f2e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51bf5ed2d1d4959987b64e48f36f1d0'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:43.701633 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-136c36f3-13f3-48a5-960c-5ff374c4f2e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51bf5ed2d1d4959987b64e48f36f1d0'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:43.702309 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-136c36f3-13f3-48a5-960c-5ff374c4f2e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51bf5ed2d1d4959987b64e48f36f1d0'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:43.717438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1351/2715] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:43 2022] DELETE /identity/v3/users/f51bf5ed2d1d4959987b64e48f36f1d0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:43.722780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a1cbb-585a-4e62-a3b7-d14c7981c00d None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:43.723076 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a1cbb-585a-4e62-a3b7-d14c7981c00d None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:43.723358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a1cbb-585a-4e62-a3b7-d14c7981c00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:43.741742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6f7a1cbb-585a-4e62-a3b7-d14c7981c00d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:43.743096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6f7a1cbb-585a-4e62-a3b7-d14c7981c00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:43.813658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1365/2716] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:43.823910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c36f3-13f3-48a5-960c-5ff374c4f2e4 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:43.825654 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-136c36f3-13f3-48a5-960c-5ff374c4f2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:43.912314 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c36f3-13f3-48a5-960c-5ff374c4f2e4 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:43.916317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfcbdb-623a-419b-90ee-c1fc3168d547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:43.916910 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfcbdb-623a-419b-90ee-c1fc3168d547 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:43.917689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfcbdb-623a-419b-90ee-c1fc3168d547 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:43.917689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfcbdb-623a-419b-90ee-c1fc3168d547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:43.928410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfcbdb-623a-419b-90ee-c1fc3168d547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:43.929969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfcbdb-623a-419b-90ee-c1fc3168d547 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:43.941029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1352/2717] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:44.232794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a1cbb-585a-4e62-a3b7-d14c7981c00d None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:44.234273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6f7a1cbb-585a-4e62-a3b7-d14c7981c00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:44.247895 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a1cbb-585a-4e62-a3b7-d14c7981c00d None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:44.253701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:44.254789 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:44.255086 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:44.255450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] PATH_INFO: `/v3/projects/1ff52f32e0484ab299b2af50fb63d672` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:44.256713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff52f32e0484ab299b2af50fb63d672)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:44.258553 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:44.312106 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:44.315053 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff52f32e0484ab299b2af50fb63d672', 'request_id': 'req-1c806fe9-1bfa-4518-b0b3-918157606e72'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.325166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff52f32e0484ab299b2af50fb63d672', 'request_id': 'req-1c806fe9-1bfa-4518-b0b3-918157606e72'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.332659 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff52f32e0484ab299b2af50fb63d672', 'request_id': 'req-1c806fe9-1bfa-4518-b0b3-918157606e72'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.343495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] The token cache is being invalidate because project 1ff52f32e0484ab299b2af50fb63d672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:44.343817 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.344644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.346476 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1366/2718] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:44 2022] DELETE /identity/v3/projects/1ff52f32e0484ab299b2af50fb63d672 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:44.350450 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfcbdb-623a-419b-90ee-c1fc3168d547 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:44.360586 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfcbdb-623a-419b-90ee-c1fc3168d547 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:44.418882 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a7f53-b9ae-4627-a103-d7dcfa86346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:44.419705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a7f53-b9ae-4627-a103-d7dcfa86346d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:44.419983 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a7f53-b9ae-4627-a103-d7dcfa86346d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:44.420250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a7f53-b9ae-4627-a103-d7dcfa86346d admin admin] PATH_INFO: `/v3/users/31521f260c094411b6683eb5fcd313ba` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:44.421540 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a7f53-b9ae-4627-a103-d7dcfa86346d admin admin] RBAC: Authorizing `identity:delete_user(user_id=31521f260c094411b6683eb5fcd313ba)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:44.423829 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a7f53-b9ae-4627-a103-d7dcfa86346d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:44.448892 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:44.481897 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-932a7f53-b9ae-4627-a103-d7dcfa86346d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31521f260c094411b6683eb5fcd313ba'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.495429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-932a7f53-b9ae-4627-a103-d7dcfa86346d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31521f260c094411b6683eb5fcd313ba'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.503439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-932a7f53-b9ae-4627-a103-d7dcfa86346d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31521f260c094411b6683eb5fcd313ba'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.504159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-932a7f53-b9ae-4627-a103-d7dcfa86346d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31521f260c094411b6683eb5fcd313ba'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.504751 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-932a7f53-b9ae-4627-a103-d7dcfa86346d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31521f260c094411b6683eb5fcd313ba'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.521665 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1353/2719] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:44 2022] DELETE /identity/v3/users/31521f260c094411b6683eb5fcd313ba => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:44.814690 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:44.816172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:44.831419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c806fe9-1bfa-4518-b0b3-918157606e72 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:44.899466 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:44.900353 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:44.900637 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:44.900915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9 admin admin] PATH_INFO: `/v3/projects/e568c72b4b154cc1978f23e825bd40f5` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:44.902146 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e568c72b4b154cc1978f23e825bd40f5)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:44.904098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:44.965764 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e568c72b4b154cc1978f23e825bd40f5', 'request_id': 'req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.973958 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e568c72b4b154cc1978f23e825bd40f5', 'request_id': 'req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.980805 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e568c72b4b154cc1978f23e825bd40f5', 'request_id': 'req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.992541 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9 admin admin] The token cache is being invalidate because project e568c72b4b154cc1978f23e825bd40f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:44.994194 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.994194 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-c90e7d79-115a-4bc7-ba6f-8cfa1a5772c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:44.995801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1367/2720] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:44 2022] DELETE /identity/v3/projects/e568c72b4b154cc1978f23e825bd40f5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:45.001063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d9e85-19a7-4364-b6cb-1268675d4b59 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.001378 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d9e85-19a7-4364-b6cb-1268675d4b59 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.001664 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d9e85-19a7-4364-b6cb-1268675d4b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:45.029277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-d18d9e85-19a7-4364-b6cb-1268675d4b59 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:45.030636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d18d9e85-19a7-4364-b6cb-1268675d4b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:45.096435 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1354/2721] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:45.104625 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcf068-b546-498d-9027-eb630e892b54 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.105073 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcf068-b546-498d-9027-eb630e892b54 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.105304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcf068-b546-498d-9027-eb630e892b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:45.126465 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-bfbcf068-b546-498d-9027-eb630e892b54 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:45.127709 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-bfbcf068-b546-498d-9027-eb630e892b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:45.136321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1368/2722] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:45.140819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d9e85-19a7-4364-b6cb-1268675d4b59 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:45.150522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d9e85-19a7-4364-b6cb-1268675d4b59 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:45.155418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0a97c-580e-4a8b-8819-757a76e832af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:45.156110 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0a97c-580e-4a8b-8819-757a76e832af admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.156617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0a97c-580e-4a8b-8819-757a76e832af admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.156780 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0a97c-580e-4a8b-8819-757a76e832af admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:45.157798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0a97c-580e-4a8b-8819-757a76e832af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:45.158140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0a97c-580e-4a8b-8819-757a76e832af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:45.160123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0a97c-580e-4a8b-8819-757a76e832af admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:45.178368 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1355/2723] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:55:45.179570 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcf068-b546-498d-9027-eb630e892b54 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:45.189360 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcf068-b546-498d-9027-eb630e892b54 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:45.195295 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13090890-80c2-49cc-8763-4b58862392e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:45.196121 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13090890-80c2-49cc-8763-4b58862392e0 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.196829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13090890-80c2-49cc-8763-4b58862392e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.197160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13090890-80c2-49cc-8763-4b58862392e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:45.197929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13090890-80c2-49cc-8763-4b58862392e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:45.199996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13090890-80c2-49cc-8763-4b58862392e0 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:45.237829 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1369/2724] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:45 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:55:45.239018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0a97c-580e-4a8b-8819-757a76e832af admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:45.249881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0a97c-580e-4a8b-8819-757a76e832af admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:45.330456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe736a-cd92-450d-bef0-7cf3d3eb5713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:45.331377 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe736a-cd92-450d-bef0-7cf3d3eb5713 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.331659 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe736a-cd92-450d-bef0-7cf3d3eb5713 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.331929 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe736a-cd92-450d-bef0-7cf3d3eb5713 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:45.332629 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe736a-cd92-450d-bef0-7cf3d3eb5713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:45.334658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe736a-cd92-450d-bef0-7cf3d3eb5713 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:45.361104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1356/2725] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:45 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:45.363900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13090890-80c2-49cc-8763-4b58862392e0 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:45.385632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13090890-80c2-49cc-8763-4b58862392e0 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:45.390537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731695df-8ede-41a2-860d-32e58a769fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:45.391461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731695df-8ede-41a2-860d-32e58a769fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.391738 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731695df-8ede-41a2-860d-32e58a769fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.392015 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731695df-8ede-41a2-860d-32e58a769fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:45.392748 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731695df-8ede-41a2-860d-32e58a769fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:45.394347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731695df-8ede-41a2-860d-32e58a769fc9 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:45.405175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1370/2726] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:45.409802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe736a-cd92-450d-bef0-7cf3d3eb5713 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:45.420557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe736a-cd92-450d-bef0-7cf3d3eb5713 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:45.426268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427d0cd-b937-4001-8909-9a89aae15049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:45.426951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427d0cd-b937-4001-8909-9a89aae15049 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.427336 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427d0cd-b937-4001-8909-9a89aae15049 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.427668 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427d0cd-b937-4001-8909-9a89aae15049 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:45.428343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427d0cd-b937-4001-8909-9a89aae15049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:45.430029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427d0cd-b937-4001-8909-9a89aae15049 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:45.440725 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1357/2727] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:45.444858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731695df-8ede-41a2-860d-32e58a769fc9 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:45.458521 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731695df-8ede-41a2-860d-32e58a769fc9 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:45.463693 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78110a-318a-4613-a1c0-53d5cd3b34c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:45.464581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78110a-318a-4613-a1c0-53d5cd3b34c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.464862 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78110a-318a-4613-a1c0-53d5cd3b34c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.465137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78110a-318a-4613-a1c0-53d5cd3b34c4 admin admin] PATH_INFO: `/v3/projects/81deafb236674da19bc502ff088b6ef2/users/131dc891a8ef499399d1877eb40c932c/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:45.479979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78110a-318a-4613-a1c0-53d5cd3b34c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81deafb236674da19bc502ff088b6ef2, user_id=131dc891a8ef499399d1877eb40c932c, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:45.482874 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78110a-318a-4613-a1c0-53d5cd3b34c4 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:45.493461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:45.498706 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1371/2728] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:45 2022] PUT /identity/v3/projects/81deafb236674da19bc502ff088b6ef2/users/131dc891a8ef499399d1877eb40c932c/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:45.510272 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda1f1f-7f70-489f-80a7-db7653dbb76d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.510649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda1f1f-7f70-489f-80a7-db7653dbb76d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.511102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda1f1f-7f70-489f-80a7-db7653dbb76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:45.525956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:45.543500 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6cda1f1f-7f70-489f-80a7-db7653dbb76d None None] MFA Rules not processed for user `131dc891a8ef499399d1877eb40c932c`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:45.544846 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6cda1f1f-7f70-489f-80a7-db7653dbb76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:45.614255 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1358/2729] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:45.618988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78110a-318a-4613-a1c0-53d5cd3b34c4 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:45.682101 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78110a-318a-4613-a1c0-53d5cd3b34c4 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:45.686850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adfa10-e685-4485-b3d5-d519489c2f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:45.687642 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adfa10-e685-4485-b3d5-d519489c2f9a admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.687907 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adfa10-e685-4485-b3d5-d519489c2f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.688396 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adfa10-e685-4485-b3d5-d519489c2f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:45.689114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adfa10-e685-4485-b3d5-d519489c2f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:45.691077 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adfa10-e685-4485-b3d5-d519489c2f9a admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:45.722204 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1372/2730] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:45 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:45.726434 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda1f1f-7f70-489f-80a7-db7653dbb76d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:45.738807 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda1f1f-7f70-489f-80a7-db7653dbb76d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:45.804475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5c26d-ff14-45f4-9f47-175623ab67b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:45.805162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5c26d-ff14-45f4-9f47-175623ab67b6 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.805442 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5c26d-ff14-45f4-9f47-175623ab67b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.805703 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5c26d-ff14-45f4-9f47-175623ab67b6 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:45.806391 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5c26d-ff14-45f4-9f47-175623ab67b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:45.808354 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5c26d-ff14-45f4-9f47-175623ab67b6 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:45.836131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1359/2731] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:45 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:45.840706 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adfa10-e685-4485-b3d5-d519489c2f9a admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:45.852740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adfa10-e685-4485-b3d5-d519489c2f9a admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:45.859031 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ba7fd-6aea-44b0-81a8-0a5fcb6238a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:45.860273 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba7fd-6aea-44b0-81a8-0a5fcb6238a6 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.860565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba7fd-6aea-44b0-81a8-0a5fcb6238a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.860850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba7fd-6aea-44b0-81a8-0a5fcb6238a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:45.861596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ba7fd-6aea-44b0-81a8-0a5fcb6238a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:45.863297 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ba7fd-6aea-44b0-81a8-0a5fcb6238a6 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:45.875364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1373/2732] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:45.879557 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5c26d-ff14-45f4-9f47-175623ab67b6 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:45.890370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5c26d-ff14-45f4-9f47-175623ab67b6 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:45.895949 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea811ca-99cd-4279-8d02-f580f462a33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:45.896634 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea811ca-99cd-4279-8d02-f580f462a33a admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.896917 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea811ca-99cd-4279-8d02-f580f462a33a admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.897195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea811ca-99cd-4279-8d02-f580f462a33a admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:45.897928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea811ca-99cd-4279-8d02-f580f462a33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:45.899615 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea811ca-99cd-4279-8d02-f580f462a33a admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:45.911082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1360/2733] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:45.915391 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ba7fd-6aea-44b0-81a8-0a5fcb6238a6 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:45.927790 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ba7fd-6aea-44b0-81a8-0a5fcb6238a6 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:45.935441 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776de733-47c9-4dca-ad36-766280226b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:45.936645 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776de733-47c9-4dca-ad36-766280226b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.936949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776de733-47c9-4dca-ad36-766280226b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.937248 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776de733-47c9-4dca-ad36-766280226b7e admin admin] PATH_INFO: `/v3/projects/d4c0d69c5fd84d06a95fa3dfddf973cb/users/bc6b3f43fc0a4a21b2a3165b9e4d9640/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:45.955257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776de733-47c9-4dca-ad36-766280226b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c0d69c5fd84d06a95fa3dfddf973cb, user_id=bc6b3f43fc0a4a21b2a3165b9e4d9640, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:45.957956 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776de733-47c9-4dca-ad36-766280226b7e admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:45.973644 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1374/2734] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:45 2022] PUT /identity/v3/projects/d4c0d69c5fd84d06a95fa3dfddf973cb/users/bc6b3f43fc0a4a21b2a3165b9e4d9640/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:45.985432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15079e1-e67e-46b0-b12c-76f6248da03f None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:45.985707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15079e1-e67e-46b0-b12c-76f6248da03f None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:45.986010 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15079e1-e67e-46b0-b12c-76f6248da03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:46.016222 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-a15079e1-e67e-46b0-b12c-76f6248da03f None None] MFA Rules not processed for user `bc6b3f43fc0a4a21b2a3165b9e4d9640`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:46.017454 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-a15079e1-e67e-46b0-b12c-76f6248da03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:46.089570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1361/2735] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:46.094404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776de733-47c9-4dca-ad36-766280226b7e admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:46.166016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776de733-47c9-4dca-ad36-766280226b7e admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:46.172250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c350f8-c8dd-4668-9c83-4bb27e36797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:46.172919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c350f8-c8dd-4668-9c83-4bb27e36797f admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:46.173197 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c350f8-c8dd-4668-9c83-4bb27e36797f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:46.173473 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c350f8-c8dd-4668-9c83-4bb27e36797f admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:46.174158 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c350f8-c8dd-4668-9c83-4bb27e36797f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:46.176227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c350f8-c8dd-4668-9c83-4bb27e36797f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:46.206661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1375/2736] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:46 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:46.212051 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15079e1-e67e-46b0-b12c-76f6248da03f None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:46.219185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:46.224176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15079e1-e67e-46b0-b12c-76f6248da03f None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:46.283770 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98361c40-1062-4f78-a0bd-4bd9593f6b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:46.284471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98361c40-1062-4f78-a0bd-4bd9593f6b91 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:46.284739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98361c40-1062-4f78-a0bd-4bd9593f6b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:46.284990 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98361c40-1062-4f78-a0bd-4bd9593f6b91 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:46.285671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98361c40-1062-4f78-a0bd-4bd9593f6b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:46.287636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98361c40-1062-4f78-a0bd-4bd9593f6b91 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:46.309684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1362/2737] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:46 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:46.314433 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c350f8-c8dd-4668-9c83-4bb27e36797f admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:46.325594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c350f8-c8dd-4668-9c83-4bb27e36797f admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:46.330996 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1b963-eb47-4ff1-9c3d-70d35b9d21c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:46.331679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1b963-eb47-4ff1-9c3d-70d35b9d21c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:46.331978 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1b963-eb47-4ff1-9c3d-70d35b9d21c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:46.332250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1b963-eb47-4ff1-9c3d-70d35b9d21c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:46.332985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1b963-eb47-4ff1-9c3d-70d35b9d21c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:46.334742 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1b963-eb47-4ff1-9c3d-70d35b9d21c8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:46.347571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1376/2738] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:46.352102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98361c40-1062-4f78-a0bd-4bd9593f6b91 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:46.363400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98361c40-1062-4f78-a0bd-4bd9593f6b91 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:46.372605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5c759-cbf7-452a-9f33-073ee87fd804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:46.373542 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5c759-cbf7-452a-9f33-073ee87fd804 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:46.373846 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5c759-cbf7-452a-9f33-073ee87fd804 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:46.374145 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5c759-cbf7-452a-9f33-073ee87fd804 admin admin] PATH_INFO: `/v3/projects/ef06024fc967401bbc746b62263cf1cc/users/eac564748ac549d482ba56cdd760c885/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:46.391194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5c759-cbf7-452a-9f33-073ee87fd804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef06024fc967401bbc746b62263cf1cc, user_id=eac564748ac549d482ba56cdd760c885, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:46.393896 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5c759-cbf7-452a-9f33-073ee87fd804 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:46.410482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1363/2739] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:46 2022] PUT /identity/v3/projects/ef06024fc967401bbc746b62263cf1cc/users/eac564748ac549d482ba56cdd760c885/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:46.414796 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1b963-eb47-4ff1-9c3d-70d35b9d21c8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:46.426536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1b963-eb47-4ff1-9c3d-70d35b9d21c8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:46.457467 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:46.495451 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff987b19-9416-4dcd-ad79-bbe3c05f67ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:46.496125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff987b19-9416-4dcd-ad79-bbe3c05f67ce admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:46.496406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff987b19-9416-4dcd-ad79-bbe3c05f67ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:46.496681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff987b19-9416-4dcd-ad79-bbe3c05f67ce admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:46.497586 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff987b19-9416-4dcd-ad79-bbe3c05f67ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:46.499034 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff987b19-9416-4dcd-ad79-bbe3c05f67ce admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:46.513504 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1377/2740] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:46.514716 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5c759-cbf7-452a-9f33-073ee87fd804 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:46.526422 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5c759-cbf7-452a-9f33-073ee87fd804 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:46.533258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccb75b-504f-499a-9d71-47de9045c460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:46.534153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccb75b-504f-499a-9d71-47de9045c460 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:46.534445 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccb75b-504f-499a-9d71-47de9045c460 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:46.534717 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccb75b-504f-499a-9d71-47de9045c460 admin admin] PATH_INFO: `/v3/projects/ef06024fc967401bbc746b62263cf1cc/users/eac564748ac549d482ba56cdd760c885/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:46.536963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccb75b-504f-499a-9d71-47de9045c460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef06024fc967401bbc746b62263cf1cc, user_id=eac564748ac549d482ba56cdd760c885, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:46.539701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccb75b-504f-499a-9d71-47de9045c460 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:46.552027 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1364/2741] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:46 2022] PUT /identity/v3/projects/ef06024fc967401bbc746b62263cf1cc/users/eac564748ac549d482ba56cdd760c885/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:46.562746 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ae575-8ae1-4eea-9bc9-7efd440763f9 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:46.563071 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ae575-8ae1-4eea-9bc9-7efd440763f9 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:46.563509 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ae575-8ae1-4eea-9bc9-7efd440763f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:46.593962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-5f5ae575-8ae1-4eea-9bc9-7efd440763f9 None None] MFA Rules not processed for user `eac564748ac549d482ba56cdd760c885`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:46.595225 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5f5ae575-8ae1-4eea-9bc9-7efd440763f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:46.680571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1378/2742] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:46.690050 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccb75b-504f-499a-9d71-47de9045c460 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:46.692085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-0bccb75b-504f-499a-9d71-47de9045c460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:46.764217 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccb75b-504f-499a-9d71-47de9045c460 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:46.768175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd145106-14c2-4388-b4b7-64463461ede7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:46.768903 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd145106-14c2-4388-b4b7-64463461ede7 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:46.769116 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd145106-14c2-4388-b4b7-64463461ede7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:46.769532 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd145106-14c2-4388-b4b7-64463461ede7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:46.781721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd145106-14c2-4388-b4b7-64463461ede7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:46.783576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd145106-14c2-4388-b4b7-64463461ede7 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:46.793428 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1365/2743] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:47.310681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ae575-8ae1-4eea-9bc9-7efd440763f9 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:47.313196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5f5ae575-8ae1-4eea-9bc9-7efd440763f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:47.326601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ae575-8ae1-4eea-9bc9-7efd440763f9 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:47.331119 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62edbcd-16ab-4f10-a7b8-81d0767cd419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:47.331843 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62edbcd-16ab-4f10-a7b8-81d0767cd419 service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:47.332133 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62edbcd-16ab-4f10-a7b8-81d0767cd419 service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:47.332413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62edbcd-16ab-4f10-a7b8-81d0767cd419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:47.408804 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62edbcd-16ab-4f10-a7b8-81d0767cd419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:47.410263 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62edbcd-16ab-4f10-a7b8-81d0767cd419 service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:47.419479 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1379/2744] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:51.488613 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd145106-14c2-4388-b4b7-64463461ede7 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:51.500899 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd145106-14c2-4388-b4b7-64463461ede7 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:51.505765 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed446392-d977-4736-a456-dfb3781ce492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:51.506724 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed446392-d977-4736-a456-dfb3781ce492 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:51.507159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed446392-d977-4736-a456-dfb3781ce492 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:51.507488 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed446392-d977-4736-a456-dfb3781ce492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:51.572885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed446392-d977-4736-a456-dfb3781ce492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:51.574289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed446392-d977-4736-a456-dfb3781ce492 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:51.578189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:51.585951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1366/2745] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:53.569945 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62edbcd-16ab-4f10-a7b8-81d0767cd419 service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:53.572499 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a62edbcd-16ab-4f10-a7b8-81d0767cd419 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:53.622799 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:53.644980 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62edbcd-16ab-4f10-a7b8-81d0767cd419 service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:53.650005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851dcd4-4b8c-4d6e-ba36-8c468bdd1fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:53.651055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851dcd4-4b8c-4d6e-ba36-8c468bdd1fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:53.651315 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851dcd4-4b8c-4d6e-ba36-8c468bdd1fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:53.651608 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851dcd4-4b8c-4d6e-ba36-8c468bdd1fdf admin admin] PATH_INFO: `/v3/users/7c62bca58a284f8caf62c4755bbf740f` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:53.652961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851dcd4-4b8c-4d6e-ba36-8c468bdd1fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c62bca58a284f8caf62c4755bbf740f)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:53.655256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851dcd4-4b8c-4d6e-ba36-8c468bdd1fdf admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:53.710500 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4851dcd4-4b8c-4d6e-ba36-8c468bdd1fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c62bca58a284f8caf62c4755bbf740f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:53.723006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4851dcd4-4b8c-4d6e-ba36-8c468bdd1fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c62bca58a284f8caf62c4755bbf740f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:53.723713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4851dcd4-4b8c-4d6e-ba36-8c468bdd1fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c62bca58a284f8caf62c4755bbf740f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:53.730545 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4851dcd4-4b8c-4d6e-ba36-8c468bdd1fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c62bca58a284f8caf62c4755bbf740f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:53.731215 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-4851dcd4-4b8c-4d6e-ba36-8c468bdd1fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c62bca58a284f8caf62c4755bbf740f'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:53.736176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed446392-d977-4736-a456-dfb3781ce492 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:53.747062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1380/2746] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:53 2022] DELETE /identity/v3/users/7c62bca58a284f8caf62c4755bbf740f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:53.747558 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed446392-d977-4736-a456-dfb3781ce492 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:53.751337 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fc726-6519-49cf-92d4-0b335e51395d None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:53.751697 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fc726-6519-49cf-92d4-0b335e51395d None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:53.751967 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fc726-6519-49cf-92d4-0b335e51395d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:53.769454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-af0fc726-6519-49cf-92d4-0b335e51395d None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:53.770683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-af0fc726-6519-49cf-92d4-0b335e51395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:53.808068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e539ebe-ecea-4df1-9230-be7051ca7ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:53.808886 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e539ebe-ecea-4df1-9230-be7051ca7ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:53.809166 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e539ebe-ecea-4df1-9230-be7051ca7ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:53.809440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e539ebe-ecea-4df1-9230-be7051ca7ffc admin admin] PATH_INFO: `/v3/users/131dc891a8ef499399d1877eb40c932c` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:53.810639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e539ebe-ecea-4df1-9230-be7051ca7ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=131dc891a8ef499399d1877eb40c932c)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:53.812702 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e539ebe-ecea-4df1-9230-be7051ca7ffc admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:53.833423 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1381/2747] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:53.844282 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fc726-6519-49cf-92d4-0b335e51395d None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:53.845897 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-af0fc726-6519-49cf-92d4-0b335e51395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:53.862920 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3e539ebe-ecea-4df1-9230-be7051ca7ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131dc891a8ef499399d1877eb40c932c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:53.876215 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3e539ebe-ecea-4df1-9230-be7051ca7ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131dc891a8ef499399d1877eb40c932c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:53.884703 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3e539ebe-ecea-4df1-9230-be7051ca7ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131dc891a8ef499399d1877eb40c932c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:53.885429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3e539ebe-ecea-4df1-9230-be7051ca7ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131dc891a8ef499399d1877eb40c932c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:53.886026 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-3e539ebe-ecea-4df1-9230-be7051ca7ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131dc891a8ef499399d1877eb40c932c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:53.901519 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1367/2748] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:53 2022] DELETE /identity/v3/users/131dc891a8ef499399d1877eb40c932c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:55:53.905870 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301101c9-0357-49b4-b09d-72c021dfc823 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:53.906157 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301101c9-0357-49b4-b09d-72c021dfc823 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:53.906432 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301101c9-0357-49b4-b09d-72c021dfc823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:53.914175 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fc726-6519-49cf-92d4-0b335e51395d None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:53.923475 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-301101c9-0357-49b4-b09d-72c021dfc823 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:53.924676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-301101c9-0357-49b4-b09d-72c021dfc823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:53.930741 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:53.966932 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07292765-0f21-43a6-8ce7-b06b347e79a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:53.967757 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07292765-0f21-43a6-8ce7-b06b347e79a9 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:53.968038 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07292765-0f21-43a6-8ce7-b06b347e79a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:53.968310 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07292765-0f21-43a6-8ce7-b06b347e79a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:53.970174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-07292765-0f21-43a6-8ce7-b06b347e79a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:53.985140 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1368/2749] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:53.994991 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301101c9-0357-49b4-b09d-72c021dfc823 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:53.996446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-301101c9-0357-49b4-b09d-72c021dfc823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:54.008504 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301101c9-0357-49b4-b09d-72c021dfc823 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:54.012235 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37413122-688b-457c-bf13-f9fd4e3538e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:54.012883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37413122-688b-457c-bf13-f9fd4e3538e5 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:54.013167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37413122-688b-457c-bf13-f9fd4e3538e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:54.013447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37413122-688b-457c-bf13-f9fd4e3538e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:54.023459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37413122-688b-457c-bf13-f9fd4e3538e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:54.024951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37413122-688b-457c-bf13-f9fd4e3538e5 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:54.034582 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1369/2750] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:55:54.034998 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07292765-0f21-43a6-8ce7-b06b347e79a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:54.036482 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07292765-0f21-43a6-8ce7-b06b347e79a9 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:54.046298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1382/2751] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:54.115068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37413122-688b-457c-bf13-f9fd4e3538e5 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:54.117657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-37413122-688b-457c-bf13-f9fd4e3538e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:54.127386 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:54.132449 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37413122-688b-457c-bf13-f9fd4e3538e5 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:54.140499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f492729-f8cc-45a5-aa19-caf9079c5045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:54.141479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f492729-f8cc-45a5-aa19-caf9079c5045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:54.141820 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f492729-f8cc-45a5-aa19-caf9079c5045 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:54.142127 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f492729-f8cc-45a5-aa19-caf9079c5045 admin admin] PATH_INFO: `/v3/users/a18b9e77840c4d4cb18fc0b16c20b0a5` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:54.144221 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f492729-f8cc-45a5-aa19-caf9079c5045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18b9e77840c4d4cb18fc0b16c20b0a5)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:54.146370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f492729-f8cc-45a5-aa19-caf9079c5045 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:54.209878 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8f492729-f8cc-45a5-aa19-caf9079c5045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18b9e77840c4d4cb18fc0b16c20b0a5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.224082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8f492729-f8cc-45a5-aa19-caf9079c5045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18b9e77840c4d4cb18fc0b16c20b0a5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.232429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8f492729-f8cc-45a5-aa19-caf9079c5045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18b9e77840c4d4cb18fc0b16c20b0a5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.233244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8f492729-f8cc-45a5-aa19-caf9079c5045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18b9e77840c4d4cb18fc0b16c20b0a5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.234052 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-8f492729-f8cc-45a5-aa19-caf9079c5045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18b9e77840c4d4cb18fc0b16c20b0a5'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.251568 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1370/2752] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:54 2022] DELETE /identity/v3/users/a18b9e77840c4d4cb18fc0b16c20b0a5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:54.257762 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acd90e-877d-4a50-ae36-32f6d41672fc None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:54.258193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acd90e-877d-4a50-ae36-32f6d41672fc None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:54.258707 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acd90e-877d-4a50-ae36-32f6d41672fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:54.278411 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-85acd90e-877d-4a50-ae36-32f6d41672fc None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:54.279777 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-85acd90e-877d-4a50-ae36-32f6d41672fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:54.349169 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f492729-f8cc-45a5-aa19-caf9079c5045 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:54.350735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8f492729-f8cc-45a5-aa19-caf9079c5045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:54.370581 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1383/2753] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:54.389189 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acd90e-877d-4a50-ae36-32f6d41672fc None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:54.391257 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-85acd90e-877d-4a50-ae36-32f6d41672fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:54.437726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f492729-f8cc-45a5-aa19-caf9079c5045 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:54.449699 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:54.451047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:54.451813 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:54.452779 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] PATH_INFO: `/v3/projects/81deafb236674da19bc502ff088b6ef2` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:54.458358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acd90e-877d-4a50-ae36-32f6d41672fc None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:54.460530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81deafb236674da19bc502ff088b6ef2)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:54.462510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a4c26-5078-4f2a-a862-98a126a68696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:54.463162 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:54.463262 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4c26-5078-4f2a-a862-98a126a68696 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:54.463418 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4c26-5078-4f2a-a862-98a126a68696 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:54.463695 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4c26-5078-4f2a-a862-98a126a68696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:54.475823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a4c26-5078-4f2a-a862-98a126a68696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:54.477311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a4c26-5078-4f2a-a862-98a126a68696 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:54.489042 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1384/2754] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:55:54.519130 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81deafb236674da19bc502ff088b6ef2', 'request_id': 'req-ba173854-7921-4884-8d3a-091d1bdd5593'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.528192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81deafb236674da19bc502ff088b6ef2', 'request_id': 'req-ba173854-7921-4884-8d3a-091d1bdd5593'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.533738 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81deafb236674da19bc502ff088b6ef2', 'request_id': 'req-ba173854-7921-4884-8d3a-091d1bdd5593'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.545734 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] The token cache is being invalidate because project 81deafb236674da19bc502ff088b6ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:54.546622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.546899 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.548609 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1371/2755] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:54 2022] DELETE /identity/v3/projects/81deafb236674da19bc502ff088b6ef2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:54.553030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a4c26-5078-4f2a-a862-98a126a68696 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:54.563052 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a4c26-5078-4f2a-a862-98a126a68696 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:54.572873 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:54.632339 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bdb66-081b-42f2-af4c-42f5e67cc667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:54.633335 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bdb66-081b-42f2-af4c-42f5e67cc667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:54.633718 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bdb66-081b-42f2-af4c-42f5e67cc667 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:54.634096 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bdb66-081b-42f2-af4c-42f5e67cc667 admin admin] PATH_INFO: `/v3/users/bc6b3f43fc0a4a21b2a3165b9e4d9640` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:54.635725 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bdb66-081b-42f2-af4c-42f5e67cc667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc6b3f43fc0a4a21b2a3165b9e4d9640)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:54.637811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bdb66-081b-42f2-af4c-42f5e67cc667 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:54.643086 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:54.645388 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:54.659128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba173854-7921-4884-8d3a-091d1bdd5593 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:54.672875 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:54.674908 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:54.675053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:54.676137 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] PATH_INFO: `/v3/projects/dc633b7c5e2d46398b45072916889108` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:54.677777 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc633b7c5e2d46398b45072916889108)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:54.689538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:54.692237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:54.726657 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-256bdb66-081b-42f2-af4c-42f5e67cc667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc6b3f43fc0a4a21b2a3165b9e4d9640'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.749534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-256bdb66-081b-42f2-af4c-42f5e67cc667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc6b3f43fc0a4a21b2a3165b9e4d9640'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.751529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-256bdb66-081b-42f2-af4c-42f5e67cc667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc6b3f43fc0a4a21b2a3165b9e4d9640'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.759854 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc633b7c5e2d46398b45072916889108', 'request_id': 'req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.767763 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-256bdb66-081b-42f2-af4c-42f5e67cc667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc6b3f43fc0a4a21b2a3165b9e4d9640'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.768731 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-256bdb66-081b-42f2-af4c-42f5e67cc667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc6b3f43fc0a4a21b2a3165b9e4d9640'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.772788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc633b7c5e2d46398b45072916889108', 'request_id': 'req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.781625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc633b7c5e2d46398b45072916889108', 'request_id': 'req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.794184 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1385/2756] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:54 2022] DELETE /identity/v3/users/bc6b3f43fc0a4a21b2a3165b9e4d9640 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:54.808312 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] The token cache is being invalidate because project dc633b7c5e2d46398b45072916889108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:54.808608 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.809406 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:54.817863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1372/2757] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:54 2022] DELETE /identity/v3/projects/dc633b7c5e2d46398b45072916889108 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:54.819140 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cfa0a-97f6-4fd7-8600-6f319beaafe9 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:54.819624 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cfa0a-97f6-4fd7-8600-6f319beaafe9 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:54.820562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cfa0a-97f6-4fd7-8600-6f319beaafe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:54.843514 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-047cfa0a-97f6-4fd7-8600-6f319beaafe9 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:54.845118 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-047cfa0a-97f6-4fd7-8600-6f319beaafe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:54.909721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:54.911758 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:54.937671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1386/2758] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:54.946889 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd711c-52ed-4fc5-b798-dbf2356c3593 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:54.947211 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd711c-52ed-4fc5-b798-dbf2356c3593 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:54.947459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd711c-52ed-4fc5-b798-dbf2356c3593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:54.970126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-d5cd711c-52ed-4fc5-b798-dbf2356c3593 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:54.971792 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d5cd711c-52ed-4fc5-b798-dbf2356c3593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:54.982833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1387/2759] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:54.986823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd711c-52ed-4fc5-b798-dbf2356c3593 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:54.999218 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd711c-52ed-4fc5-b798-dbf2356c3593 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.020361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eebf1-346c-4a5a-b03e-8fb3ad92a1bb admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.020925 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20051a-ae82-4b90-b98a-224ce8a817fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.021636 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20051a-ae82-4b90-b98a-224ce8a817fd admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.021919 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20051a-ae82-4b90-b98a-224ce8a817fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.022196 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20051a-ae82-4b90-b98a-224ce8a817fd admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.023732 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20051a-ae82-4b90-b98a-224ce8a817fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:55.024048 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20051a-ae82-4b90-b98a-224ce8a817fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.025666 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20051a-ae82-4b90-b98a-224ce8a817fd admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.026251 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.027237 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.027523 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.028270 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f admin admin] PATH_INFO: `/v3/projects/b0d4093fc09643f9abb129cc1e2a2a68` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.029522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d4093fc09643f9abb129cc1e2a2a68)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.031494 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.041305 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1388/2760] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:55:55.045410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20051a-ae82-4b90-b98a-224ce8a817fd admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.056588 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20051a-ae82-4b90-b98a-224ce8a817fd admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.061678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d821d-ea09-4b13-baf7-a8e198e52517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.062660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d821d-ea09-4b13-baf7-a8e198e52517 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.063055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d821d-ea09-4b13-baf7-a8e198e52517 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.063372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d821d-ea09-4b13-baf7-a8e198e52517 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.064086 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d821d-ea09-4b13-baf7-a8e198e52517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.066322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d821d-ea09-4b13-baf7-a8e198e52517 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.079415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:55.096552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d4093fc09643f9abb129cc1e2a2a68', 'request_id': 'req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.103005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1389/2761] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:55 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:55:55.107164 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d821d-ea09-4b13-baf7-a8e198e52517 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.107994 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d4093fc09643f9abb129cc1e2a2a68', 'request_id': 'req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.117165 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d4093fc09643f9abb129cc1e2a2a68', 'request_id': 'req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.129888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f admin admin] The token cache is being invalidate because project b0d4093fc09643f9abb129cc1e2a2a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:55.130164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.130869 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-0d7532cd-b49e-48b4-b3ed-0c19eeaa137f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.132548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1373/2762] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:54 2022] DELETE /identity/v3/projects/b0d4093fc09643f9abb129cc1e2a2a68 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:55.137466 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128b022-66cd-4e38-b0d0-73e1cd4afbdf None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.137683 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128b022-66cd-4e38-b0d0-73e1cd4afbdf None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.137957 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128b022-66cd-4e38-b0d0-73e1cd4afbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.158209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-4128b022-66cd-4e38-b0d0-73e1cd4afbdf None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:55.159608 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-4128b022-66cd-4e38-b0d0-73e1cd4afbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:55.177373 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:55.196820 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d821d-ea09-4b13-baf7-a8e198e52517 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.202210 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abaa07-54ca-4093-8d7b-8d28dabbe25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.202917 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abaa07-54ca-4093-8d7b-8d28dabbe25f admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.203200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abaa07-54ca-4093-8d7b-8d28dabbe25f admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.203474 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abaa07-54ca-4093-8d7b-8d28dabbe25f admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.204191 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abaa07-54ca-4093-8d7b-8d28dabbe25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.206540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abaa07-54ca-4093-8d7b-8d28dabbe25f admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.230649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1390/2763] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:55 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:55:55.230649 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abaa07-54ca-4093-8d7b-8d28dabbe25f admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.232560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-78abaa07-54ca-4093-8d7b-8d28dabbe25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:55.232697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1374/2764] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:55.233383 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128b022-66cd-4e38-b0d0-73e1cd4afbdf None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.234834 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-4128b022-66cd-4e38-b0d0-73e1cd4afbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:55.244986 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abaa07-54ca-4093-8d7b-8d28dabbe25f admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.247404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128b022-66cd-4e38-b0d0-73e1cd4afbdf None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.249694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.250560 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.250877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.251154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] PATH_INFO: `/v3/projects/d4c0d69c5fd84d06a95fa3dfddf973cb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.252429 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ceb5e-cd1b-483b-9dc6-b4b4ef1a94af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.252562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4c0d69c5fd84d06a95fa3dfddf973cb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.253151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ceb5e-cd1b-483b-9dc6-b4b4ef1a94af admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.253428 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ceb5e-cd1b-483b-9dc6-b4b4ef1a94af admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.253704 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ceb5e-cd1b-483b-9dc6-b4b4ef1a94af admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.254392 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.254534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ceb5e-cd1b-483b-9dc6-b4b4ef1a94af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.256175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ceb5e-cd1b-483b-9dc6-b4b4ef1a94af admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.266805 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1375/2765] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:55.267668 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9c07-e0c6-45b9-a746-abd1adbaf29a None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.267952 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9c07-e0c6-45b9-a746-abd1adbaf29a None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.268238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9c07-e0c6-45b9-a746-abd1adbaf29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.286130 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-11dd9c07-e0c6-45b9-a746-abd1adbaf29a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:55.287366 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-11dd9c07-e0c6-45b9-a746-abd1adbaf29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:55.295612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1376/2766] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:55.296647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd9c07-e0c6-45b9-a746-abd1adbaf29a None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.303601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4c0d69c5fd84d06a95fa3dfddf973cb', 'request_id': 'req-9a09f627-1681-43f2-8504-1167075379b8'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.307196 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd9c07-e0c6-45b9-a746-abd1adbaf29a None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.312837 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4c0d69c5fd84d06a95fa3dfddf973cb', 'request_id': 'req-9a09f627-1681-43f2-8504-1167075379b8'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.323379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4c0d69c5fd84d06a95fa3dfddf973cb', 'request_id': 'req-9a09f627-1681-43f2-8504-1167075379b8'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.339711 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] The token cache is being invalidate because project d4c0d69c5fd84d06a95fa3dfddf973cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:55.340222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.341011 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.342717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1391/2767] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:55 2022] DELETE /identity/v3/projects/d4c0d69c5fd84d06a95fa3dfddf973cb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:55.346513 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.348278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:55.370417 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f13bb7-bb03-46b5-b8d4-752eea223689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.371128 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f13bb7-bb03-46b5-b8d4-752eea223689 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.371407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f13bb7-bb03-46b5-b8d4-752eea223689 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.371684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f13bb7-bb03-46b5-b8d4-752eea223689 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.372412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f13bb7-bb03-46b5-b8d4-752eea223689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.374023 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f13bb7-bb03-46b5-b8d4-752eea223689 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.387576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1377/2768] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:55.387576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f13bb7-bb03-46b5-b8d4-752eea223689 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.387576 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-f8f13bb7-bb03-46b5-b8d4-752eea223689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:55.399735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f13bb7-bb03-46b5-b8d4-752eea223689 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.404484 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e75089-9126-4af5-9e42-09fc28ef20cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.405360 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e75089-9126-4af5-9e42-09fc28ef20cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.405641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e75089-9126-4af5-9e42-09fc28ef20cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.405915 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e75089-9126-4af5-9e42-09fc28ef20cf admin admin] PATH_INFO: `/v3/users/eac564748ac549d482ba56cdd760c885` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.407238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e75089-9126-4af5-9e42-09fc28ef20cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac564748ac549d482ba56cdd760c885)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.409234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e75089-9126-4af5-9e42-09fc28ef20cf admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.416838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09f627-1681-43f2-8504-1167075379b8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.421933 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1835-7eda-4f23-98eb-13d27866ff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.422598 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1835-7eda-4f23-98eb-13d27866ff02 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.422912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1835-7eda-4f23-98eb-13d27866ff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.423240 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1835-7eda-4f23-98eb-13d27866ff02 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.423949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1835-7eda-4f23-98eb-13d27866ff02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:55.424289 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1835-7eda-4f23-98eb-13d27866ff02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.426691 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1835-7eda-4f23-98eb-13d27866ff02 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.432811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:55.440449 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1392/2769] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:55:55.442894 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1835-7eda-4f23-98eb-13d27866ff02 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.444876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-cf7c1835-7eda-4f23-98eb-13d27866ff02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:55.459564 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1835-7eda-4f23-98eb-13d27866ff02 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.464011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-57e75089-9126-4af5-9e42-09fc28ef20cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac564748ac549d482ba56cdd760c885'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.464540 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30f348-ba00-48db-9c46-f0b06b00b0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.465435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30f348-ba00-48db-9c46-f0b06b00b0d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.465718 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30f348-ba00-48db-9c46-f0b06b00b0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.465993 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30f348-ba00-48db-9c46-f0b06b00b0d0 admin admin] PATH_INFO: `/v3/projects/7cd83043daa64be78e992f28808aceb0/users/e95a9d89651045e289c85da2c9e8f56c/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.476354 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-57e75089-9126-4af5-9e42-09fc28ef20cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac564748ac549d482ba56cdd760c885'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.481648 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30f348-ba00-48db-9c46-f0b06b00b0d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd83043daa64be78e992f28808aceb0, user_id=e95a9d89651045e289c85da2c9e8f56c, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.483466 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-57e75089-9126-4af5-9e42-09fc28ef20cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac564748ac549d482ba56cdd760c885'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.484187 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-57e75089-9126-4af5-9e42-09fc28ef20cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac564748ac549d482ba56cdd760c885'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.484412 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30f348-ba00-48db-9c46-f0b06b00b0d0 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.484810 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-57e75089-9126-4af5-9e42-09fc28ef20cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac564748ac549d482ba56cdd760c885'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.499988 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1393/2770] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:55 2022] PUT /identity/v3/projects/7cd83043daa64be78e992f28808aceb0/users/e95a9d89651045e289c85da2c9e8f56c/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:55.500958 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30f348-ba00-48db-9c46-f0b06b00b0d0 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.501124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1378/2771] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:55:55 2022] DELETE /identity/v3/users/eac564748ac549d482ba56cdd760c885 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:55.502537 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6b30f348-ba00-48db-9c46-f0b06b00b0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:55.507953 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c69bc8-35ce-4859-9f12-e2a9d6ff0b74 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.508253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c69bc8-35ce-4859-9f12-e2a9d6ff0b74 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.508520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c69bc8-35ce-4859-9f12-e2a9d6ff0b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.526637 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-54c69bc8-35ce-4859-9f12-e2a9d6ff0b74 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:55.527877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-54c69bc8-35ce-4859-9f12-e2a9d6ff0b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:55.533783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:55.586981 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30f348-ba00-48db-9c46-f0b06b00b0d0 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.596548 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1379/2772] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:55.608408 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c69bc8-35ce-4859-9f12-e2a9d6ff0b74 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.610082 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-54c69bc8-35ce-4859-9f12-e2a9d6ff0b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:55.650364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcde5e-ac0a-4110-92fe-398736bcc989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.651085 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcde5e-ac0a-4110-92fe-398736bcc989 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.651405 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcde5e-ac0a-4110-92fe-398736bcc989 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.651702 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcde5e-ac0a-4110-92fe-398736bcc989 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.652603 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcde5e-ac0a-4110-92fe-398736bcc989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.656234 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcde5e-ac0a-4110-92fe-398736bcc989 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.686988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c69bc8-35ce-4859-9f12-e2a9d6ff0b74 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.691513 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18818c79-ec7d-4a09-bd7d-7ace851c59ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.692261 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18818c79-ec7d-4a09-bd7d-7ace851c59ff service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.692631 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18818c79-ec7d-4a09-bd7d-7ace851c59ff service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.693103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18818c79-ec7d-4a09-bd7d-7ace851c59ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.694808 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1394/2773] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:55 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:55.698153 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcde5e-ac0a-4110-92fe-398736bcc989 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.707701 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18818c79-ec7d-4a09-bd7d-7ace851c59ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.709175 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18818c79-ec7d-4a09-bd7d-7ace851c59ff service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.720153 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1380/2774] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:55.764247 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcde5e-ac0a-4110-92fe-398736bcc989 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.770167 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30010221-4022-46f1-942a-f4f84534dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.770842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30010221-4022-46f1-942a-f4f84534dd25 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.771154 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30010221-4022-46f1-942a-f4f84534dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.771435 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30010221-4022-46f1-942a-f4f84534dd25 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.772134 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30010221-4022-46f1-942a-f4f84534dd25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.774132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30010221-4022-46f1-942a-f4f84534dd25 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.784100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:55.799672 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1395/2775] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:55 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:55:55.800990 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18818c79-ec7d-4a09-bd7d-7ace851c59ff service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.812402 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18818c79-ec7d-4a09-bd7d-7ace851c59ff service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.817349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a2b5-d667-4b96-b9cb-ac6fd262efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.818072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a2b5-d667-4b96-b9cb-ac6fd262efcd admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.818361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a2b5-d667-4b96-b9cb-ac6fd262efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.818641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a2b5-d667-4b96-b9cb-ac6fd262efcd admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.819430 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49a2b5-d667-4b96-b9cb-ac6fd262efcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.821443 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49a2b5-d667-4b96-b9cb-ac6fd262efcd admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.835815 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1381/2776] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:55.837594 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30010221-4022-46f1-942a-f4f84534dd25 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.848739 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30010221-4022-46f1-942a-f4f84534dd25 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.855915 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15466439-d79f-4687-816a-94e2642ff871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.856757 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15466439-d79f-4687-816a-94e2642ff871 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.857047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15466439-d79f-4687-816a-94e2642ff871 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.857314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15466439-d79f-4687-816a-94e2642ff871 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.858060 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15466439-d79f-4687-816a-94e2642ff871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.859830 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15466439-d79f-4687-816a-94e2642ff871 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.873495 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1396/2777] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:55.873681 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a2b5-d667-4b96-b9cb-ac6fd262efcd admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.873681 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8a49a2b5-d667-4b96-b9cb-ac6fd262efcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:55.875320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15466439-d79f-4687-816a-94e2642ff871 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:55.894788 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a2b5-d667-4b96-b9cb-ac6fd262efcd admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.895906 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15466439-d79f-4687-816a-94e2642ff871 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:55.900689 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019be97-d7da-44cd-a4c5-d64d227619e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.901507 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019be97-d7da-44cd-a4c5-d64d227619e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.901646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9cc58-b3a5-484f-9508-dc4f1a249983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:55.901831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019be97-d7da-44cd-a4c5-d64d227619e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.902060 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019be97-d7da-44cd-a4c5-d64d227619e7 admin admin] PATH_INFO: `/v3/projects/ef06024fc967401bbc746b62263cf1cc` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.902562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9cc58-b3a5-484f-9508-dc4f1a249983 admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.902898 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9cc58-b3a5-484f-9508-dc4f1a249983 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.903179 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9cc58-b3a5-484f-9508-dc4f1a249983 admin admin] PATH_INFO: `/v3/projects/429c38c3845a464ab896463baed831f7/users/f6c9b5e3dbc342a2af6e6a24abc11a06/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.903769 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019be97-d7da-44cd-a4c5-d64d227619e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef06024fc967401bbc746b62263cf1cc)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.905850 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019be97-d7da-44cd-a4c5-d64d227619e7 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.920662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9cc58-b3a5-484f-9508-dc4f1a249983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=429c38c3845a464ab896463baed831f7, user_id=f6c9b5e3dbc342a2af6e6a24abc11a06, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:55.923436 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9cc58-b3a5-484f-9508-dc4f1a249983 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:55.940753 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1397/2778] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:55 2022] PUT /identity/v3/projects/429c38c3845a464ab896463baed831f7/users/f6c9b5e3dbc342a2af6e6a24abc11a06/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:55.952946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46aa6a-2f8d-44ec-80d3-982131edc88e None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:55.953302 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46aa6a-2f8d-44ec-80d3-982131edc88e None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:55.953927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46aa6a-2f8d-44ec-80d3-982131edc88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:55.982888 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-c019be97-d7da-44cd-a4c5-d64d227619e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef06024fc967401bbc746b62263cf1cc', 'request_id': 'req-c019be97-d7da-44cd-a4c5-d64d227619e7'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:55.988692 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6c46aa6a-2f8d-44ec-80d3-982131edc88e None None] MFA Rules not processed for user `f6c9b5e3dbc342a2af6e6a24abc11a06`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:55.990060 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6c46aa6a-2f8d-44ec-80d3-982131edc88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:55.993254 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-c019be97-d7da-44cd-a4c5-d64d227619e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef06024fc967401bbc746b62263cf1cc', 'request_id': 'req-c019be97-d7da-44cd-a4c5-d64d227619e7'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:56.001770 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-c019be97-d7da-44cd-a4c5-d64d227619e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef06024fc967401bbc746b62263cf1cc', 'request_id': 'req-c019be97-d7da-44cd-a4c5-d64d227619e7'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:56.017893 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-c019be97-d7da-44cd-a4c5-d64d227619e7 admin admin] The token cache is being invalidate because project ef06024fc967401bbc746b62263cf1cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:55:56.018357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-c019be97-d7da-44cd-a4c5-d64d227619e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:56.019354 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-c019be97-d7da-44cd-a4c5-d64d227619e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:55:56.021126 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1382/2779] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:55:55 2022] DELETE /identity/v3/projects/ef06024fc967401bbc746b62263cf1cc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:56.027084 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f3dff-fa25-422e-ab48-69ee12abd924 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.027598 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f3dff-fa25-422e-ab48-69ee12abd924 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.028059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f3dff-fa25-422e-ab48-69ee12abd924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.048300 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-c51f3dff-fa25-422e-ab48-69ee12abd924 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:56.049553 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-c51f3dff-fa25-422e-ab48-69ee12abd924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:56.062863 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1398/2780] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:56.063856 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46aa6a-2f8d-44ec-80d3-982131edc88e None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.065639 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6c46aa6a-2f8d-44ec-80d3-982131edc88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:56.077047 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:56.124885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1383/2781] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:56.133178 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b667a73-a947-4494-bf37-438c0beb836a None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.133469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b667a73-a947-4494-bf37-438c0beb836a None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.133765 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b667a73-a947-4494-bf37-438c0beb836a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.153694 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-8b667a73-a947-4494-bf37-438c0beb836a None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:56.154970 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8b667a73-a947-4494-bf37-438c0beb836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:56.161087 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46aa6a-2f8d-44ec-80d3-982131edc88e None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.167120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaabc9-9c14-46d0-863c-14fdaaacbbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.167934 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaabc9-9c14-46d0-863c-14fdaaacbbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.168245 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaabc9-9c14-46d0-863c-14fdaaacbbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.168530 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaabc9-9c14-46d0-863c-14fdaaacbbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.168647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1384/2782] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:55:56.169242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaabc9-9c14-46d0-863c-14fdaaacbbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.169440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b667a73-a947-4494-bf37-438c0beb836a None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.171474 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaabc9-9c14-46d0-863c-14fdaaacbbf1 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:56.180152 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b667a73-a947-4494-bf37-438c0beb836a None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.186988 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6af59a-ba31-407d-b3cb-cbe124234248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.187860 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af59a-ba31-407d-b3cb-cbe124234248 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.188192 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af59a-ba31-407d-b3cb-cbe124234248 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.189033 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af59a-ba31-407d-b3cb-cbe124234248 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.190031 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6af59a-ba31-407d-b3cb-cbe124234248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:55:56.190712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6af59a-ba31-407d-b3cb-cbe124234248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.192421 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6af59a-ba31-407d-b3cb-cbe124234248 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:56.203135 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1399/2783] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:56 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:56.207579 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaabc9-9c14-46d0-863c-14fdaaacbbf1 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.210029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1385/2784] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:55:56.214447 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6af59a-ba31-407d-b3cb-cbe124234248 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.226306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6af59a-ba31-407d-b3cb-cbe124234248 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.256428 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:56.283671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaabc9-9c14-46d0-863c-14fdaaacbbf1 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.288908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7290695-7a66-44d3-8e42-f5d08e6accfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.289717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7290695-7a66-44d3-8e42-f5d08e6accfd admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.290125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7290695-7a66-44d3-8e42-f5d08e6accfd admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.290408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7290695-7a66-44d3-8e42-f5d08e6accfd admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.290618 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ceb8e-db84-4a8e-ac8c-3b3a26add10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.291534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7290695-7a66-44d3-8e42-f5d08e6accfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.291667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ceb8e-db84-4a8e-ac8c-3b3a26add10f admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.291667 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ceb8e-db84-4a8e-ac8c-3b3a26add10f admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.291943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ceb8e-db84-4a8e-ac8c-3b3a26add10f admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.292641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ceb8e-db84-4a8e-ac8c-3b3a26add10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.293137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7290695-7a66-44d3-8e42-f5d08e6accfd admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:56.294546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ceb8e-db84-4a8e-ac8c-3b3a26add10f admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:56.316110 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1400/2785] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:56 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:56.320231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7290695-7a66-44d3-8e42-f5d08e6accfd admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.327072 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1386/2786] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:56 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:55:56.331259 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ceb8e-db84-4a8e-ac8c-3b3a26add10f admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.331446 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7290695-7a66-44d3-8e42-f5d08e6accfd admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.399747 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9aac6-6afa-4782-9430-20bb36590cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.400551 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9aac6-6afa-4782-9430-20bb36590cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.401322 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9aac6-6afa-4782-9430-20bb36590cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.401615 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9aac6-6afa-4782-9430-20bb36590cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.402406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9aac6-6afa-4782-9430-20bb36590cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.402802 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ceb8e-db84-4a8e-ac8c-3b3a26add10f admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.404399 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9aac6-6afa-4782-9430-20bb36590cf8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:56.407588 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab21c5f-36a1-4df8-aec6-833302caa062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.408284 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21c5f-36a1-4df8-aec6-833302caa062 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.408635 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21c5f-36a1-4df8-aec6-833302caa062 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.409003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21c5f-36a1-4df8-aec6-833302caa062 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.409823 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab21c5f-36a1-4df8-aec6-833302caa062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.412307 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab21c5f-36a1-4df8-aec6-833302caa062 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:56.416736 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1401/2787] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:55:56.420648 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9aac6-6afa-4782-9430-20bb36590cf8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.437479 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9aac6-6afa-4782-9430-20bb36590cf8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.442014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1387/2788] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:56 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:55:56.443801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ace3ff-3704-448b-bc28-4962f7dbe52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.444483 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ace3ff-3704-448b-bc28-4962f7dbe52c admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.444765 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ace3ff-3704-448b-bc28-4962f7dbe52c admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.445156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ace3ff-3704-448b-bc28-4962f7dbe52c admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.446244 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ace3ff-3704-448b-bc28-4962f7dbe52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.446729 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab21c5f-36a1-4df8-aec6-833302caa062 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.447886 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ace3ff-3704-448b-bc28-4962f7dbe52c admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:56.462622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1402/2789] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:56.463542 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ace3ff-3704-448b-bc28-4962f7dbe52c admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.464063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab21c5f-36a1-4df8-aec6-833302caa062 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.469102 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c355f-a278-48d7-a80c-0ca6333736c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.469951 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c355f-a278-48d7-a80c-0ca6333736c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.470357 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c355f-a278-48d7-a80c-0ca6333736c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.470684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c355f-a278-48d7-a80c-0ca6333736c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.471552 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c355f-a278-48d7-a80c-0ca6333736c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.473744 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c355f-a278-48d7-a80c-0ca6333736c6 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:56.474256 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ace3ff-3704-448b-bc28-4962f7dbe52c admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.479347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252dd65-0e01-45af-bc29-32c20ebe97fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.480250 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252dd65-0e01-45af-bc29-32c20ebe97fe admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.481393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252dd65-0e01-45af-bc29-32c20ebe97fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.481393 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252dd65-0e01-45af-bc29-32c20ebe97fe admin admin] PATH_INFO: `/v3/projects/4ed12304796f456fbe996c3001533745/users/bc5ac7a9962542b9b1cebb4bd1122e92/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.498844 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1388/2790] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:56.500290 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c355f-a278-48d7-a80c-0ca6333736c6 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.501419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252dd65-0e01-45af-bc29-32c20ebe97fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed12304796f456fbe996c3001533745, user_id=bc5ac7a9962542b9b1cebb4bd1122e92, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.509801 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252dd65-0e01-45af-bc29-32c20ebe97fe admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:56.514705 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c355f-a278-48d7-a80c-0ca6333736c6 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.523103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d128ead-f767-4c56-a894-542d45ae288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.524129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d128ead-f767-4c56-a894-542d45ae288e admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.524671 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d128ead-f767-4c56-a894-542d45ae288e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.524947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d128ead-f767-4c56-a894-542d45ae288e admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.526229 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d128ead-f767-4c56-a894-542d45ae288e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.528002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d128ead-f767-4c56-a894-542d45ae288e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:56.534463 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:56.547364 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1403/2791] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:56 2022] PUT /identity/v3/projects/4ed12304796f456fbe996c3001533745/users/bc5ac7a9962542b9b1cebb4bd1122e92/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:56.548709 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1389/2792] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:56.559722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b9400-d2a2-4407-9d8b-e6c89ba5c111 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.560058 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b9400-d2a2-4407-9d8b-e6c89ba5c111 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.560279 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b9400-d2a2-4407-9d8b-e6c89ba5c111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.560719 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d128ead-f767-4c56-a894-542d45ae288e admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.581989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d128ead-f767-4c56-a894-542d45ae288e admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.592038 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-ea1b9400-d2a2-4407-9d8b-e6c89ba5c111 None None] MFA Rules not processed for user `bc5ac7a9962542b9b1cebb4bd1122e92`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:56.593270 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ea1b9400-d2a2-4407-9d8b-e6c89ba5c111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:56.682655 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c593b-9014-41c4-b53d-e5f83385d729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.683779 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c593b-9014-41c4-b53d-e5f83385d729 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.684193 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c593b-9014-41c4-b53d-e5f83385d729 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.684617 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c593b-9014-41c4-b53d-e5f83385d729 admin admin] PATH_INFO: `/v3/projects/866c3e6045174e869792ed3968d38308/users/3be87358ab094774a680a81a1062c579/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.691627 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1404/2793] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:56.696377 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b9400-d2a2-4407-9d8b-e6c89ba5c111 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.704406 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c593b-9014-41c4-b53d-e5f83385d729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866c3e6045174e869792ed3968d38308, user_id=3be87358ab094774a680a81a1062c579, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.708324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b9400-d2a2-4407-9d8b-e6c89ba5c111 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.708814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c593b-9014-41c4-b53d-e5f83385d729 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:56.714701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e8c0d-b63b-4636-9291-b255361270f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.715520 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e8c0d-b63b-4636-9291-b255361270f3 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.715846 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e8c0d-b63b-4636-9291-b255361270f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.716125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e8c0d-b63b-4636-9291-b255361270f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.716922 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e8c0d-b63b-4636-9291-b255361270f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.719266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e8c0d-b63b-4636-9291-b255361270f3 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:56.733229 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1390/2794] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:56 2022] PUT /identity/v3/projects/866c3e6045174e869792ed3968d38308/users/3be87358ab094774a680a81a1062c579/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:56.747345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06dfcb-f7a9-4587-8def-77e24709722a None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.747825 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06dfcb-f7a9-4587-8def-77e24709722a None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.748206 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06dfcb-f7a9-4587-8def-77e24709722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.748582 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:56.772573 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1405/2795] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:55:56 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:56.773492 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e8c0d-b63b-4636-9291-b255361270f3 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.788103 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6b06dfcb-f7a9-4587-8def-77e24709722a None None] MFA Rules not processed for user `3be87358ab094774a680a81a1062c579`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:56.789976 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6b06dfcb-f7a9-4587-8def-77e24709722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:56.859730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e8c0d-b63b-4636-9291-b255361270f3 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.866173 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07d798-b016-4677-8dda-f12709b645f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.867203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07d798-b016-4677-8dda-f12709b645f8 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.868174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07d798-b016-4677-8dda-f12709b645f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.868701 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07d798-b016-4677-8dda-f12709b645f8 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.869733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07d798-b016-4677-8dda-f12709b645f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.872432 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07d798-b016-4677-8dda-f12709b645f8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:56.883053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1391/2796] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:56.897485 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06dfcb-f7a9-4587-8def-77e24709722a None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.899669 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6b06dfcb-f7a9-4587-8def-77e24709722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:56.907683 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1406/2797] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:55:56 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:55:56.913794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07d798-b016-4677-8dda-f12709b645f8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.926454 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07d798-b016-4677-8dda-f12709b645f8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.931876 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fcf50-9eff-4a11-8fb4-08d257082d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.932661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fcf50-9eff-4a11-8fb4-08d257082d85 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.933162 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fcf50-9eff-4a11-8fb4-08d257082d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.933515 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fcf50-9eff-4a11-8fb4-08d257082d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.934505 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fcf50-9eff-4a11-8fb4-08d257082d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.936358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fcf50-9eff-4a11-8fb4-08d257082d85 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:56.954955 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1407/2798] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:56.958529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fcf50-9eff-4a11-8fb4-08d257082d85 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:56.970139 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fcf50-9eff-4a11-8fb4-08d257082d85 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.975606 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847f9f3-be6f-4fb1-aac5-fce9c7b9950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.976507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f9f3-be6f-4fb1-aac5-fce9c7b9950d admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.976877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f9f3-be6f-4fb1-aac5-fce9c7b9950d admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.977159 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f9f3-be6f-4fb1-aac5-fce9c7b9950d admin admin] PATH_INFO: `/v3/projects/720354f6a0cf48c0975977a4278374f6/users/fa43c7f5997a4977949b5528e7ae1525/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.982053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06dfcb-f7a9-4587-8def-77e24709722a None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:56.987993 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c84d5-2163-4840-baf4-f2c0cafbe588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:56.989004 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c84d5-2163-4840-baf4-f2c0cafbe588 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:56.989520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c84d5-2163-4840-baf4-f2c0cafbe588 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:56.989986 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c84d5-2163-4840-baf4-f2c0cafbe588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:56.994127 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847f9f3-be6f-4fb1-aac5-fce9c7b9950d admin admin] RBAC: Authorizing `identity:create_grant(project_id=720354f6a0cf48c0975977a4278374f6, user_id=fa43c7f5997a4977949b5528e7ae1525, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:56.997015 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847f9f3-be6f-4fb1-aac5-fce9c7b9950d admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:57.005129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c84d5-2163-4840-baf4-f2c0cafbe588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:57.007150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c84d5-2163-4840-baf4-f2c0cafbe588 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:57.016547 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1408/2799] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:56 2022] PUT /identity/v3/projects/720354f6a0cf48c0975977a4278374f6/users/fa43c7f5997a4977949b5528e7ae1525/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:57.019331 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847f9f3-be6f-4fb1-aac5-fce9c7b9950d admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:57.034427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1392/2800] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:55:57.119577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847f9f3-be6f-4fb1-aac5-fce9c7b9950d admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:57.127116 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592486d4-df94-4d65-841d-96426ab94e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:57.127866 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592486d4-df94-4d65-841d-96426ab94e90 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:57.128313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592486d4-df94-4d65-841d-96426ab94e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:57.128869 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592486d4-df94-4d65-841d-96426ab94e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:57.130367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592486d4-df94-4d65-841d-96426ab94e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:57.132953 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592486d4-df94-4d65-841d-96426ab94e90 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:57.148601 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1409/2801] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:55:57.152743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c84d5-2163-4840-baf4-f2c0cafbe588 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:57.166150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c84d5-2163-4840-baf4-f2c0cafbe588 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:57.179275 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac30ac1-7b79-421a-a1ff-f0f7195719f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:57.180245 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac30ac1-7b79-421a-a1ff-f0f7195719f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:57.180536 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac30ac1-7b79-421a-a1ff-f0f7195719f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:57.181006 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac30ac1-7b79-421a-a1ff-f0f7195719f5 admin admin] PATH_INFO: `/v3/projects/720354f6a0cf48c0975977a4278374f6/users/fa43c7f5997a4977949b5528e7ae1525/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:57.184067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac30ac1-7b79-421a-a1ff-f0f7195719f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=720354f6a0cf48c0975977a4278374f6, user_id=fa43c7f5997a4977949b5528e7ae1525, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:57.186021 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac30ac1-7b79-421a-a1ff-f0f7195719f5 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:57.200811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1393/2802] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:55:57 2022] PUT /identity/v3/projects/720354f6a0cf48c0975977a4278374f6/users/fa43c7f5997a4977949b5528e7ae1525/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:55:57.277159 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524d21-cfcc-4efe-a742-0c5e88b7abfb None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:57.277442 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524d21-cfcc-4efe-a742-0c5e88b7abfb None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:57.277744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524d21-cfcc-4efe-a742-0c5e88b7abfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:57.311086 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-cb524d21-cfcc-4efe-a742-0c5e88b7abfb None None] MFA Rules not processed for user `fa43c7f5997a4977949b5528e7ae1525`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:55:57.312823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-cb524d21-cfcc-4efe-a742-0c5e88b7abfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:55:57.361938 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:57.438664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1410/2803] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:55:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:55:57.456266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac30ac1-7b79-421a-a1ff-f0f7195719f5 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:57.467210 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:55:57.554129 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac30ac1-7b79-421a-a1ff-f0f7195719f5 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:57.558161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cdacc-7a33-4458-9300-28dff266a351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:57.559150 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cdacc-7a33-4458-9300-28dff266a351 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:57.559646 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cdacc-7a33-4458-9300-28dff266a351 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:57.560143 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cdacc-7a33-4458-9300-28dff266a351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:57.637167 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cdacc-7a33-4458-9300-28dff266a351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:57.638849 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cdacc-7a33-4458-9300-28dff266a351 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:57.648564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1394/2804] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:55:59.360414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb524d21-cfcc-4efe-a742-0c5e88b7abfb None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:55:59.371300 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb524d21-cfcc-4efe-a742-0c5e88b7abfb None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:55:59.375338 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ffc47-2eee-4b46-ba25-36078ecc580b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:55:59.375999 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ffc47-2eee-4b46-ba25-36078ecc580b service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:55:59.376290 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ffc47-2eee-4b46-ba25-36078ecc580b service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:55:59.376571 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ffc47-2eee-4b46-ba25-36078ecc580b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:55:59.449153 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ffc47-2eee-4b46-ba25-36078ecc580b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:55:59.450625 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ffc47-2eee-4b46-ba25-36078ecc580b service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:55:59.464966 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1411/2805] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:55:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:56:00.240367 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d7b2c-fec5-417a-86e4-92f7c928c61a None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:00.240867 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d7b2c-fec5-417a-86e4-92f7c928c61a None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:00.241164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d7b2c-fec5-417a-86e4-92f7c928c61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:00.272908 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ffc47-2eee-4b46-ba25-36078ecc580b service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:00.283131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-835d7b2c-fec5-417a-86e4-92f7c928c61a None None] MFA Rules not processed for user `e95a9d89651045e289c85da2c9e8f56c`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:00.284446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-835d7b2c-fec5-417a-86e4-92f7c928c61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:00.286061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ffc47-2eee-4b46-ba25-36078ecc580b service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:00.290149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb15b1-fb18-4335-ae6d-649b51f3376e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:00.290993 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb15b1-fb18-4335-ae6d-649b51f3376e service cinder] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:00.291285 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb15b1-fb18-4335-ae6d-649b51f3376e service cinder] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:00.291567 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb15b1-fb18-4335-ae6d-649b51f3376e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:00.304877 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb15b1-fb18-4335-ae6d-649b51f3376e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:00.306510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb15b1-fb18-4335-ae6d-649b51f3376e service cinder] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:00.331372 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1412/2806] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:56:00.385280 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1395/2807] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:00.389943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb15b1-fb18-4335-ae6d-649b51f3376e service cinder] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:00.392421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-c1bb15b1-fb18-4335-ae6d-649b51f3376e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:00.505160 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb15b1-fb18-4335-ae6d-649b51f3376e service cinder] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:00.520944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd512036-8cd0-4d1a-8033-177ac4ca18ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:00.520944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd512036-8cd0-4d1a-8033-177ac4ca18ce admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:00.520944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd512036-8cd0-4d1a-8033-177ac4ca18ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:00.520944 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd512036-8cd0-4d1a-8033-177ac4ca18ce admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:00.521536 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd512036-8cd0-4d1a-8033-177ac4ca18ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:00.522727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd512036-8cd0-4d1a-8033-177ac4ca18ce admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:00.560100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1413/2808] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:56:00 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:56:00.565185 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d7b2c-fec5-417a-86e4-92f7c928c61a None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:00.594510 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d7b2c-fec5-417a-86e4-92f7c928c61a None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:00.686362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:00.694989 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d01de2-6a07-4af4-90fe-a5489a0e2d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:00.695687 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d01de2-6a07-4af4-90fe-a5489a0e2d1e admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:00.695969 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d01de2-6a07-4af4-90fe-a5489a0e2d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:00.697074 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d01de2-6a07-4af4-90fe-a5489a0e2d1e admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:00.697786 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d01de2-6a07-4af4-90fe-a5489a0e2d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:00.700842 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d01de2-6a07-4af4-90fe-a5489a0e2d1e admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:00.733437 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1396/2809] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:56:00 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:56:00.737181 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd512036-8cd0-4d1a-8033-177ac4ca18ce admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:00.749222 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd512036-8cd0-4d1a-8033-177ac4ca18ce admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:00.755243 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a15c09-6701-41bb-98c5-6e8097d8b34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:00.755937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a15c09-6701-41bb-98c5-6e8097d8b34a admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:00.756224 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a15c09-6701-41bb-98c5-6e8097d8b34a admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:00.756506 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a15c09-6701-41bb-98c5-6e8097d8b34a admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:00.757264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a15c09-6701-41bb-98c5-6e8097d8b34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:00.765343 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a15c09-6701-41bb-98c5-6e8097d8b34a admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:00.788156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1414/2810] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:56:00.792764 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d01de2-6a07-4af4-90fe-a5489a0e2d1e admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:00.806670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d01de2-6a07-4af4-90fe-a5489a0e2d1e admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:00.812522 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a4ee8-0067-473a-9553-d134573b6b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:00.814346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a4ee8-0067-473a-9553-d134573b6b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:00.814831 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a4ee8-0067-473a-9553-d134573b6b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:00.815264 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a4ee8-0067-473a-9553-d134573b6b4d admin admin] PATH_INFO: `/v3/projects/ef27f50e24d44317bbe5b44f12e6e04c/users/72fc0ce7d7ef4ae084f5d75c498902ce/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:00.838417 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a4ee8-0067-473a-9553-d134573b6b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef27f50e24d44317bbe5b44f12e6e04c, user_id=72fc0ce7d7ef4ae084f5d75c498902ce, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:00.841252 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a4ee8-0067-473a-9553-d134573b6b4d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:00.864002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1397/2811] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:56:00 2022] PUT /identity/v3/projects/ef27f50e24d44317bbe5b44f12e6e04c/users/72fc0ce7d7ef4ae084f5d75c498902ce/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 03:56:00.868480 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a15c09-6701-41bb-98c5-6e8097d8b34a admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:00.883556 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a15c09-6701-41bb-98c5-6e8097d8b34a admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:00.920987 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:00.969023 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f20d7-5baa-43b3-aed2-19430e20a8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:00.969708 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f20d7-5baa-43b3-aed2-19430e20a8aa admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:00.969990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f20d7-5baa-43b3-aed2-19430e20a8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:00.970275 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f20d7-5baa-43b3-aed2-19430e20a8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:00.971109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f20d7-5baa-43b3-aed2-19430e20a8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:00.973543 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f20d7-5baa-43b3-aed2-19430e20a8aa admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:00.985853 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1415/2812] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:56:00.991440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a4ee8-0067-473a-9553-d134573b6b4d admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:01.005459 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a4ee8-0067-473a-9553-d134573b6b4d admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:01.010453 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc7d0c-66ea-4321-8a92-9cde6085872d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:01.011400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc7d0c-66ea-4321-8a92-9cde6085872d admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:01.011711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc7d0c-66ea-4321-8a92-9cde6085872d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:01.011968 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc7d0c-66ea-4321-8a92-9cde6085872d admin admin] PATH_INFO: `/v3/projects/ef27f50e24d44317bbe5b44f12e6e04c/users/72fc0ce7d7ef4ae084f5d75c498902ce/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:01.014130 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc7d0c-66ea-4321-8a92-9cde6085872d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef27f50e24d44317bbe5b44f12e6e04c, user_id=72fc0ce7d7ef4ae084f5d75c498902ce, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:01.016789 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc7d0c-66ea-4321-8a92-9cde6085872d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:01.036653 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1398/2813] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:56:00 2022] PUT /identity/v3/projects/ef27f50e24d44317bbe5b44f12e6e04c/users/72fc0ce7d7ef4ae084f5d75c498902ce/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:03.120151 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f20d7-5baa-43b3-aed2-19430e20a8aa admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:03.132304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f20d7-5baa-43b3-aed2-19430e20a8aa admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:03.211394 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166a487-fc0d-4729-8eae-a2d8621e6cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:03.212463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166a487-fc0d-4729-8eae-a2d8621e6cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:03.212848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166a487-fc0d-4729-8eae-a2d8621e6cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:03.213508 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166a487-fc0d-4729-8eae-a2d8621e6cb8 admin admin] PATH_INFO: `/v3/users/3be87358ab094774a680a81a1062c579` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:03.214961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166a487-fc0d-4729-8eae-a2d8621e6cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be87358ab094774a680a81a1062c579)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:03.217313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166a487-fc0d-4729-8eae-a2d8621e6cb8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:03.341557 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9166a487-fc0d-4729-8eae-a2d8621e6cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be87358ab094774a680a81a1062c579'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:03.367519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9166a487-fc0d-4729-8eae-a2d8621e6cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be87358ab094774a680a81a1062c579'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:03.368552 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9166a487-fc0d-4729-8eae-a2d8621e6cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be87358ab094774a680a81a1062c579'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:03.376847 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9166a487-fc0d-4729-8eae-a2d8621e6cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be87358ab094774a680a81a1062c579'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:03.377927 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-9166a487-fc0d-4729-8eae-a2d8621e6cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be87358ab094774a680a81a1062c579'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:03.424788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1416/2814] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:56:03 2022] DELETE /identity/v3/users/3be87358ab094774a680a81a1062c579 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:03.430238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c1f63-1396-4b5b-84e9-a2cfff47e747 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:03.430912 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c1f63-1396-4b5b-84e9-a2cfff47e747 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:03.430912 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c1f63-1396-4b5b-84e9-a2cfff47e747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:03.468881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-8a3c1f63-1396-4b5b-84e9-a2cfff47e747 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:03.474107 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8a3c1f63-1396-4b5b-84e9-a2cfff47e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:03.572539 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1399/2815] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:03.584445 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166a487-fc0d-4729-8eae-a2d8621e6cb8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:03.586244 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9166a487-fc0d-4729-8eae-a2d8621e6cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:03.658200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:03.684890 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166a487-fc0d-4729-8eae-a2d8621e6cb8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:03.688902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96fc02-0f44-4d5e-804c-0c4c36618aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:03.689687 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96fc02-0f44-4d5e-804c-0c4c36618aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:03.690062 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96fc02-0f44-4d5e-804c-0c4c36618aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:03.690430 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96fc02-0f44-4d5e-804c-0c4c36618aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:03.704179 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96fc02-0f44-4d5e-804c-0c4c36618aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:03.706347 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96fc02-0f44-4d5e-804c-0c4c36618aa2 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:03.718316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1417/2816] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:56:04.361855 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c1f63-1396-4b5b-84e9-a2cfff47e747 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:04.363515 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8a3c1f63-1396-4b5b-84e9-a2cfff47e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:04.392331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c1f63-1396-4b5b-84e9-a2cfff47e747 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:04.407180 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:04.408266 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:04.408643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:04.409025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] PATH_INFO: `/v3/projects/866c3e6045174e869792ed3968d38308` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:04.411231 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=866c3e6045174e869792ed3968d38308)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:04.413727 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:04.498973 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866c3e6045174e869792ed3968d38308', 'request_id': 'req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:04.514071 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866c3e6045174e869792ed3968d38308', 'request_id': 'req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:04.528234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866c3e6045174e869792ed3968d38308', 'request_id': 'req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:04.551743 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] The token cache is being invalidate because project 866c3e6045174e869792ed3968d38308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:56:04.552198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:04.553085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:04.555661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1400/2817] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:56:04 2022] DELETE /identity/v3/projects/866c3e6045174e869792ed3968d38308 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:04.560911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d007-032d-4efd-b1e3-48560fd24a3b None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:04.560911 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d007-032d-4efd-b1e3-48560fd24a3b None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:04.561491 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d007-032d-4efd-b1e3-48560fd24a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:04.609669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-fc01d007-032d-4efd-b1e3-48560fd24a3b None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:04.611620 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-fc01d007-032d-4efd-b1e3-48560fd24a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:04.635123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:04.638182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:04.723438 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:04.803669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1418/2818] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:04.812142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c4cf2-de25-4b9b-bcb4-ca1151960f48 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:04.812818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c4cf2-de25-4b9b-bcb4-ca1151960f48 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:04.813304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c4cf2-de25-4b9b-bcb4-ca1151960f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:04.814964 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9fc29-9b64-4ffa-8f52-233b32cad5ed admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:04.820242 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0d968-9c71-47b4-ae96-b5cdfde028ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:04.821155 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0d968-9c71-47b4-ae96-b5cdfde028ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:04.821434 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0d968-9c71-47b4-ae96-b5cdfde028ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:04.821707 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0d968-9c71-47b4-ae96-b5cdfde028ee admin admin] PATH_INFO: `/v3/users/f6c9b5e3dbc342a2af6e6a24abc11a06` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:04.823322 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0d968-9c71-47b4-ae96-b5cdfde028ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c9b5e3dbc342a2af6e6a24abc11a06)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:04.825296 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0d968-9c71-47b4-ae96-b5cdfde028ee admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:04.874912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-2e6c4cf2-de25-4b9b-bcb4-ca1151960f48 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:04.876266 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2e6c4cf2-de25-4b9b-bcb4-ca1151960f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:04.893180 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1419/2819] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:56:04.898805 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c4cf2-de25-4b9b-bcb4-ca1151960f48 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:04.922259 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c4cf2-de25-4b9b-bcb4-ca1151960f48 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:04.936283 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-45a0d968-9c71-47b4-ae96-b5cdfde028ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c9b5e3dbc342a2af6e6a24abc11a06'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:04.940535 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c6b09-d18f-48ed-bdce-288e7733a1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:04.941258 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c6b09-d18f-48ed-bdce-288e7733a1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:04.941631 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c6b09-d18f-48ed-bdce-288e7733a1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:04.941916 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c6b09-d18f-48ed-bdce-288e7733a1f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:04.942664 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c6b09-d18f-48ed-bdce-288e7733a1f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:56:04.943000 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c6b09-d18f-48ed-bdce-288e7733a1f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:04.944629 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c6b09-d18f-48ed-bdce-288e7733a1f1 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:04.977170 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-45a0d968-9c71-47b4-ae96-b5cdfde028ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c9b5e3dbc342a2af6e6a24abc11a06'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:04.990082 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1420/2820] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:56:04.991114 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c6b09-d18f-48ed-bdce-288e7733a1f1 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:05.009431 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-45a0d968-9c71-47b4-ae96-b5cdfde028ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c9b5e3dbc342a2af6e6a24abc11a06'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:05.012839 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-45a0d968-9c71-47b4-ae96-b5cdfde028ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c9b5e3dbc342a2af6e6a24abc11a06'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:05.016015 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-45a0d968-9c71-47b4-ae96-b5cdfde028ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c9b5e3dbc342a2af6e6a24abc11a06'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:05.023654 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c6b09-d18f-48ed-bdce-288e7733a1f1 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:05.048406 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd8a1c-e78d-43e5-85fa-ff78285d75b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:05.049086 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd8a1c-e78d-43e5-85fa-ff78285d75b0 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:05.049367 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd8a1c-e78d-43e5-85fa-ff78285d75b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:05.049650 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd8a1c-e78d-43e5-85fa-ff78285d75b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:05.050357 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd8a1c-e78d-43e5-85fa-ff78285d75b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:05.051358 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1401/2821] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:56:04 2022] DELETE /identity/v3/users/f6c9b5e3dbc342a2af6e6a24abc11a06 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:05.056053 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff87876-ebec-4c9f-96ac-494fe2358a20 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:05.056349 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff87876-ebec-4c9f-96ac-494fe2358a20 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:05.056645 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff87876-ebec-4c9f-96ac-494fe2358a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:05.056777 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd8a1c-e78d-43e5-85fa-ff78285d75b0 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:05.088194 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-1ff87876-ebec-4c9f-96ac-494fe2358a20 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:05.094205 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-1ff87876-ebec-4c9f-96ac-494fe2358a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:05.113016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1421/2822] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:56:04 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:56:05.118045 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd8a1c-e78d-43e5-85fa-ff78285d75b0 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:05.121043 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-41bd8a1c-e78d-43e5-85fa-ff78285d75b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:05.293742 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1402/2823] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:05.305946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd8a1c-e78d-43e5-85fa-ff78285d75b0 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:05.308203 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff87876-ebec-4c9f-96ac-494fe2358a20 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:05.309627 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-1ff87876-ebec-4c9f-96ac-494fe2358a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:05.314383 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef063b4b-0647-430b-bf9f-defd47d0b904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:05.315247 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063b4b-0647-430b-bf9f-defd47d0b904 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:05.315534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063b4b-0647-430b-bf9f-defd47d0b904 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:05.315813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063b4b-0647-430b-bf9f-defd47d0b904 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:05.316926 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef063b4b-0647-430b-bf9f-defd47d0b904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:05.324717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef063b4b-0647-430b-bf9f-defd47d0b904 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:05.386839 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1422/2824] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:56:05 2022] POST /identity/v3/users => generated 285 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:56:05.390261 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef063b4b-0647-430b-bf9f-defd47d0b904 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:05.411077 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:05.413685 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef063b4b-0647-430b-bf9f-defd47d0b904 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:05.423166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ca7ed-a0b4-4692-b9ae-a0eca3bbe949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:05.423963 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ca7ed-a0b4-4692-b9ae-a0eca3bbe949 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:05.424320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ca7ed-a0b4-4692-b9ae-a0eca3bbe949 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:05.424668 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ca7ed-a0b4-4692-b9ae-a0eca3bbe949 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:05.427294 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ca7ed-a0b4-4692-b9ae-a0eca3bbe949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:05.429468 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ca7ed-a0b4-4692-b9ae-a0eca3bbe949 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:05.439883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff87876-ebec-4c9f-96ac-494fe2358a20 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:05.446943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1423/2825] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:56:05.451450 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ca7ed-a0b4-4692-b9ae-a0eca3bbe949 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:05.483047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ca7ed-a0b4-4692-b9ae-a0eca3bbe949 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:05.497072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee4f28-9f26-4062-affa-95792eadc8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:05.498562 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee4f28-9f26-4062-affa-95792eadc8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:05.498679 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee4f28-9f26-4062-affa-95792eadc8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:05.500103 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee4f28-9f26-4062-affa-95792eadc8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:05.502274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee4f28-9f26-4062-affa-95792eadc8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:05.507658 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee4f28-9f26-4062-affa-95792eadc8f7 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:05.543169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1424/2826] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:56:05.544697 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee4f28-9f26-4062-affa-95792eadc8f7 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:05.563483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae24cb-7f1f-4662-91ba-a48517ea2748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:05.564151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae24cb-7f1f-4662-91ba-a48517ea2748 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:05.564605 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae24cb-7f1f-4662-91ba-a48517ea2748 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:05.565131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae24cb-7f1f-4662-91ba-a48517ea2748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:05.565371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee4f28-9f26-4062-affa-95792eadc8f7 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:05.582660 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae24cb-7f1f-4662-91ba-a48517ea2748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:05.586527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d003ac-a019-4570-8229-4aa7d99ee2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:05.587531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d003ac-a019-4570-8229-4aa7d99ee2be admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:05.587811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d003ac-a019-4570-8229-4aa7d99ee2be admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:05.588130 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d003ac-a019-4570-8229-4aa7d99ee2be admin admin] PATH_INFO: `/v3/projects/05272927384f4e62ac08c838e518930d/users/492e778c5e8845a6a245c134e06c3ab3/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:05.588539 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae24cb-7f1f-4662-91ba-a48517ea2748 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:05.607446 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1403/2827] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:56:05.615132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:05.630813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d003ac-a019-4570-8229-4aa7d99ee2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=05272927384f4e62ac08c838e518930d, user_id=492e778c5e8845a6a245c134e06c3ab3, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:05.634195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d003ac-a019-4570-8229-4aa7d99ee2be admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:05.690923 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1425/2828] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:56:05 2022] PUT /identity/v3/projects/05272927384f4e62ac08c838e518930d/users/492e778c5e8845a6a245c134e06c3ab3/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:05.739614 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6755ca9-e1e2-4464-8063-0fb718624e27 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:05.740146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6755ca9-e1e2-4464-8063-0fb718624e27 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:05.740574 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6755ca9-e1e2-4464-8063-0fb718624e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:05.794164 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-d6755ca9-e1e2-4464-8063-0fb718624e27 None None] MFA Rules not processed for user `492e778c5e8845a6a245c134e06c3ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:05.795517 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d6755ca9-e1e2-4464-8063-0fb718624e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:05.935782 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1404/2829] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:05.948973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d003ac-a019-4570-8229-4aa7d99ee2be admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:05.951408 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-71d003ac-a019-4570-8229-4aa7d99ee2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:06.045254 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d003ac-a019-4570-8229-4aa7d99ee2be admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:06.052743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70694ed6-7cfa-4768-b490-b6ea09aaa5d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450fda3236cc4d1ba3189b6b66f65686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:06.053458 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70694ed6-7cfa-4768-b490-b6ea09aaa5d9 service glance] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:06.053744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70694ed6-7cfa-4768-b490-b6ea09aaa5d9 service glance] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:06.054022 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70694ed6-7cfa-4768-b490-b6ea09aaa5d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:06.064942 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70694ed6-7cfa-4768-b490-b6ea09aaa5d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:06.066421 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70694ed6-7cfa-4768-b490-b6ea09aaa5d9 service glance] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:06.084242 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1426/2830] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:56:06.100319 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6755ca9-e1e2-4464-8063-0fb718624e27 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:06.102137 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d6755ca9-e1e2-4464-8063-0fb718624e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:06.204343 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6755ca9-e1e2-4464-8063-0fb718624e27 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:06.209798 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a00147-f469-45b0-8ff3-09151e06eb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:06.210698 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00147-f469-45b0-8ff3-09151e06eb43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:06.211190 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00147-f469-45b0-8ff3-09151e06eb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:06.211464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00147-f469-45b0-8ff3-09151e06eb43 admin admin] PATH_INFO: `/v3/projects/429c38c3845a464ab896463baed831f7` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:06.212770 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a00147-f469-45b0-8ff3-09151e06eb43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=429c38c3845a464ab896463baed831f7)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:06.214712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a00147-f469-45b0-8ff3-09151e06eb43 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:06.272678 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:06.311641 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-36a00147-f469-45b0-8ff3-09151e06eb43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '429c38c3845a464ab896463baed831f7', 'request_id': 'req-36a00147-f469-45b0-8ff3-09151e06eb43'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:06.327002 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-36a00147-f469-45b0-8ff3-09151e06eb43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '429c38c3845a464ab896463baed831f7', 'request_id': 'req-36a00147-f469-45b0-8ff3-09151e06eb43'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:06.335639 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-36a00147-f469-45b0-8ff3-09151e06eb43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '429c38c3845a464ab896463baed831f7', 'request_id': 'req-36a00147-f469-45b0-8ff3-09151e06eb43'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:06.353624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-36a00147-f469-45b0-8ff3-09151e06eb43 admin admin] The token cache is being invalidate because project 429c38c3845a464ab896463baed831f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:56:06.353624 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-36a00147-f469-45b0-8ff3-09151e06eb43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:06.354527 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-36a00147-f469-45b0-8ff3-09151e06eb43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:06.357326 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1405/2831] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:56:06 2022] DELETE /identity/v3/projects/429c38c3845a464ab896463baed831f7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:06.361355 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70694ed6-7cfa-4768-b490-b6ea09aaa5d9 service glance] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:06.392046 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70694ed6-7cfa-4768-b490-b6ea09aaa5d9 service glance] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:06.520730 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a8ce5-4d4b-4683-a639-65d10644bce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:06.521565 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a8ce5-4d4b-4683-a639-65d10644bce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:06.521936 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a8ce5-4d4b-4683-a639-65d10644bce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:06.522278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a8ce5-4d4b-4683-a639-65d10644bce3 admin admin] PATH_INFO: `/v3/users/bc5ac7a9962542b9b1cebb4bd1122e92` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:06.523722 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a8ce5-4d4b-4683-a639-65d10644bce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5ac7a9962542b9b1cebb4bd1122e92)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:06.527010 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a8ce5-4d4b-4683-a639-65d10644bce3 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:06.614636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4ba39-4c20-4008-8c63-115155e13b50 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:06.615643 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4ba39-4c20-4008-8c63-115155e13b50 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:06.616085 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4ba39-4c20-4008-8c63-115155e13b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:06.684482 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-cde4ba39-4c20-4008-8c63-115155e13b50 None None] MFA Rules not processed for user `72fc0ce7d7ef4ae084f5d75c498902ce`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:06.686496 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cde4ba39-4c20-4008-8c63-115155e13b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:06.692758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-ee4a8ce5-4d4b-4683-a639-65d10644bce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5ac7a9962542b9b1cebb4bd1122e92'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:06.728231 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-ee4a8ce5-4d4b-4683-a639-65d10644bce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5ac7a9962542b9b1cebb4bd1122e92'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:06.729577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-ee4a8ce5-4d4b-4683-a639-65d10644bce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5ac7a9962542b9b1cebb4bd1122e92'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:06.742976 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-ee4a8ce5-4d4b-4683-a639-65d10644bce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5ac7a9962542b9b1cebb4bd1122e92'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:06.744006 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-ee4a8ce5-4d4b-4683-a639-65d10644bce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5ac7a9962542b9b1cebb4bd1122e92'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:06.774867 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1427/2832] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:56:06 2022] DELETE /identity/v3/users/bc5ac7a9962542b9b1cebb4bd1122e92 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:06.789291 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1406/2833] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:56:06.806957 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a8ce5-4d4b-4683-a639-65d10644bce3 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:06.808704 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-ee4a8ce5-4d4b-4683-a639-65d10644bce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:06.826413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:06.962228 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a8ce5-4d4b-4683-a639-65d10644bce3 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:06.967990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b8a9f-396f-45d1-9d55-e08521e8e70b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:06.969143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8a9f-396f-45d1-9d55-e08521e8e70b service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:06.969143 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8a9f-396f-45d1-9d55-e08521e8e70b service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:06.969358 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8a9f-396f-45d1-9d55-e08521e8e70b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:06.971261 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-5d6b8a9f-396f-45d1-9d55-e08521e8e70b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:07.074821 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b8a9f-396f-45d1-9d55-e08521e8e70b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:07.076724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b8a9f-396f-45d1-9d55-e08521e8e70b service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:07.089128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1428/2834] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:56:07.219883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4ba39-4c20-4008-8c63-115155e13b50 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:07.221948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-cde4ba39-4c20-4008-8c63-115155e13b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:07.258189 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4ba39-4c20-4008-8c63-115155e13b50 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:07.398182 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:07.400308 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:07.400905 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:07.402011 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] PATH_INFO: `/v3/projects/4ed12304796f456fbe996c3001533745` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:07.403970 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ed12304796f456fbe996c3001533745)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:07.406884 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:07.469444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:07.471439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed12304796f456fbe996c3001533745', 'request_id': 'req-d596d11d-36fd-4997-bbe7-2c45bbff18d6'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:07.488928 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed12304796f456fbe996c3001533745', 'request_id': 'req-d596d11d-36fd-4997-bbe7-2c45bbff18d6'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:07.503381 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed12304796f456fbe996c3001533745', 'request_id': 'req-d596d11d-36fd-4997-bbe7-2c45bbff18d6'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:07.518464 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] The token cache is being invalidate because project 4ed12304796f456fbe996c3001533745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:56:07.518773 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:07.519534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:07.521400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1407/2835] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:56:07 2022] DELETE /identity/v3/projects/4ed12304796f456fbe996c3001533745 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:07.525545 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b8a9f-396f-45d1-9d55-e08521e8e70b service nova] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:07.536952 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b8a9f-396f-45d1-9d55-e08521e8e70b service nova] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:07.607341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d7e58-108b-402d-8c0a-9a24f6e74a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:07.608472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d7e58-108b-402d-8c0a-9a24f6e74a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:07.608851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d7e58-108b-402d-8c0a-9a24f6e74a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:07.609187 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d7e58-108b-402d-8c0a-9a24f6e74a68 admin admin] PATH_INFO: `/v3/users/fa43c7f5997a4977949b5528e7ae1525` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:07.610459 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d7e58-108b-402d-8c0a-9a24f6e74a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa43c7f5997a4977949b5528e7ae1525)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:07.615427 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d7e58-108b-402d-8c0a-9a24f6e74a68 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:07.669545 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6c3d7e58-108b-402d-8c0a-9a24f6e74a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa43c7f5997a4977949b5528e7ae1525'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:07.672324 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:07.685371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6c3d7e58-108b-402d-8c0a-9a24f6e74a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa43c7f5997a4977949b5528e7ae1525'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:07.686109 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6c3d7e58-108b-402d-8c0a-9a24f6e74a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa43c7f5997a4977949b5528e7ae1525'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:07.695320 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6c3d7e58-108b-402d-8c0a-9a24f6e74a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa43c7f5997a4977949b5528e7ae1525'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:07.696913 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-6c3d7e58-108b-402d-8c0a-9a24f6e74a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa43c7f5997a4977949b5528e7ae1525'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:07.712820 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1429/2836] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:56:07 2022] DELETE /identity/v3/users/fa43c7f5997a4977949b5528e7ae1525 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:08.065104 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:08.067064 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:08.108974 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596d11d-36fd-4997-bbe7-2c45bbff18d6 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:08.186333 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793770f-f1af-48b5-a29c-5ddb23f98480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:08.187361 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793770f-f1af-48b5-a29c-5ddb23f98480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:08.187863 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793770f-f1af-48b5-a29c-5ddb23f98480 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:08.188415 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793770f-f1af-48b5-a29c-5ddb23f98480 admin admin] PATH_INFO: `/v3/projects/720354f6a0cf48c0975977a4278374f6` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:08.189645 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793770f-f1af-48b5-a29c-5ddb23f98480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=720354f6a0cf48c0975977a4278374f6)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:08.191642 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793770f-f1af-48b5-a29c-5ddb23f98480 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:08.253759 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4793770f-f1af-48b5-a29c-5ddb23f98480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '720354f6a0cf48c0975977a4278374f6', 'request_id': 'req-4793770f-f1af-48b5-a29c-5ddb23f98480'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:08.263238 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4793770f-f1af-48b5-a29c-5ddb23f98480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '720354f6a0cf48c0975977a4278374f6', 'request_id': 'req-4793770f-f1af-48b5-a29c-5ddb23f98480'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:08.269885 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4793770f-f1af-48b5-a29c-5ddb23f98480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '720354f6a0cf48c0975977a4278374f6', 'request_id': 'req-4793770f-f1af-48b5-a29c-5ddb23f98480'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:08.282209 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4793770f-f1af-48b5-a29c-5ddb23f98480 admin admin] The token cache is being invalidate because project 720354f6a0cf48c0975977a4278374f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:56:08.282504 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4793770f-f1af-48b5-a29c-5ddb23f98480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:08.283199 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-4793770f-f1af-48b5-a29c-5ddb23f98480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:08.285025 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1408/2837] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:56:08 2022] DELETE /identity/v3/projects/720354f6a0cf48c0975977a4278374f6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:08.290653 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8dea7-a5a1-408e-bc58-61a3b59a2159 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:08.291064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8dea7-a5a1-408e-bc58-61a3b59a2159 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:08.291535 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8dea7-a5a1-408e-bc58-61a3b59a2159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:08.312169 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-74a8dea7-a5a1-408e-bc58-61a3b59a2159 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:08.313488 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-74a8dea7-a5a1-408e-bc58-61a3b59a2159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:08.335520 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5675e7-2a52-40d9-b1c3-1f4c2205114e None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:08.335804 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5675e7-2a52-40d9-b1c3-1f4c2205114e None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:08.336079 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5675e7-2a52-40d9-b1c3-1f4c2205114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:08.355857 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-6c5675e7-2a52-40d9-b1c3-1f4c2205114e None None] MFA Rules not processed for user `e95a9d89651045e289c85da2c9e8f56c`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:08.357003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6c5675e7-2a52-40d9-b1c3-1f4c2205114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:08.388033 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1430/2838] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:08.396518 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880004e0-66da-4cc6-b8f4-3f5d4d05efd3 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:08.396811 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880004e0-66da-4cc6-b8f4-3f5d4d05efd3 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:08.397090 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880004e0-66da-4cc6-b8f4-3f5d4d05efd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:08.422570 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1409/2839] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:08.426003 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-880004e0-66da-4cc6-b8f4-3f5d4d05efd3 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:08.427312 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-880004e0-66da-4cc6-b8f4-3f5d4d05efd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:08.436529 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1431/2840] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:56:08.439967 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5675e7-2a52-40d9-b1c3-1f4c2205114e None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:08.458636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5675e7-2a52-40d9-b1c3-1f4c2205114e None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:08.466345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1f2e9-9ab2-4b3c-8693-17770124d029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:08.466345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1f2e9-9ab2-4b3c-8693-17770124d029 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:08.466345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1f2e9-9ab2-4b3c-8693-17770124d029 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:08.466345 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1f2e9-9ab2-4b3c-8693-17770124d029 admin admin] PATH_INFO: `/v3/domains` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:08.466963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1f2e9-9ab2-4b3c-8693-17770124d029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87039) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:56:08.466963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1f2e9-9ab2-4b3c-8693-17770124d029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:08.468444 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1f2e9-9ab2-4b3c-8693-17770124d029 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:08.477963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:08.491200 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880004e0-66da-4cc6-b8f4-3f5d4d05efd3 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:08.494477 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1410/2841] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:56:08.502453 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880004e0-66da-4cc6-b8f4-3f5d4d05efd3 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:08.507235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bf88f-0363-4084-9b3b-8b3d55ebe4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:08.508282 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bf88f-0363-4084-9b3b-8b3d55ebe4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:08.508282 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bf88f-0363-4084-9b3b-8b3d55ebe4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:08.508549 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bf88f-0363-4084-9b3b-8b3d55ebe4f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:08.509220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bf88f-0363-4084-9b3b-8b3d55ebe4f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:08.511172 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bf88f-0363-4084-9b3b-8b3d55ebe4f5 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:08.573402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1432/2842] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:56:08 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:56:08.576423 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1f2e9-9ab2-4b3c-8693-17770124d029 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:08.592732 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1f2e9-9ab2-4b3c-8693-17770124d029 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:08.662668 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d74ab-ea9f-48d8-9bb1-f90413fbcc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:08.663501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d74ab-ea9f-48d8-9bb1-f90413fbcc6f admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:08.663882 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d74ab-ea9f-48d8-9bb1-f90413fbcc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:08.664223 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d74ab-ea9f-48d8-9bb1-f90413fbcc6f admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:08.665181 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d74ab-ea9f-48d8-9bb1-f90413fbcc6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:08.667161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d74ab-ea9f-48d8-9bb1-f90413fbcc6f admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:08.698818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1411/2843] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:56:08 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:56:08.700943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bf88f-0363-4084-9b3b-8b3d55ebe4f5 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:08.712694 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bf88f-0363-4084-9b3b-8b3d55ebe4f5 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:08.717884 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a167763-cde6-40b4-9fa8-55f27b2f58e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:08.718888 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a167763-cde6-40b4-9fa8-55f27b2f58e8 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:08.719373 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a167763-cde6-40b4-9fa8-55f27b2f58e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:08.721947 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a167763-cde6-40b4-9fa8-55f27b2f58e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:08.723136 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a167763-cde6-40b4-9fa8-55f27b2f58e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:08.726100 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a167763-cde6-40b4-9fa8-55f27b2f58e8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:08.740983 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1433/2844] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:56:08.745059 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d74ab-ea9f-48d8-9bb1-f90413fbcc6f admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:08.757880 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d74ab-ea9f-48d8-9bb1-f90413fbcc6f admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:08.764523 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fb2f0-2c38-417b-8b91-56913a2c5fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:08.765197 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fb2f0-2c38-417b-8b91-56913a2c5fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:08.765483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fb2f0-2c38-417b-8b91-56913a2c5fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:08.765759 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fb2f0-2c38-417b-8b91-56913a2c5fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:08.766498 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fb2f0-2c38-417b-8b91-56913a2c5fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:08.768388 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fb2f0-2c38-417b-8b91-56913a2c5fd7 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:08.788537 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1412/2845] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:56:08.789985 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a167763-cde6-40b4-9fa8-55f27b2f58e8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:08.800193 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a167763-cde6-40b4-9fa8-55f27b2f58e8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:08.805117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242507e-bfca-4c49-85d2-6917a237edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:08.806120 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242507e-bfca-4c49-85d2-6917a237edda admin admin] REQUEST_METHOD: `PUT` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:08.806470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242507e-bfca-4c49-85d2-6917a237edda admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:08.806838 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242507e-bfca-4c49-85d2-6917a237edda admin admin] PATH_INFO: `/v3/projects/31fc6d2e86af483692a6768f7ad65012/users/a32171f3dfcf47918b28e6b583e28c52/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:08.822213 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242507e-bfca-4c49-85d2-6917a237edda admin admin] RBAC: Authorizing `identity:create_grant(project_id=31fc6d2e86af483692a6768f7ad65012, user_id=a32171f3dfcf47918b28e6b583e28c52, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:08.825341 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242507e-bfca-4c49-85d2-6917a237edda admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:08.851278 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1434/2846] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:56:08 2022] PUT /identity/v3/projects/31fc6d2e86af483692a6768f7ad65012/users/a32171f3dfcf47918b28e6b583e28c52/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:08.857063 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f34e7-9f73-4062-b9c1-d3dc6997e611 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:08.857422 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f34e7-9f73-4062-b9c1-d3dc6997e611 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:08.857711 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f34e7-9f73-4062-b9c1-d3dc6997e611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:08.878340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-776f34e7-9f73-4062-b9c1-d3dc6997e611 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:08.878599 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-776f34e7-9f73-4062-b9c1-d3dc6997e611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:08.967476 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1413/2847] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:08.978108 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242507e-bfca-4c49-85d2-6917a237edda admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:08.980141 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e242507e-bfca-4c49-85d2-6917a237edda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:09.080547 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242507e-bfca-4c49-85d2-6917a237edda admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:09.094818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9f91a-c544-41d3-acad-4beea2a01eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:09.094818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9f91a-c544-41d3-acad-4beea2a01eaa service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:09.094818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9f91a-c544-41d3-acad-4beea2a01eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:09.094818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9f91a-c544-41d3-acad-4beea2a01eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:09.109973 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9f91a-c544-41d3-acad-4beea2a01eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:09.112050 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9f91a-c544-41d3-acad-4beea2a01eaa service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:09.123673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1435/2848] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:56:13.675583 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cba773-5458-4935-b9fc-a155e642bd5e None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:13.676195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cba773-5458-4935-b9fc-a155e642bd5e None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:13.676195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cba773-5458-4935-b9fc-a155e642bd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:13.706652 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-72cba773-5458-4935-b9fc-a155e642bd5e None None] MFA Rules not processed for user `a32171f3dfcf47918b28e6b583e28c52`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:13.707919 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-72cba773-5458-4935-b9fc-a155e642bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:13.799479 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1414/2849] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:13.804145 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9f91a-c544-41d3-acad-4beea2a01eaa service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:13.814949 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9f91a-c544-41d3-acad-4beea2a01eaa service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:13.820410 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427cf22-a5c3-4f2a-a38d-98892fce0293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:13.821088 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427cf22-a5c3-4f2a-a38d-98892fce0293 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:13.821371 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427cf22-a5c3-4f2a-a38d-98892fce0293 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:13.821628 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427cf22-a5c3-4f2a-a38d-98892fce0293 admin admin] PATH_INFO: `/v3/projects` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:13.822327 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427cf22-a5c3-4f2a-a38d-98892fce0293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:13.824805 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427cf22-a5c3-4f2a-a38d-98892fce0293 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:13.828507 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:13.865439 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1436/2850] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:56:13 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:56:13.869534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cba773-5458-4935-b9fc-a155e642bd5e None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:13.881258 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cba773-5458-4935-b9fc-a155e642bd5e None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:13.885262 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:13.950881 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc0a62-791e-485e-a893-8802afb0b6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:13.951567 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc0a62-791e-485e-a893-8802afb0b6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:13.951848 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc0a62-791e-485e-a893-8802afb0b6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:13.952117 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc0a62-791e-485e-a893-8802afb0b6c4 admin admin] PATH_INFO: `/v3/users` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:13.952818 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc0a62-791e-485e-a893-8802afb0b6c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:13.954780 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc0a62-791e-485e-a893-8802afb0b6c4 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:13.977109 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1415/2851] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:56:13 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 03:56:13.981370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427cf22-a5c3-4f2a-a38d-98892fce0293 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:13.999785 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427cf22-a5c3-4f2a-a38d-98892fce0293 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:14.004727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441cc77-3ceb-4a87-a65c-28ab1e6df8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:14.005568 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441cc77-3ceb-4a87-a65c-28ab1e6df8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:14.005857 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441cc77-3ceb-4a87-a65c-28ab1e6df8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:14.006137 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441cc77-3ceb-4a87-a65c-28ab1e6df8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:14.007116 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441cc77-3ceb-4a87-a65c-28ab1e6df8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:14.008727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441cc77-3ceb-4a87-a65c-28ab1e6df8a1 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:14.020235 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1437/2852] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 03:56:14.026099 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc0a62-791e-485e-a893-8802afb0b6c4 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:14.048469 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc0a62-791e-485e-a893-8802afb0b6c4 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:14.053416 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d42dd-d39f-4d07-a128-d0cdf26b557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:14.054369 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d42dd-d39f-4d07-a128-d0cdf26b557a admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:14.054656 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d42dd-d39f-4d07-a128-d0cdf26b557a admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:14.054962 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d42dd-d39f-4d07-a128-d0cdf26b557a admin admin] PATH_INFO: `/v3/projects/253fcfe1a8434f088c67dbe1581736b7/users/893993b79973426db68c208ad70efc13/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:14.072174 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d42dd-d39f-4d07-a128-d0cdf26b557a admin admin] RBAC: Authorizing `identity:create_grant(project_id=253fcfe1a8434f088c67dbe1581736b7, user_id=893993b79973426db68c208ad70efc13, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:14.075268 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d42dd-d39f-4d07-a128-d0cdf26b557a admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:14.100163 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1416/2853] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:56:14 2022] PUT /identity/v3/projects/253fcfe1a8434f088c67dbe1581736b7/users/893993b79973426db68c208ad70efc13/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:14.101425 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441cc77-3ceb-4a87-a65c-28ab1e6df8a1 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:14.112900 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441cc77-3ceb-4a87-a65c-28ab1e6df8a1 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:14.176671 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091fe2c-9033-4e04-80a8-faec2678ae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:14.177538 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091fe2c-9033-4e04-80a8-faec2678ae94 admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:14.178126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091fe2c-9033-4e04-80a8-faec2678ae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:14.178126 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091fe2c-9033-4e04-80a8-faec2678ae94 admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:14.178822 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091fe2c-9033-4e04-80a8-faec2678ae94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:14.180470 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091fe2c-9033-4e04-80a8-faec2678ae94 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:14.199340 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1438/2854] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:56:14.203573 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d42dd-d39f-4d07-a128-d0cdf26b557a admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:14.215745 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d42dd-d39f-4d07-a128-d0cdf26b557a admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:14.221264 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef500eb6-7404-46d9-bdc0-e6711d3c9417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:14.222508 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef500eb6-7404-46d9-bdc0-e6711d3c9417 admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:14.222785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef500eb6-7404-46d9-bdc0-e6711d3c9417 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:14.223183 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef500eb6-7404-46d9-bdc0-e6711d3c9417 admin admin] PATH_INFO: `/v3/projects/253fcfe1a8434f088c67dbe1581736b7/users/893993b79973426db68c208ad70efc13/roles/debd6ade74ee428b812886f0ca9f5930` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:14.229317 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef500eb6-7404-46d9-bdc0-e6711d3c9417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=253fcfe1a8434f088c67dbe1581736b7, user_id=893993b79973426db68c208ad70efc13, role_id=debd6ade74ee428b812886f0ca9f5930)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:14.232218 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef500eb6-7404-46d9-bdc0-e6711d3c9417 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:14.245154 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1417/2855] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:56:14 2022] PUT /identity/v3/projects/253fcfe1a8434f088c67dbe1581736b7/users/893993b79973426db68c208ad70efc13/roles/debd6ade74ee428b812886f0ca9f5930 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:19.287717 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6194c0a-3db1-4219-9cdc-5922851e551a None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:19.288946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6194c0a-3db1-4219-9cdc-5922851e551a None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:19.288946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6194c0a-3db1-4219-9cdc-5922851e551a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:19.329751 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e6194c0a-3db1-4219-9cdc-5922851e551a None None] MFA Rules not processed for user `893993b79973426db68c208ad70efc13`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:19.331026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e6194c0a-3db1-4219-9cdc-5922851e551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:19.449517 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1439/2856] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:19.817909 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef500eb6-7404-46d9-bdc0-e6711d3c9417 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:19.819900 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ef500eb6-7404-46d9-bdc0-e6711d3c9417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:19.886514 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef500eb6-7404-46d9-bdc0-e6711d3c9417 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:19.891173 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1bddc-b422-4796-bcfe-2a67c34efe39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450fda3236cc4d1ba3189b6b66f65686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:19.891873 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1bddc-b422-4796-bcfe-2a67c34efe39 service glance] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:19.892160 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1bddc-b422-4796-bcfe-2a67c34efe39 service glance] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:19.892439 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1bddc-b422-4796-bcfe-2a67c34efe39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:19.958538 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1bddc-b422-4796-bcfe-2a67c34efe39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:19.960593 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1bddc-b422-4796-bcfe-2a67c34efe39 service glance] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:19.970977 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1418/2857] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:56:20.077502 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aea682-4577-47aa-b93a-ce987b370c73 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:20.077788 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aea682-4577-47aa-b93a-ce987b370c73 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:20.078061 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aea682-4577-47aa-b93a-ce987b370c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:20.096912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e8aea682-4577-47aa-b93a-ce987b370c73 None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:20.098128 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e8aea682-4577-47aa-b93a-ce987b370c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:20.151044 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:20.159828 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1440/2858] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:56:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:20.218009 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1bddc-b422-4796-bcfe-2a67c34efe39 service glance] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:20.219778 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2af1bddc-b422-4796-bcfe-2a67c34efe39 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:20.236191 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:20.300499 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1bddc-b422-4796-bcfe-2a67c34efe39 service glance] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:20.306304 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b75914-1367-4dbb-b55c-fbdd2847b3bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:20.306973 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b75914-1367-4dbb-b55c-fbdd2847b3bc service swift] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:20.307234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b75914-1367-4dbb-b55c-fbdd2847b3bc service swift] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:20.307506 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b75914-1367-4dbb-b55c-fbdd2847b3bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:20.316149 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b75914-1367-4dbb-b55c-fbdd2847b3bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:20.317684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b75914-1367-4dbb-b55c-fbdd2847b3bc service swift] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:20.326814 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1419/2859] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:56:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:56:26.792044 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aea682-4577-47aa-b93a-ce987b370c73 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:26.793494 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e8aea682-4577-47aa-b93a-ce987b370c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:26.866002 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aea682-4577-47aa-b93a-ce987b370c73 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:26.870415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3615f28-2fb4-4214-970a-736f55c4f55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:26.871321 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3615f28-2fb4-4214-970a-736f55c4f55c service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:26.871456 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3615f28-2fb4-4214-970a-736f55c4f55c service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:26.871738 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3615f28-2fb4-4214-970a-736f55c4f55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:26.873609 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-d3615f28-2fb4-4214-970a-736f55c4f55c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:26.885854 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3615f28-2fb4-4214-970a-736f55c4f55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:26.887622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3615f28-2fb4-4214-970a-736f55c4f55c service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:26.909511 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1441/2860] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:56:30.021697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2495e-24fa-4ca0-9968-c5d5cdc1cc85 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:30.022146 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2495e-24fa-4ca0-9968-c5d5cdc1cc85 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:30.022308 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2495e-24fa-4ca0-9968-c5d5cdc1cc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:30.044397 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-24e2495e-24fa-4ca0-9968-c5d5cdc1cc85 None None] MFA Rules not processed for user `a32171f3dfcf47918b28e6b583e28c52`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:30.045647 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-24e2495e-24fa-4ca0-9968-c5d5cdc1cc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:30.054151 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1420/2861] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:30.431720 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3615f28-2fb4-4214-970a-736f55c4f55c service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:30.442166 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3615f28-2fb4-4214-970a-736f55c4f55c service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:30.451648 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0d913-efbf-4681-ad69-ecf0c8cba571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:30.452805 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0d913-efbf-4681-ad69-ecf0c8cba571 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:30.453203 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0d913-efbf-4681-ad69-ecf0c8cba571 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:30.453577 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0d913-efbf-4681-ad69-ecf0c8cba571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:30.457219 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9bd0d913-efbf-4681-ad69-ecf0c8cba571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:30.469153 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0d913-efbf-4681-ad69-ecf0c8cba571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:30.470850 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0d913-efbf-4681-ad69-ecf0c8cba571 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:30.482534 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1442/2862] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:56:32.520137 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52405f3-703f-42f7-8796-1c1d14d49e9d None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:32.520625 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52405f3-703f-42f7-8796-1c1d14d49e9d None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:32.520716 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52405f3-703f-42f7-8796-1c1d14d49e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:32.538844 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-c52405f3-703f-42f7-8796-1c1d14d49e9d None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:32.540090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-c52405f3-703f-42f7-8796-1c1d14d49e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:32.548069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1421/2863] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:56:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:32.561557 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0d913-efbf-4681-ad69-ecf0c8cba571 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:32.574653 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0d913-efbf-4681-ad69-ecf0c8cba571 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:32.580026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefc6b4-a730-4ccc-9e83-0fb7d6513fe3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:32.580662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefc6b4-a730-4ccc-9e83-0fb7d6513fe3 service swift] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:32.581060 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefc6b4-a730-4ccc-9e83-0fb7d6513fe3 service swift] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:32.581345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefc6b4-a730-4ccc-9e83-0fb7d6513fe3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:32.589845 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefc6b4-a730-4ccc-9e83-0fb7d6513fe3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:32.591519 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefc6b4-a730-4ccc-9e83-0fb7d6513fe3 service swift] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:32.599855 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1443/2864] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:56:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:56:34.248377 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52405f3-703f-42f7-8796-1c1d14d49e9d None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:34.250426 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-c52405f3-703f-42f7-8796-1c1d14d49e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:34.324453 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52405f3-703f-42f7-8796-1c1d14d49e9d None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:34.329534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2895b-6e30-4217-bb0b-00180cbdd72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:34.330382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2895b-6e30-4217-bb0b-00180cbdd72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:34.330684 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2895b-6e30-4217-bb0b-00180cbdd72d admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:34.330996 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2895b-6e30-4217-bb0b-00180cbdd72d admin admin] PATH_INFO: `/v3/users/492e778c5e8845a6a245c134e06c3ab3` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:34.332250 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2895b-6e30-4217-bb0b-00180cbdd72d admin admin] RBAC: Authorizing `identity:delete_user(user_id=492e778c5e8845a6a245c134e06c3ab3)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:34.334541 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2895b-6e30-4217-bb0b-00180cbdd72d admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:34.391418 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2fa2895b-6e30-4217-bb0b-00180cbdd72d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492e778c5e8845a6a245c134e06c3ab3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:34.404932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2fa2895b-6e30-4217-bb0b-00180cbdd72d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492e778c5e8845a6a245c134e06c3ab3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:34.412362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2fa2895b-6e30-4217-bb0b-00180cbdd72d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492e778c5e8845a6a245c134e06c3ab3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:34.413114 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2fa2895b-6e30-4217-bb0b-00180cbdd72d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492e778c5e8845a6a245c134e06c3ab3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:34.413718 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-2fa2895b-6e30-4217-bb0b-00180cbdd72d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492e778c5e8845a6a245c134e06c3ab3'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:34.428956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1422/2865] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:56:34 2022] DELETE /identity/v3/users/492e778c5e8845a6a245c134e06c3ab3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:34.433842 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f40d-a0b9-4f71-8ac1-3e7d83b0d8e1 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:34.434458 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f40d-a0b9-4f71-8ac1-3e7d83b0d8e1 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:34.434458 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f40d-a0b9-4f71-8ac1-3e7d83b0d8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:34.454157 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-3589f40d-a0b9-4f71-8ac1-3e7d83b0d8e1 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:34.455400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3589f40d-a0b9-4f71-8ac1-3e7d83b0d8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:34.527632 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1444/2866] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:34.535017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2895b-6e30-4217-bb0b-00180cbdd72d admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:34.536826 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2fa2895b-6e30-4217-bb0b-00180cbdd72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:34.552616 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:34.615741 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2895b-6e30-4217-bb0b-00180cbdd72d admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:34.619546 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebe34a-a23d-4e33-817e-3e32e7254c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:34.620211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebe34a-a23d-4e33-817e-3e32e7254c19 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:34.620512 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebe34a-a23d-4e33-817e-3e32e7254c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:34.620785 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebe34a-a23d-4e33-817e-3e32e7254c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:34.631212 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebe34a-a23d-4e33-817e-3e32e7254c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:34.632715 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebe34a-a23d-4e33-817e-3e32e7254c19 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:34.644161 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1423/2867] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:56:35.380027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589f40d-a0b9-4f71-8ac1-3e7d83b0d8e1 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:35.381780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-3589f40d-a0b9-4f71-8ac1-3e7d83b0d8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:35.397748 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589f40d-a0b9-4f71-8ac1-3e7d83b0d8e1 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:35.407055 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad3e05-e14a-41aa-98d2-d236382663e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:35.408607 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad3e05-e14a-41aa-98d2-d236382663e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:35.408970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad3e05-e14a-41aa-98d2-d236382663e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:35.409343 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad3e05-e14a-41aa-98d2-d236382663e0 admin admin] PATH_INFO: `/v3/projects/05272927384f4e62ac08c838e518930d` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:35.410698 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad3e05-e14a-41aa-98d2-d236382663e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05272927384f4e62ac08c838e518930d)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:35.413219 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad3e05-e14a-41aa-98d2-d236382663e0 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:35.472029 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebe34a-a23d-4e33-817e-3e32e7254c19 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:35.473695 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-41ebe34a-a23d-4e33-817e-3e32e7254c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:35.519909 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-27ad3e05-e14a-41aa-98d2-d236382663e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05272927384f4e62ac08c838e518930d', 'request_id': 'req-27ad3e05-e14a-41aa-98d2-d236382663e0'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:35.536600 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-27ad3e05-e14a-41aa-98d2-d236382663e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05272927384f4e62ac08c838e518930d', 'request_id': 'req-27ad3e05-e14a-41aa-98d2-d236382663e0'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:35.549099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-27ad3e05-e14a-41aa-98d2-d236382663e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05272927384f4e62ac08c838e518930d', 'request_id': 'req-27ad3e05-e14a-41aa-98d2-d236382663e0'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:35.560961 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:35.565699 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-27ad3e05-e14a-41aa-98d2-d236382663e0 admin admin] The token cache is being invalidate because project 05272927384f4e62ac08c838e518930d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:56:35.566240 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-27ad3e05-e14a-41aa-98d2-d236382663e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:35.568180 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-27ad3e05-e14a-41aa-98d2-d236382663e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:35.571026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1445/2868] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:56:35 2022] DELETE /identity/v3/projects/05272927384f4e62ac08c838e518930d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:35.576095 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657b383-4831-41f2-807b-07db96e6f5f5 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:35.577030 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657b383-4831-41f2-807b-07db96e6f5f5 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:35.578229 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657b383-4831-41f2-807b-07db96e6f5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:35.600048 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-6657b383-4831-41f2-807b-07db96e6f5f5 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:35.601233 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebe34a-a23d-4e33-817e-3e32e7254c19 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:35.601528 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6657b383-4831-41f2-807b-07db96e6f5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:35.678752 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1446/2869] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:56:35.687129 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9dfa-bfca-4b80-bf4c-0dbf9aaa8444 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:35.687533 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9dfa-bfca-4b80-bf4c-0dbf9aaa8444 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:35.687818 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9dfa-bfca-4b80-bf4c-0dbf9aaa8444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:35.694703 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1ef84-72b0-4108-b05c-379cbcea1534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:35.695389 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1ef84-72b0-4108-b05c-379cbcea1534 service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:35.695670 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1ef84-72b0-4108-b05c-379cbcea1534 service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:35.695943 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1ef84-72b0-4108-b05c-379cbcea1534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:35.697783 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8ec1ef84-72b0-4108-b05c-379cbcea1534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:35.709038 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e78d9dfa-bfca-4b80-bf4c-0dbf9aaa8444 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:35.710402 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e78d9dfa-bfca-4b80-bf4c-0dbf9aaa8444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:35.716378 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1ef84-72b0-4108-b05c-379cbcea1534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:35.718163 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1ef84-72b0-4108-b05c-379cbcea1534 service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:35.719472 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1447/2870] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:35.723873 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d9dfa-bfca-4b80-bf4c-0dbf9aaa8444 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:35.731841 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1424/2871] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:56:35.733599 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d9dfa-bfca-4b80-bf4c-0dbf9aaa8444 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:35.738501 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1fe26-2914-46e1-bf12-51edc88f46de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:35.739227 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1fe26-2914-46e1-bf12-51edc88f46de admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:35.739510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1fe26-2914-46e1-bf12-51edc88f46de admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:35.739786 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1fe26-2914-46e1-bf12-51edc88f46de admin admin] PATH_INFO: `/v3/domains` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:35.740527 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1fe26-2914-46e1-bf12-51edc88f46de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87040) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 03:56:35.741081 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1fe26-2914-46e1-bf12-51edc88f46de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:35.742729 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1fe26-2914-46e1-bf12-51edc88f46de admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:35.768091 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1448/2872] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 03:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 03:56:35.769335 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1ef84-72b0-4108-b05c-379cbcea1534 service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:35.784409 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1ef84-72b0-4108-b05c-379cbcea1534 service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:35.806672 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dd429-14e1-4147-8b1a-c697dc68d653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:35.807384 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dd429-14e1-4147-8b1a-c697dc68d653 admin admin] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:35.807669 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dd429-14e1-4147-8b1a-c697dc68d653 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:35.807937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dd429-14e1-4147-8b1a-c697dc68d653 admin admin] PATH_INFO: `/v3/projects` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:35.808847 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59dd429-14e1-4147-8b1a-c697dc68d653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:35.810819 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59dd429-14e1-4147-8b1a-c697dc68d653 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:35.847323 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1425/2873] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 03:56:35 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:56:35.851329 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1fe26-2914-46e1-bf12-51edc88f46de admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:35.866897 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1fe26-2914-46e1-bf12-51edc88f46de admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:35.945834 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc499296-f724-47b1-91b3-55087fb330c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:35.946551 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc499296-f724-47b1-91b3-55087fb330c8 admin admin] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:35.946935 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc499296-f724-47b1-91b3-55087fb330c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:35.947156 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc499296-f724-47b1-91b3-55087fb330c8 admin admin] PATH_INFO: `/v3/users` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:35.947875 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc499296-f724-47b1-91b3-55087fb330c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:35.959316 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc499296-f724-47b1-91b3-55087fb330c8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:35.999660 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1449/2874] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 03:56:35 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 03:56:36.000511 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dd429-14e1-4147-8b1a-c697dc68d653 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:36.012445 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dd429-14e1-4147-8b1a-c697dc68d653 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:36.017123 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef47542-5c92-4c03-8af0-b0f965cf8657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:36.017804 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef47542-5c92-4c03-8af0-b0f965cf8657 admin admin] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:36.018171 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef47542-5c92-4c03-8af0-b0f965cf8657 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:36.018534 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef47542-5c92-4c03-8af0-b0f965cf8657 admin admin] PATH_INFO: `/v3/roles` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:36.019370 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef47542-5c92-4c03-8af0-b0f965cf8657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:36.021456 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef47542-5c92-4c03-8af0-b0f965cf8657 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:36.037069 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1426/2875] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:56:36.038352 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc499296-f724-47b1-91b3-55087fb330c8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:36.050737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc499296-f724-47b1-91b3-55087fb330c8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:36.056048 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa867f-bf17-45ad-ba6e-3f7607439dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:36.056743 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa867f-bf17-45ad-ba6e-3f7607439dbe admin admin] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:36.057031 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa867f-bf17-45ad-ba6e-3f7607439dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:36.057312 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa867f-bf17-45ad-ba6e-3f7607439dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:36.058274 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa867f-bf17-45ad-ba6e-3f7607439dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:36.060596 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa867f-bf17-45ad-ba6e-3f7607439dbe admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:36.072099 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1450/2876] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 03:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 03:56:36.076657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef47542-5c92-4c03-8af0-b0f965cf8657 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:36.082291 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:36.088676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef47542-5c92-4c03-8af0-b0f965cf8657 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:36.095532 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362a861-d361-4968-be4d-f13da452fdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:36.096445 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362a861-d361-4968-be4d-f13da452fdbe admin admin] REQUEST_METHOD: `PUT` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:36.096726 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362a861-d361-4968-be4d-f13da452fdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:36.097007 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362a861-d361-4968-be4d-f13da452fdbe admin admin] PATH_INFO: `/v3/projects/e71580bd24804c18aea19a134e7e2ce3/users/cefb249d892e4d1c96bf6b6fee166210/roles/59a0f03d08fd401ebbd29ebd5f174abb` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:36.121721 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362a861-d361-4968-be4d-f13da452fdbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71580bd24804c18aea19a134e7e2ce3, user_id=cefb249d892e4d1c96bf6b6fee166210, role_id=59a0f03d08fd401ebbd29ebd5f174abb)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:36.125068 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362a861-d361-4968-be4d-f13da452fdbe admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:36.141828 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1427/2877] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 03:56:36 2022] PUT /identity/v3/projects/e71580bd24804c18aea19a134e7e2ce3/users/cefb249d892e4d1c96bf6b6fee166210/roles/59a0f03d08fd401ebbd29ebd5f174abb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:36.152481 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748299b8-1a9c-4553-87a1-43b7b9672e11 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:36.152798 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748299b8-1a9c-4553-87a1-43b7b9672e11 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:36.153064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748299b8-1a9c-4553-87a1-43b7b9672e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:36.185655 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-748299b8-1a9c-4553-87a1-43b7b9672e11 None None] MFA Rules not processed for user `cefb249d892e4d1c96bf6b6fee166210`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:36.187116 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-748299b8-1a9c-4553-87a1-43b7b9672e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:36.246125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:36.269027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1451/2878] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:36.280811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362a861-d361-4968-be4d-f13da452fdbe admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:36.282602 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-5362a861-d361-4968-be4d-f13da452fdbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:36.374879 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362a861-d361-4968-be4d-f13da452fdbe admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:36.378967 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75ba78-65f4-49c8-91dd-e017cb51d120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef547cb73e04f62afb9e6c20793ad8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:36.379948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75ba78-65f4-49c8-91dd-e017cb51d120 service cinder] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:36.380318 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75ba78-65f4-49c8-91dd-e017cb51d120 service cinder] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:36.380600 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75ba78-65f4-49c8-91dd-e017cb51d120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:36.391666 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75ba78-65f4-49c8-91dd-e017cb51d120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:36.393526 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75ba78-65f4-49c8-91dd-e017cb51d120 service cinder] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:36.404811 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1428/2879] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:56:37.926970 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de3af6-e656-49e7-b769-b54d65cea842 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:37.927526 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de3af6-e656-49e7-b769-b54d65cea842 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:37.927643 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de3af6-e656-49e7-b769-b54d65cea842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:37.946865 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-96de3af6-e656-49e7-b769-b54d65cea842 None None] MFA Rules not processed for user `cefb249d892e4d1c96bf6b6fee166210`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:37.948414 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-96de3af6-e656-49e7-b769-b54d65cea842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:37.956416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1452/2880] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:43.816458 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75ba78-65f4-49c8-91dd-e017cb51d120 service cinder] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:43.818155 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ab75ba78-65f4-49c8-91dd-e017cb51d120 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:43.879367 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75ba78-65f4-49c8-91dd-e017cb51d120 service cinder] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:43.884035 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95c6a8-91be-4c78-9bb6-14594cfd48d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:43.884696 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95c6a8-91be-4c78-9bb6-14594cfd48d9 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:43.884977 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95c6a8-91be-4c78-9bb6-14594cfd48d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:43.885244 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95c6a8-91be-4c78-9bb6-14594cfd48d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:43.887028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-8d95c6a8-91be-4c78-9bb6-14594cfd48d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:43.960014 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95c6a8-91be-4c78-9bb6-14594cfd48d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:43.961778 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95c6a8-91be-4c78-9bb6-14594cfd48d9 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:43.973257 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1429/2881] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:56:47.940661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=8 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:53.934073 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de3af6-e656-49e7-b769-b54d65cea842 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:53.936409 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-96de3af6-e656-49e7-b769-b54d65cea842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:53.969401 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=85,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:54.044795 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de3af6-e656-49e7-b769-b54d65cea842 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:54.050075 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc85aa-4e13-444d-a959-fd6b1b89dac7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13562e65139b44ab931fb8fdb41a61b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:54.051011 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc85aa-4e13-444d-a959-fd6b1b89dac7 service placement] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:54.051375 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc85aa-4e13-444d-a959-fd6b1b89dac7 service placement] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:54.051719 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc85aa-4e13-444d-a959-fd6b1b89dac7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:54.053646 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a5cc85aa-4e13-444d-a959-fd6b1b89dac7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:54.069990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc85aa-4e13-444d-a959-fd6b1b89dac7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:54.072283 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc85aa-4e13-444d-a959-fd6b1b89dac7 service placement] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:54.086991 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1453/2882] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:56:55.238411 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf310-2a77-4e93-9d3f-8e0197cb0fbc None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:55.238925 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf310-2a77-4e93-9d3f-8e0197cb0fbc None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:55.239061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf310-2a77-4e93-9d3f-8e0197cb0fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:55.256396 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-2cccf310-2a77-4e93-9d3f-8e0197cb0fbc None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:55.257608 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2cccf310-2a77-4e93-9d3f-8e0197cb0fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:55.315960 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1430/2883] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:56:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 03:56:55.328226 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc85aa-4e13-444d-a959-fd6b1b89dac7 service placement] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:55.329672 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-a5cc85aa-4e13-444d-a959-fd6b1b89dac7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:55.337530 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccf310-2a77-4e93-9d3f-8e0197cb0fbc None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:55.339055 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2cccf310-2a77-4e93-9d3f-8e0197cb0fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:55.351095 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccf310-2a77-4e93-9d3f-8e0197cb0fbc None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:55.354735 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e77c86-3414-47ea-ab17-4a7bb4e87e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:55.355398 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e77c86-3414-47ea-ab17-4a7bb4e87e99 service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:55.355676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e77c86-3414-47ea-ab17-4a7bb4e87e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:55.355947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e77c86-3414-47ea-ab17-4a7bb4e87e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:55.357731 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-39e77c86-3414-47ea-ab17-4a7bb4e87e99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:55.400463 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc85aa-4e13-444d-a959-fd6b1b89dac7 service placement] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:55.406645 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2e4f6-b286-44e0-8a48-bcc0297e2414 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:55.408556 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2e4f6-b286-44e0-8a48-bcc0297e2414 service swift] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:55.408826 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2e4f6-b286-44e0-8a48-bcc0297e2414 service swift] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:55.409125 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2e4f6-b286-44e0-8a48-bcc0297e2414 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:55.418662 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2e4f6-b286-44e0-8a48-bcc0297e2414 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:55.420284 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2e4f6-b286-44e0-8a48-bcc0297e2414 service swift] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:55.423131 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e77c86-3414-47ea-ab17-4a7bb4e87e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:55.424708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e77c86-3414-47ea-ab17-4a7bb4e87e99 service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:55.430142 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1454/2884] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:56:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:56:55.435504 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1431/2885] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 03:56:55.970489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b04ae-e073-4f1c-927f-670a99f3798d None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:55.970787 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b04ae-e073-4f1c-927f-670a99f3798d None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:55.971088 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b04ae-e073-4f1c-927f-670a99f3798d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:55.992102 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-fa6b04ae-e073-4f1c-927f-670a99f3798d None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:55.993617 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-fa6b04ae-e073-4f1c-927f-670a99f3798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:56.002032 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1455/2886] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 30 03:56:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:56.015476 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e77c86-3414-47ea-ab17-4a7bb4e87e99 service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:56.027344 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e77c86-3414-47ea-ab17-4a7bb4e87e99 service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:56.032306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e67e5e-cf9b-4eac-8e0a-d6f4549fa1cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:56.032968 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e67e5e-cf9b-4eac-8e0a-d6f4549fa1cd service swift] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:56.033249 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e67e5e-cf9b-4eac-8e0a-d6f4549fa1cd service swift] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:56.033526 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e67e5e-cf9b-4eac-8e0a-d6f4549fa1cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:56.042335 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e67e5e-cf9b-4eac-8e0a-d6f4549fa1cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:56.043977 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e67e5e-cf9b-4eac-8e0a-d6f4549fa1cd service swift] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:56.052493 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1432/2887] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:56:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:56:56.267067 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554a495-a8a5-4e77-82b6-c3e79c5aec03 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:56.267531 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554a495-a8a5-4e77-82b6-c3e79c5aec03 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:56.267820 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554a495-a8a5-4e77-82b6-c3e79c5aec03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:56.286642 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-9554a495-a8a5-4e77-82b6-c3e79c5aec03 None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:56.287902 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-9554a495-a8a5-4e77-82b6-c3e79c5aec03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:56.296379 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1456/2888] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 03:56:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:56.309673 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e67e5e-cf9b-4eac-8e0a-d6f4549fa1cd service swift] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:56.321287 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e67e5e-cf9b-4eac-8e0a-d6f4549fa1cd service swift] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:56.326736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3a5c9-17c6-4449-996d-a6f4fc88b1a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:56.327414 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3a5c9-17c6-4449-996d-a6f4fc88b1a2 service swift] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:56.327697 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3a5c9-17c6-4449-996d-a6f4fc88b1a2 service swift] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:56.327975 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3a5c9-17c6-4449-996d-a6f4fc88b1a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:56.337604 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3a5c9-17c6-4449-996d-a6f4fc88b1a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:56.339246 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3a5c9-17c6-4449-996d-a6f4fc88b1a2 service swift] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:56.347782 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1433/2889] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:56:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 30 03:56:56.886112 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b6cc3-5e20-47ff-b209-a733d8305cd3 None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:56.886587 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b6cc3-5e20-47ff-b209-a733d8305cd3 None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:56.886684 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b6cc3-5e20-47ff-b209-a733d8305cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:56.905512 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-558b6cc3-5e20-47ff-b209-a733d8305cd3 None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:56.906744 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-558b6cc3-5e20-47ff-b209-a733d8305cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:56.914144 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1457/2890] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 30 03:56:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:56.926642 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3a5c9-17c6-4449-996d-a6f4fc88b1a2 service swift] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:56.937372 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3a5c9-17c6-4449-996d-a6f4fc88b1a2 service swift] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:56.942676 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d248e-cfef-49b8-ad69-4c167b9934ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:56.943380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d248e-cfef-49b8-ad69-4c167b9934ee service swift] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:56.943661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d248e-cfef-49b8-ad69-4c167b9934ee service swift] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:56.943937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d248e-cfef-49b8-ad69-4c167b9934ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:56.952404 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d248e-cfef-49b8-ad69-4c167b9934ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:56.954125 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d248e-cfef-49b8-ad69-4c167b9934ee service swift] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:56.963402 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1434/2891] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:56:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 30 03:56:59.246271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b6cc3-5e20-47ff-b209-a733d8305cd3 None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:59.313195 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b6cc3-5e20-47ff-b209-a733d8305cd3 None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:59.318912 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d92bc1-f75f-4adf-95d1-6426dc78cf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:59.319813 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d92bc1-f75f-4adf-95d1-6426dc78cf63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:59.320098 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d92bc1-f75f-4adf-95d1-6426dc78cf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:59.320370 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d92bc1-f75f-4adf-95d1-6426dc78cf63 admin admin] PATH_INFO: `/v3/users/cefb249d892e4d1c96bf6b6fee166210` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:59.321681 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d92bc1-f75f-4adf-95d1-6426dc78cf63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cefb249d892e4d1c96bf6b6fee166210)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:59.323675 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d92bc1-f75f-4adf-95d1-6426dc78cf63 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:59.325833 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=100 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:59.377740 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-20d92bc1-f75f-4adf-95d1-6426dc78cf63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cefb249d892e4d1c96bf6b6fee166210'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:59.391910 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-20d92bc1-f75f-4adf-95d1-6426dc78cf63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cefb249d892e4d1c96bf6b6fee166210'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:59.392732 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-20d92bc1-f75f-4adf-95d1-6426dc78cf63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cefb249d892e4d1c96bf6b6fee166210'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:59.402287 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-20d92bc1-f75f-4adf-95d1-6426dc78cf63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cefb249d892e4d1c96bf6b6fee166210'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:59.403072 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-20d92bc1-f75f-4adf-95d1-6426dc78cf63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cefb249d892e4d1c96bf6b6fee166210'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:56:59.425661 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1458/2892] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:56:59 2022] DELETE /identity/v3/users/cefb249d892e4d1c96bf6b6fee166210 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:56:59.430360 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fef35f-9874-4417-bc1b-d724b0962145 None None] REQUEST_METHOD: `POST` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:59.430911 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fef35f-9874-4417-bc1b-d724b0962145 None None] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:59.431013 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fef35f-9874-4417-bc1b-d724b0962145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:59.463937 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.auth.core [None req-49fef35f-9874-4417-bc1b-d724b0962145 None None] MFA Rules not processed for user `7c1cf291bfd64ba287443cde4df814a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87039) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:56:59.465198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-49fef35f-9874-4417-bc1b-d724b0962145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:59.571939 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=100 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:56:59.591569 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1435/2893] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 03:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:56:59.596939 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d92bc1-f75f-4adf-95d1-6426dc78cf63 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:59.598836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-20d92bc1-f75f-4adf-95d1-6426dc78cf63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:59.684441 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d92bc1-f75f-4adf-95d1-6426dc78cf63 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:59.688306 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa6b86-6b39-4d10-a439-b5fc19418fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:59.688971 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa6b86-6b39-4d10-a439-b5fc19418fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:59.689253 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa6b86-6b39-4d10-a439-b5fc19418fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:59.689524 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa6b86-6b39-4d10-a439-b5fc19418fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:59.700593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa6b86-6b39-4d10-a439-b5fc19418fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:59.702733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa6b86-6b39-4d10-a439-b5fc19418fc9 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:56:59.716858 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1459/2894] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:56:59.916036 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fef35f-9874-4417-bc1b-d724b0962145 None None] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:56:59.917856 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-49fef35f-9874-4417-bc1b-d724b0962145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:56:59.941331 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fef35f-9874-4417-bc1b-d724b0962145 None None] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:56:59.948080 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:56:59.949417 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:56:59.949948 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:56:59.951179 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] PATH_INFO: `/v3/projects/e71580bd24804c18aea19a134e7e2ce3` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:56:59.952931 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71580bd24804c18aea19a134e7e2ce3)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:56:59.955481 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:57:00.029390 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71580bd24804c18aea19a134e7e2ce3', 'request_id': 'req-59910fef-ca38-4b30-bd41-35aff3c1a4dd'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:57:00.043309 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71580bd24804c18aea19a134e7e2ce3', 'request_id': 'req-59910fef-ca38-4b30-bd41-35aff3c1a4dd'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:57:00.055115 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71580bd24804c18aea19a134e7e2ce3', 'request_id': 'req-59910fef-ca38-4b30-bd41-35aff3c1a4dd'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:57:00.069699 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] The token cache is being invalidate because project e71580bd24804c18aea19a134e7e2ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:57:00.070017 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:57:00.070822 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:57:00.073630 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1436/2895] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:56:59 2022] DELETE /identity/v3/projects/e71580bd24804c18aea19a134e7e2ce3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:57:09.711990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=52,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:57:10.066229 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:58:18.152413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5ba5a-50d9-48c8-8a85-3beec9bd634c None None] REQUEST_METHOD: `POST` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:58:18.152943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5ba5a-50d9-48c8-8a85-3beec9bd634c None None] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:58:18.152943 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5ba5a-50d9-48c8-8a85-3beec9bd634c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:58:18.173117 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.auth.core [None req-e2a5ba5a-50d9-48c8-8a85-3beec9bd634c None None] MFA Rules not processed for user `f75f5e28008b4189b5feb6438bdf1852`. Rule list: `[]` (Enabled: `True`). {{(pid=87040) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 03:58:18.174343 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e2a5ba5a-50d9-48c8-8a85-3beec9bd634c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:58:18.234647 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1460/2896] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 30 03:58:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 03:58:18.284110 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:58:18.285655 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:58:18.366466 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59910fef-ca38-4b30-bd41-35aff3c1a4dd admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:58:18.374410 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ee135-9441-4960-a92e-041184dbaed8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9de5d5c703b84e508e3112f90070e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:58:18.375362 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ee135-9441-4960-a92e-041184dbaed8 service swift] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:58:18.375739 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ee135-9441-4960-a92e-041184dbaed8 service swift] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:58:18.376067 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ee135-9441-4960-a92e-041184dbaed8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:58:18.385423 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ee135-9441-4960-a92e-041184dbaed8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:58:18.387093 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ee135-9441-4960-a92e-041184dbaed8 service swift] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:58:18.395463 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1437/2897] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 03:58:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 03:58:21.661419 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5ba5a-50d9-48c8-8a85-3beec9bd634c None None] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:58:21.662990 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-e2a5ba5a-50d9-48c8-8a85-3beec9bd634c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:58:21.769436 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5ba5a-50d9-48c8-8a85-3beec9bd634c None None] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:58:21.775928 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104acca1-8c1c-4744-bbcf-073adb6d4f75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13562e65139b44ab931fb8fdb41a61b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:58:21.777037 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104acca1-8c1c-4744-bbcf-073adb6d4f75 service placement] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:58:21.777497 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104acca1-8c1c-4744-bbcf-073adb6d4f75 service placement] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:58:21.777936 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104acca1-8c1c-4744-bbcf-073adb6d4f75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:58:21.780085 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-104acca1-8c1c-4744-bbcf-073adb6d4f75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:58:21.806605 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104acca1-8c1c-4744-bbcf-073adb6d4f75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:58:21.811931 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104acca1-8c1c-4744-bbcf-073adb6d4f75 service placement] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:58:21.823198 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1461/2898] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:58:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:58:25.113865 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ee135-9441-4960-a92e-041184dbaed8 service swift] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:58:25.125949 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ee135-9441-4960-a92e-041184dbaed8 service swift] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:58:25.131877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513ef3c-f7f8-4ce7-9319-4829aa69e06d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13562e65139b44ab931fb8fdb41a61b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:58:25.132821 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513ef3c-f7f8-4ce7-9319-4829aa69e06d service placement] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:58:25.133176 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513ef3c-f7f8-4ce7-9319-4829aa69e06d service placement] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:58:25.133483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513ef3c-f7f8-4ce7-9319-4829aa69e06d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:58:25.135412 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-2513ef3c-f7f8-4ce7-9319-4829aa69e06d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:58:25.147612 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513ef3c-f7f8-4ce7-9319-4829aa69e06d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:58:25.149214 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513ef3c-f7f8-4ce7-9319-4829aa69e06d service placement] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:58:25.160513 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1438/2899] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:58:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:58:25.172836 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104acca1-8c1c-4744-bbcf-073adb6d4f75 service placement] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:58:25.174264 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-104acca1-8c1c-4744-bbcf-073adb6d4f75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:58:25.239645 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104acca1-8c1c-4744-bbcf-073adb6d4f75 service placement] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:58:25.244209 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6006e8-3e3b-49d5-9822-0038b625dda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:58:25.245132 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6006e8-3e3b-49d5-9822-0038b625dda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:58:25.245404 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6006e8-3e3b-49d5-9822-0038b625dda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:58:25.245677 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6006e8-3e3b-49d5-9822-0038b625dda8 admin admin] PATH_INFO: `/v3/users/a32171f3dfcf47918b28e6b583e28c52` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:58:25.246901 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6006e8-3e3b-49d5-9822-0038b625dda8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32171f3dfcf47918b28e6b583e28c52)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:58:25.248823 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6006e8-3e3b-49d5-9822-0038b625dda8 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:58:25.296723 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:58:25.306605 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-2f6006e8-3e3b-49d5-9822-0038b625dda8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32171f3dfcf47918b28e6b583e28c52'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.318342 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-2f6006e8-3e3b-49d5-9822-0038b625dda8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32171f3dfcf47918b28e6b583e28c52'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.319026 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-2f6006e8-3e3b-49d5-9822-0038b625dda8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32171f3dfcf47918b28e6b583e28c52'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.326047 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-2f6006e8-3e3b-49d5-9822-0038b625dda8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32171f3dfcf47918b28e6b583e28c52'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.326727 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-2f6006e8-3e3b-49d5-9822-0038b625dda8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32171f3dfcf47918b28e6b583e28c52'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.344932 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1462/2900] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:58:25 2022] DELETE /identity/v3/users/a32171f3dfcf47918b28e6b583e28c52 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:58:25.534400 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513ef3c-f7f8-4ce7-9319-4829aa69e06d service placement] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:58:25.545417 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513ef3c-f7f8-4ce7-9319-4829aa69e06d service placement] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:58:25.604226 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:58:25.605090 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:58:25.605366 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:58:25.605636 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] PATH_INFO: `/v3/projects/31fc6d2e86af483692a6768f7ad65012` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:58:25.606883 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31fc6d2e86af483692a6768f7ad65012)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:58:25.608876 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:58:25.657340 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31fc6d2e86af483692a6768f7ad65012', 'request_id': 'req-79fc8b46-3e06-44d7-b744-b1278ed86e74'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.666289 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31fc6d2e86af483692a6768f7ad65012', 'request_id': 'req-79fc8b46-3e06-44d7-b744-b1278ed86e74'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.671887 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31fc6d2e86af483692a6768f7ad65012', 'request_id': 'req-79fc8b46-3e06-44d7-b744-b1278ed86e74'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.683096 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] The token cache is being invalidate because project 31fc6d2e86af483692a6768f7ad65012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:58:25.683380 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.684018 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.685594 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1439/2901] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:58:25 2022] DELETE /identity/v3/projects/31fc6d2e86af483692a6768f7ad65012 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:58:25.689917 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6006e8-3e3b-49d5-9822-0038b625dda8 admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:58:25.691415 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-2f6006e8-3e3b-49d5-9822-0038b625dda8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:58:25.704471 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6006e8-3e3b-49d5-9822-0038b625dda8 admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:58:25.762056 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbed11e-e3dc-4557-9966-86279359ce6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:58:25.762937 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbed11e-e3dc-4557-9966-86279359ce6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:58:25.763220 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbed11e-e3dc-4557-9966-86279359ce6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:58:25.763489 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbed11e-e3dc-4557-9966-86279359ce6b admin admin] PATH_INFO: `/v3/users/893993b79973426db68c208ad70efc13` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:58:25.764794 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbed11e-e3dc-4557-9966-86279359ce6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=893993b79973426db68c208ad70efc13)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:58:25.766758 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbed11e-e3dc-4557-9966-86279359ce6b admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:58:25.814558 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-acbed11e-e3dc-4557-9966-86279359ce6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893993b79973426db68c208ad70efc13'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.827344 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-acbed11e-e3dc-4557-9966-86279359ce6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893993b79973426db68c208ad70efc13'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.828016 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-acbed11e-e3dc-4557-9966-86279359ce6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893993b79973426db68c208ad70efc13'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.835413 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-acbed11e-e3dc-4557-9966-86279359ce6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893993b79973426db68c208ad70efc13'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.836027 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-acbed11e-e3dc-4557-9966-86279359ce6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893993b79973426db68c208ad70efc13'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:25.850461 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1463/2902] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 03:58:25 2022] DELETE /identity/v3/users/893993b79973426db68c208ad70efc13 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:58:26.045346 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:58:26.046956 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:58:26.065699 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc8b46-3e06-44d7-b744-b1278ed86e74 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:58:26.070381 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:58:26.132947 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:58:26.133828 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:58:26.134111 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:58:26.134382 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] PATH_INFO: `/v3/projects/253fcfe1a8434f088c67dbe1581736b7` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:58:26.135607 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=253fcfe1a8434f088c67dbe1581736b7)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:58:26.137949 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:58:26.187403 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253fcfe1a8434f088c67dbe1581736b7', 'request_id': 'req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:26.196398 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253fcfe1a8434f088c67dbe1581736b7', 'request_id': 'req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:26.202755 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253fcfe1a8434f088c67dbe1581736b7', 'request_id': 'req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:26.214277 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] The token cache is being invalidate because project 253fcfe1a8434f088c67dbe1581736b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87039) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 03:58:26.214564 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:26.215312 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 03:58:26.216963 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1440/2903] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 03:58:26 2022] DELETE /identity/v3/projects/253fcfe1a8434f088c67dbe1581736b7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 03:58:35.847152 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=68,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:58:36.211501 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:58:48.473277 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbed11e-e3dc-4557-9966-86279359ce6b admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:58:48.475929 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-acbed11e-e3dc-4557-9966-86279359ce6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:58:48.546962 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbed11e-e3dc-4557-9966-86279359ce6b admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:58:48.597766 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90750710-5409-401c-92be-7241b8d411e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:58:48.598446 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90750710-5409-401c-92be-7241b8d411e2 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:58:48.598729 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90750710-5409-401c-92be-7241b8d411e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:58:48.599029 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90750710-5409-401c-92be-7241b8d411e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:58:48.601336 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-90750710-5409-401c-92be-7241b8d411e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:58:48.678673 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90750710-5409-401c-92be-7241b8d411e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:58:48.680079 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90750710-5409-401c-92be-7241b8d411e2 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:58:48.691656 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1464/2904] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:58:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:58:49.882736 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:58:49.884436 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:58:49.898253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec4ec7-7da0-4b7c-b143-6f63b3fe3a0b admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:58:49.903234 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17b38e-5162-4c3d-a144-b142f5142b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:58:49.903877 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17b38e-5162-4c3d-a144-b142f5142b6e service neutron] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:58:49.904159 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17b38e-5162-4c3d-a144-b142f5142b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:58:49.904427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17b38e-5162-4c3d-a144-b142f5142b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:58:49.906565 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-aa17b38e-5162-4c3d-a144-b142f5142b6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:58:49.920752 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17b38e-5162-4c3d-a144-b142f5142b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:58:49.922198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17b38e-5162-4c3d-a144-b142f5142b6e service neutron] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:58:49.933466 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1441/2905] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:58:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 03:58:58.686298 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=74 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:58:59.928332 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=6 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 03:59:58.540669 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90750710-5409-401c-92be-7241b8d411e2 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 03:59:58.551086 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90750710-5409-401c-92be-7241b8d411e2 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 03:59:58.555713 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb36fb-12b8-413c-a647-a837294602d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3aa7416101948aba0b45129174cd988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 03:59:58.556395 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb36fb-12b8-413c-a647-a837294602d2 service neutron] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 03:59:58.556674 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb36fb-12b8-413c-a647-a837294602d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 03:59:58.556946 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb36fb-12b8-413c-a647-a837294602d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 03:59:58.559314 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-6dfb36fb-12b8-413c-a647-a837294602d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 03:59:58.570051 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb36fb-12b8-413c-a647-a837294602d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 03:59:58.571556 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb36fb-12b8-413c-a647-a837294602d2 service neutron] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 03:59:58.580218 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1465/2906] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 03:59:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 04:00:08.576416 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=6 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:00:16.626471 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17b38e-5162-4c3d-a144-b142f5142b6e service neutron] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 04:00:16.627932 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-aa17b38e-5162-4c3d-a144-b142f5142b6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 04:00:16.646028 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17b38e-5162-4c3d-a144-b142f5142b6e service neutron] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 04:00:16.651993 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb56d08-3036-42d8-bcc8-43597ef7c8cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 04:00:16.652649 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb56d08-3036-42d8-bcc8-43597ef7c8cf service nova] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 04:00:16.652930 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb56d08-3036-42d8-bcc8-43597ef7c8cf service nova] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 04:00:16.653206 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb56d08-3036-42d8-bcc8-43597ef7c8cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 04:00:16.655061 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6fb56d08-3036-42d8-bcc8-43597ef7c8cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 04:00:16.668407 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb56d08-3036-42d8-bcc8-43597ef7c8cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 04:00:16.670003 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb56d08-3036-42d8-bcc8-43597ef7c8cf service nova] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 04:00:16.681722 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1442/2907] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 04:00:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 04:00:18.518116 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb36fb-12b8-413c-a647-a837294602d2 service neutron] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 04:00:18.534589 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb36fb-12b8-413c-a647-a837294602d2 service neutron] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 04:00:18.541380 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574182a-be62-40f3-aa56-ce97c883ed44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758b152c320e4a94921bb96541cbea98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 04:00:18.542115 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574182a-be62-40f3-aa56-ce97c883ed44 service nova] REQUEST_METHOD: `GET` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 04:00:18.542400 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574182a-be62-40f3-aa56-ce97c883ed44 service nova] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 04:00:18.542678 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574182a-be62-40f3-aa56-ce97c883ed44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 04:00:18.545304 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-b574182a-be62-40f3-aa56-ce97c883ed44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 04:00:18.559174 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574182a-be62-40f3-aa56-ce97c883ed44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 04:00:18.560780 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574182a-be62-40f3-aa56-ce97c883ed44 service nova] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 04:00:18.571994 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1466/2908] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 04:00:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 04:00:25.686124 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb56d08-3036-42d8-bcc8-43597ef7c8cf service nova] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 04:00:25.687661 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-6fb56d08-3036-42d8-bcc8-43597ef7c8cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 04:00:25.757054 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb56d08-3036-42d8-bcc8-43597ef7c8cf service nova] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 04:00:25.762791 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f7312-7279-4cd3-ae81-14b42b501589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 04:00:25.763708 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f7312-7279-4cd3-ae81-14b42b501589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 04:00:25.763992 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f7312-7279-4cd3-ae81-14b42b501589 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 04:00:25.764269 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f7312-7279-4cd3-ae81-14b42b501589 admin admin] PATH_INFO: `/v3/users/e95a9d89651045e289c85da2c9e8f56c` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 04:00:25.765678 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f7312-7279-4cd3-ae81-14b42b501589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95a9d89651045e289c85da2c9e8f56c)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 04:00:25.767712 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f7312-7279-4cd3-ae81-14b42b501589 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 04:00:25.817503 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e95f7312-7279-4cd3-ae81-14b42b501589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95a9d89651045e289c85da2c9e8f56c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:25.829198 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e95f7312-7279-4cd3-ae81-14b42b501589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95a9d89651045e289c85da2c9e8f56c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:25.836416 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e95f7312-7279-4cd3-ae81-14b42b501589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95a9d89651045e289c85da2c9e8f56c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:25.837132 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e95f7312-7279-4cd3-ae81-14b42b501589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95a9d89651045e289c85da2c9e8f56c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:25.837747 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-e95f7312-7279-4cd3-ae81-14b42b501589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95a9d89651045e289c85da2c9e8f56c'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:25.854253 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1443/2909] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 04:00:25 2022] DELETE /identity/v3/users/e95a9d89651045e289c85da2c9e8f56c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 04:00:26.033848 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574182a-be62-40f3-aa56-ce97c883ed44 service nova] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 04:00:26.045151 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574182a-be62-40f3-aa56-ce97c883ed44 service nova] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 04:00:26.106171 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 04:00:26.107064 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 04:00:26.107345 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 04:00:26.107617 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] PATH_INFO: `/v3/projects/7cd83043daa64be78e992f28808aceb0` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 04:00:26.108819 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd83043daa64be78e992f28808aceb0)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 04:00:26.110737 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 04:00:26.160918 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd83043daa64be78e992f28808aceb0', 'request_id': 'req-bbf33992-3e4f-4245-b202-e906da8356bd'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.171510 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd83043daa64be78e992f28808aceb0', 'request_id': 'req-bbf33992-3e4f-4245-b202-e906da8356bd'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.178610 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd83043daa64be78e992f28808aceb0', 'request_id': 'req-bbf33992-3e4f-4245-b202-e906da8356bd'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.189313 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] The token cache is being invalidate because project 7cd83043daa64be78e992f28808aceb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 04:00:26.189593 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.190271 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.192431 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1467/2910] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 04:00:26 2022] DELETE /identity/v3/projects/7cd83043daa64be78e992f28808aceb0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 04:00:26.196658 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f7312-7279-4cd3-ae81-14b42b501589 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 04:00:26.198108 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-e95f7312-7279-4cd3-ae81-14b42b501589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 04:00:26.211714 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f7312-7279-4cd3-ae81-14b42b501589 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 04:00:26.271306 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29c25f-f87f-423e-9b0a-fb684f63b5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 04:00:26.272177 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29c25f-f87f-423e-9b0a-fb684f63b5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 04:00:26.272458 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29c25f-f87f-423e-9b0a-fb684f63b5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 04:00:26.272730 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29c25f-f87f-423e-9b0a-fb684f63b5f2 admin admin] PATH_INFO: `/v3/users/72fc0ce7d7ef4ae084f5d75c498902ce` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 04:00:26.273922 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29c25f-f87f-423e-9b0a-fb684f63b5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72fc0ce7d7ef4ae084f5d75c498902ce)` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 04:00:26.275899 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29c25f-f87f-423e-9b0a-fb684f63b5f2 admin admin] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 04:00:26.281440 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:00:26.329195 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ec29c25f-f87f-423e-9b0a-fb684f63b5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72fc0ce7d7ef4ae084f5d75c498902ce'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.342321 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ec29c25f-f87f-423e-9b0a-fb684f63b5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72fc0ce7d7ef4ae084f5d75c498902ce'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.349427 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ec29c25f-f87f-423e-9b0a-fb684f63b5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72fc0ce7d7ef4ae084f5d75c498902ce'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.350155 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ec29c25f-f87f-423e-9b0a-fb684f63b5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72fc0ce7d7ef4ae084f5d75c498902ce'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.350847 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.notifications [None req-ec29c25f-f87f-423e-9b0a-fb684f63b5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72fc0ce7d7ef4ae084f5d75c498902ce'} {{(pid=87039) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.367100 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1444/2911] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 04:00:26 2022] DELETE /identity/v3/users/72fc0ce7d7ef4ae084f5d75c498902ce => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 04:00:26.568424 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] Authenticating user token {{(pid=87040) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 04:00:26.569997 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.fernet_utils [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87040) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 04:00:26.585129 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf33992-3e4f-4245-b202-e906da8356bd admin admin] Validating token access rules against request {{(pid=87040) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 04:00:26.647851 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344ae52-9872-4590-a08b-e167f22dd2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1cf291bfd64ba287443cde4df814a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26fd4a4f105a4803a50f2696df78fba5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87040) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 04:00:26.648733 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344ae52-9872-4590-a08b-e167f22dd2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 04:00:26.649005 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344ae52-9872-4590-a08b-e167f22dd2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 04:00:26.649279 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344ae52-9872-4590-a08b-e167f22dd2c1 admin admin] PATH_INFO: `/v3/projects/ef27f50e24d44317bbe5b44f12e6e04c` {{(pid=87040) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 04:00:26.650622 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344ae52-9872-4590-a08b-e167f22dd2c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef27f50e24d44317bbe5b44f12e6e04c)` {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 04:00:26.652613 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344ae52-9872-4590-a08b-e167f22dd2c1 admin admin] RBAC: Authorization granted {{(pid=87040) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 04:00:26.676149 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:00:26.705768 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3344ae52-9872-4590-a08b-e167f22dd2c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef27f50e24d44317bbe5b44f12e6e04c', 'request_id': 'req-3344ae52-9872-4590-a08b-e167f22dd2c1'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.714724 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3344ae52-9872-4590-a08b-e167f22dd2c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef27f50e24d44317bbe5b44f12e6e04c', 'request_id': 'req-3344ae52-9872-4590-a08b-e167f22dd2c1'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.721311 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3344ae52-9872-4590-a08b-e167f22dd2c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef27f50e24d44317bbe5b44f12e6e04c', 'request_id': 'req-3344ae52-9872-4590-a08b-e167f22dd2c1'} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.733979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3344ae52-9872-4590-a08b-e167f22dd2c1 admin admin] The token cache is being invalidate because project ef27f50e24d44317bbe5b44f12e6e04c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87040) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 04:00:26.733979 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3344ae52-9872-4590-a08b-e167f22dd2c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.734670 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG keystone.notifications [None req-3344ae52-9872-4590-a08b-e167f22dd2c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87040) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 04:00:26.736384 dv-cinder-846842-7-smb devstack@keystone.service[87040]: [pid: 87040|app: 0|req: 1468/2912] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 04:00:26 2022] DELETE /identity/v3/projects/ef27f50e24d44317bbe5b44f12e6e04c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 04:00:36.363483 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:00:36.730479 dv-cinder-846842-7-smb devstack@keystone.service[87040]: DEBUG dbcounter [-] [87040] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:02:02.791656 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29c25f-f87f-423e-9b0a-fb684f63b5f2 admin admin] Authenticating user token {{(pid=87039) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 04:02:02.793257 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-ec29c25f-f87f-423e-9b0a-fb684f63b5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 04:02:02.942622 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29c25f-f87f-423e-9b0a-fb684f63b5f2 admin admin] Validating token access rules against request {{(pid=87039) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 04:02:03.014261 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fbdb3-aa71-4295-bcde-5297d4d10043 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13562e65139b44ab931fb8fdb41a61b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e59c2ab83c477385e5a81b32a7c897', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87039) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 04:02:03.014954 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fbdb3-aa71-4295-bcde-5297d4d10043 service placement] REQUEST_METHOD: `GET` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 04:02:03.015211 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fbdb3-aa71-4295-bcde-5297d4d10043 service placement] SCRIPT_NAME: `/identity` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 04:02:03.015509 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fbdb3-aa71-4295-bcde-5297d4d10043 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87039) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 04:02:03.017693 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.fernet_utils [None req-af9fbdb3-aa71-4295-bcde-5297d4d10043 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87039) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 04:02:03.029660 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fbdb3-aa71-4295-bcde-5297d4d10043 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 04:02:03.031290 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fbdb3-aa71-4295-bcde-5297d4d10043 service placement] RBAC: Authorization granted {{(pid=87039) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 04:02:03.041531 dv-cinder-846842-7-smb devstack@keystone.service[87039]: [pid: 87039|app: 0|req: 1445/2913] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 04:02:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 04:02:13.037657 dv-cinder-846842-7-smb devstack@keystone.service[87039]: DEBUG dbcounter [-] [87039] Writing DB stats keystone:SELECT=89 {{(pid=87039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}